-- Logs begin at Mon 2022-08-08 16:52:09 UTC, end at Mon 2022-08-08 18:05:52 UTC. -- Aug 08 17:31:06.259202 dv-cinder-852364-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 08 17:31:06.268571 dv-cinder-852364-1-smb devstack@keystone.service[86908]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 08 17:31:06.270568 dv-cinder-852364-1-smb devstack@keystone.service[86908]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 8 17:31:06 2022] *** Aug 08 17:31:06.270568 dv-cinder-852364-1-smb devstack@keystone.service[86908]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 08 17:31:06.270568 dv-cinder-852364-1-smb devstack@keystone.service[86908]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 08 17:31:06.270568 dv-cinder-852364-1-smb devstack@keystone.service[86908]: nodename: dv-cinder-852364-1-smb Aug 08 17:31:06.270568 dv-cinder-852364-1-smb devstack@keystone.service[86908]: machine: x86_64 Aug 08 17:31:06.270568 dv-cinder-852364-1-smb devstack@keystone.service[86908]: clock source: unix Aug 08 17:31:06.270568 dv-cinder-852364-1-smb devstack@keystone.service[86908]: pcre jit disabled Aug 08 17:31:06.270568 dv-cinder-852364-1-smb devstack@keystone.service[86908]: detected number of CPU cores: 4 Aug 08 17:31:06.270568 dv-cinder-852364-1-smb devstack@keystone.service[86908]: current working directory: / Aug 08 17:31:06.270568 dv-cinder-852364-1-smb devstack@keystone.service[86908]: detected binary path: /usr/bin/uwsgi-core Aug 08 17:31:06.270568 dv-cinder-852364-1-smb devstack@keystone.service[86908]: your processes number limit is 47680 Aug 08 17:31:06.271253 dv-cinder-852364-1-smb devstack@keystone.service[86908]: your memory page size is 4096 bytes Aug 08 17:31:06.271253 dv-cinder-852364-1-smb devstack@keystone.service[86908]: detected max file descriptor number: 2048 Aug 08 17:31:06.271253 dv-cinder-852364-1-smb devstack@keystone.service[86908]: lock engine: pthread robust mutexes Aug 08 17:31:06.271253 dv-cinder-852364-1-smb devstack@keystone.service[86908]: thunder lock: enabled Aug 08 17:31:06.271253 dv-cinder-852364-1-smb devstack@keystone.service[86908]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 08 17:31:06.271253 dv-cinder-852364-1-smb devstack@keystone.service[86908]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 08 17:31:06.311647 dv-cinder-852364-1-smb devstack@keystone.service[86908]: Python main interpreter initialized at 0x5621b04859c0 Aug 08 17:31:06.311647 dv-cinder-852364-1-smb devstack@keystone.service[86908]: python threads support enabled Aug 08 17:31:06.311647 dv-cinder-852364-1-smb devstack@keystone.service[86908]: your server socket listen backlog is limited to 100 connections Aug 08 17:31:06.311647 dv-cinder-852364-1-smb devstack@keystone.service[86908]: your mercy for graceful operations on workers is 90 seconds Aug 08 17:31:06.312098 dv-cinder-852364-1-smb devstack@keystone.service[86908]: mapped 403077 bytes (393 KB) for 2 cores Aug 08 17:31:06.312098 dv-cinder-852364-1-smb devstack@keystone.service[86908]: *** Operational MODE: preforking *** Aug 08 17:31:06.312361 dv-cinder-852364-1-smb devstack@keystone.service[86908]: *** uWSGI is running in multiple interpreter mode *** Aug 08 17:31:06.312361 dv-cinder-852364-1-smb devstack@keystone.service[86908]: spawned uWSGI master process (pid: 86908) Aug 08 17:31:06.312571 dv-cinder-852364-1-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 08 17:31:06.315089 dv-cinder-852364-1-smb devstack@keystone.service[86908]: spawned uWSGI worker 1 (pid: 86919, cores: 1) Aug 08 17:31:06.315089 dv-cinder-852364-1-smb devstack@keystone.service[86908]: spawned uWSGI worker 2 (pid: 86920, cores: 1) Aug 08 17:31:06.315089 dv-cinder-852364-1-smb devstack@keystone.service[86908]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 08 17:31:11.895446 dv-cinder-852364-1-smb devstack@keystone.service[86920]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 17:31:11.895446 dv-cinder-852364-1-smb devstack@keystone.service[86920]: from cryptography.utils import int_from_bytes Aug 08 17:31:11.896280 dv-cinder-852364-1-smb devstack@keystone.service[86919]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 17:31:11.896280 dv-cinder-852364-1-smb devstack@keystone.service[86919]: from cryptography.utils import int_from_bytes Aug 08 17:31:11.896722 dv-cinder-852364-1-smb devstack@keystone.service[86920]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 17:31:11.896722 dv-cinder-852364-1-smb devstack@keystone.service[86920]: from cryptography.utils import int_from_bytes Aug 08 17:31:11.896860 dv-cinder-852364-1-smb devstack@keystone.service[86919]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 17:31:11.896860 dv-cinder-852364-1-smb devstack@keystone.service[86919]: from cryptography.utils import int_from_bytes Aug 08 17:31:11.946390 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 17:31:11.946578 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 17:31:11.946665 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 17:31:11.946754 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 17:31:11.946839 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] command line args: [] {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 17:31:11.946918 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] command line args: [] {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 17:31:11.947039 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 17:31:11.947120 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 17:31:11.947225 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ================================================================================ {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 17:31:11.947311 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ================================================================================ {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 17:31:11.947496 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] admin_token = **** {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.947585 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] admin_token = **** {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.947749 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] config_dir = [] {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.947831 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] config_dir = [] {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.947942 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.948023 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.948130 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] config_source = [] {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.948217 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] config_source = [] {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.948301 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] debug = True {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.948381 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] debug = True {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.948503 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.948820 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.948961 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.949104 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.949220 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.949322 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.949418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.949514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.949626 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.949731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.949829 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] list_limit = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.949932 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] list_limit = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.950042 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] log_config_append = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.950145 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] log_config_append = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.950251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.950860 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.950969 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] log_dir = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.951385 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] log_dir = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.951515 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] log_file = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.951604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] log_file = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.951696 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.951848 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.951993 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.952094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.952198 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.952285 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.952360 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.952485 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.952571 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.952692 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.952770 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.952855 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.952930 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.953064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.953142 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.953272 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.953356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.953438 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.953511 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.953628 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.953711 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.953773 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.953930 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.954064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.954167 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.954293 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.954377 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.954457 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.954531 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.954615 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.954851 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.70/identity {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.954987 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.70/identity {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.955129 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] publish_errors = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.955210 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] publish_errors = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.955289 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.955362 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.955495 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.955620 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.955703 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.955828 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.955904 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.955995 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.956126 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.956244 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.956349 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] standard_threads = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.956430 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] standard_threads = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.956553 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.956640 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.956760 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.956844 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.956942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.957021 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.957166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] use_journal = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.957294 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] use_journal = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.957411 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] use_json = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.957526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] use_json = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.957642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] use_stderr = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.957758 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] use_stderr = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.957879 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] use_syslog = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.958066 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] use_syslog = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.958184 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.958306 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 17:31:11.958428 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.958550 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.958669 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.958795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.958912 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.959033 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.959147 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.959262 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.959377 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.959500 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.959617 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.959733 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.959848 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.959968 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.960091 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.960215 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.960332 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.960446 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.960561 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.960676 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.960792 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.960915 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.961045 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.961162 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.961278 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.961403 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.961529 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.961661 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.961778 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.961885 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.961998 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.962113 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.962236 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.962359 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.962476 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.962591 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.962712 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.962834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.962958 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.963074 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.963190 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.963296 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.963409 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.963523 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.963716 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.963834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.963957 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.964072 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.964186 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.964307 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.964432 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.964549 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.964665 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.964779 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.964901 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.965024 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.965188 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.965306 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.965421 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.965543 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.965666 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.965782 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.965950 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.966627 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.966734 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.966839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.966944 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.967050 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.967339 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.967453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.967560 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.967658 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.967755 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.967852 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.967960 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.968069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.968168 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.968264 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.968392 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.968509 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.968627 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.968733 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.968831 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.968927 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.969047 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.969153 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.976774 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.976920 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.977062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.977171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.977273 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.977398 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.977508 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.977655 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.977763 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.977861 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.977958 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.978055 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.978154 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.978244 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.978365 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.978481 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.978564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.978627 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.978751 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.978839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.978963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.979037 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.979118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.979198 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.979276 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.979402 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.979480 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.979596 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.979671 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.979743 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.979872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.979945 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.980018 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.980133 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.980209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.980280 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.980408 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.980480 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.980552 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.980679 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.980810 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.980927 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.981007 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.981155 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.981234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.981234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.981412 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.981527 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.981704 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.982242 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.982389 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.982465 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.982585 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.982662 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.982728 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.982875 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.982950 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.983076 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.983154 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.983231 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.983304 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.983430 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.983508 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.983576 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.983636 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.983707 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.983767 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.983839 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.983914 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.984027 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.984105 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.984221 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.984221 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.984355 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.984438 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.984512 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.984582 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.984652 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.984729 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.984801 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.984801 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.984939 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.985011 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.985135 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.985135 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.985265 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.985349 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.985467 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.985544 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.985615 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.985686 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.985757 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.985837 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.985911 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.985990 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.986063 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.986134 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.986204 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.986283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.986355 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.986426 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.986495 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.986566 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.986636 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.986718 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.986792 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.986863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.986933 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.987004 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.987074 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.987152 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.987225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.987296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.987367 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.987436 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.987507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.987585 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.987664 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.987737 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.987808 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.987878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] auth.external = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.987949 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.988080 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.988158 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.988230 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.988311 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] auth.external = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.988385 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.988484 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.988569 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] auth.password = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.988569 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] auth.token = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.988710 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.988786 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.988858 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.988935 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.989008 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] auth.password = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.989008 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] auth.token = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.989166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.989248 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.989321 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.989394 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.989465 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.989537 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.989617 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.989713 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.989796 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.989878 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.990212 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] credential.caching = True {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.990291 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.990377 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.990451 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.990523 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.990594 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] credential.caching = True {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.990667 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.990738 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.990820 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.990900 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.990974 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.990974 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.991134 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.991134 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.991276 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.991348 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.991420 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.991492 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.991612 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.991698 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.991773 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.991845 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.991917 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.991988 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.992060 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.992207 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.992284 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.992357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.992437 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.992511 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.992584 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.992664 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.992738 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] federation.caching = True {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.992810 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.992882 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.992960 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.993053 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.993140 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] federation.caching = True {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.993215 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.993334 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.993412 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.993412 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.993544 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.993662 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.993736 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.993813 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.993886 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.993957 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.994038 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.994123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.994197 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.994269 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.994341 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.994413 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.994484 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.994566 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] identity.caching = True {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.994640 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.994717 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.994801 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.994876 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.994949 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.995028 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.995103 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] identity.caching = True {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.995175 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.995246 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.995317 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.995395 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.995476 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.995550 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.995650 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.995729 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.995803 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.995875 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.995954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.996034 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.996106 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.996178 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.996249 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.996320 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.996399 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.996467 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.996540 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.996612 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.996683 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.996755 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.996834 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.996907 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.996985 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.997074 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.997148 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.997703 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.997793 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.998389 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.998480 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.998555 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.998629 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.998629 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.998773 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.998846 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.998924 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.998996 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.999067 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.999150 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.999224 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.999296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.999367 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.999438 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.999509 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.999589 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.999657 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.999728 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.999799 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.999877 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:11.999953 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.000114 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.000198 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.000355 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.000442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.000608 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.000690 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.000870 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.000951 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.001135 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.001219 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.001380 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.001473 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.001618 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.001700 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.001863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.001942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.002107 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.002211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.002467 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.002560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.002685 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.002763 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.002836 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.002908 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.003060 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.003140 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.003309 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.003389 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.003543 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.003662 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.003788 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.003905 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.004020 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.004134 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.004249 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.004364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.004488 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.004603 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.004718 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.004835 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.004951 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.005102 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.005230 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.user = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.005347 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.005463 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.005571 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.005684 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.005803 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.005929 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.006045 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.006160 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.user = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.006273 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.006388 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.006502 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.006625 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.006740 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.006855 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.006978 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.007094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.007209 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.007317 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.007433 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.007548 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.007664 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.007779 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.007893 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.008017 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.008134 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.008250 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.008365 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.008480 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.008594 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.008717 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.008833 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.008948 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.009127 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.009245 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.009360 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.009488 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.009606 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.009760 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.009863 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.009960 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.010058 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.010164 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.010263 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.010359 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.010455 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.010551 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.010648 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.010754 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.010852 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.010950 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.011047 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.011145 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.011250 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.011372 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.011478 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.011609 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.011714 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.011858 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.012035 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.012137 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.012235 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.012331 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.012427 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.012549 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.012663 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.012800 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.013719 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.014112 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.014233 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.014350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.014481 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.014600 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.014718 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.014834 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] resource.caching = True {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.014950 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.015066 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.015191 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.015310 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.015426 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.015542 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.015659 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.015766 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.015889 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] resource.caching = True {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.016007 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.016128 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.016244 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.016363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.016479 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.016603 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.016721 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.016845 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.016963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.017120 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.017239 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] role.caching = True {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.017367 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.017486 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] role.driver = sql {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.017602 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.017725 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.017843 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.017955 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.018080 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.018197 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.018315 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] role.caching = True {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.018431 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.018547 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] role.driver = sql {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.018662 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.018788 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.018905 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.019022 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.019137 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.019253 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.019369 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.019495 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.019612 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.019761 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.019877 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.019993 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.020109 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.020238 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.020356 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.020472 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.020589 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.020705 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.020819 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.020944 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.020944 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.021179 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.021296 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.021412 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.021540 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.021660 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.021776 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.021892 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.022000 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.022114 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.022238 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.022355 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.022471 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.022587 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.022703 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.022818 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.022818 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.023045 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.023160 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.023276 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.023391 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.023508 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.023632 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.023750 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.023849 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.023929 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.024002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.024082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.024164 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.024239 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.024383 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.024493 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.024591 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.024756 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.024887 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.025004 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.025154 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.025273 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] token.caching = True {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.025389 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.025504 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.025632 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.025751 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.025871 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.025988 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.026094 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.026208 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.026334 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.026452 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.026568 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] token.caching = True {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.026683 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.026799 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.026915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.027040 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.027156 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.027272 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.027386 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.027489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.027603 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.027727 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.027844 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.027961 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.028076 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.028190 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.028305 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.028429 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.028750 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.029231 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.029350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.029467 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.029583 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.029713 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.029713 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.029933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.030050 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.030159 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] database.connection = **** {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.030285 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.030411 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.030537 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.030654 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.030795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.030914 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.031053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.031169 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.031169 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.031396 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] database.connection = **** {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.031521 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.031647 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.031765 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.031880 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.031995 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.032188 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.032306 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.032422 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.032536 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.032651 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.032766 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.032889 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.033014 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.033184 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.033299 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.033414 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.033529 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.033656 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.033773 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.033890 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.034038 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.034156 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.034273 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.034397 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.034514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.034659 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.034807 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 17:31:12.034926 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.034926 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.034926 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.034926 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.035354 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 17:31:12.035354 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 17:31:12.063763 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.063998 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.064687 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.064779 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.064779 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.064925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.074356 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.075068 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.104576 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.104800 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.104891 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.105096 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.158384 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.158761 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.209689 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.209918 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.211014 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.211255 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.274653 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.274886 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.274977 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.275115 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.275203 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.275360 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.275444 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.275549 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.275635 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.275770 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.275863 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.276011 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.299465 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.299692 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.299814 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.299921 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.300057 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.300142 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.300287 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.300368 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.300514 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.300605 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.300738 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.300819 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.300957 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.301207 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.312685 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.313251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.326169 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.326397 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.326624 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.326737 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.326850 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.326937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.327069 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.327152 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.327288 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.327381 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.327503 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.327586 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.327743 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.327962 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 17:31:12.344369 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.344582 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 08 17:31:12.344929 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.345161 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 08 17:31:12.345248 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.345398 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 08 17:31:12.345482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.345700 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.345821 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.345966 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.346073 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 08 17:31:12.346229 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.346320 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.346551 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.346817 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.347082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.358282 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.358571 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.358849 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.359145 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.359437 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.359732 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.360011 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.360299 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.366379 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=86920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 17:31:12.367658 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=86919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 17:31:12.369506 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=86920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 17:31:12.369791 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.370078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.370363 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.370650 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.370778 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=86919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 17:31:12.370918 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.371071 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.371192 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.371361 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.371470 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.371652 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.371745 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.371943 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.372027 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.372827 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.372920 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.373144 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.373433 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.373707 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.373988 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.374261 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.396076 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.397616 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 17:31:12.397909 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.401173 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.402515 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=86920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 17:31:12.402700 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 17:31:12.402846 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.402991 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.403080 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.407904 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=86919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 17:31:12.408193 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.408530 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.410962 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=86920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 17:31:12.410962 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.414264 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 17:31:12.414563 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.414864 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.415092 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=86919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 17:31:12.415182 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.415384 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.415469 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.415711 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.416002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.416301 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.420082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 17:31:12.420377 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.420666 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.420958 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.421276 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.421576 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.421860 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.422136 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.432882 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.433228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.437864 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 17:31:12.438718 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.439004 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.441015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.441336 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.443029 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 17:31:12.445752 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 17:31:12.446237 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.446541 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.448938 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 17:31:12.451158 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 17:31:12.452163 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.452470 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.452762 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.453089 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.453378 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.453676 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.454393 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 17:31:12.457569 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.457878 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.458185 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.458481 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.458770 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.459070 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.469863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 17:31:12.470153 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.470430 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.470703 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.475088 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 17:31:12.475391 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.475668 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.475938 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.477676 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.479239 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.479523 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.482978 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=86920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 17:31:12.483264 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.483562 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.483658 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.483872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.484156 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.485163 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.485447 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.488249 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=86919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 17:31:12.488541 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.488839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.489163 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.489447 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.495812 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=86920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 17:31:12.496104 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.496394 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.496682 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.496971 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.497860 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.498184 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.501851 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=86919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 17:31:12.502145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.502435 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.502732 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.503022 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.503305 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.503586 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.514856 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=86920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 17:31:12.517841 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 17:31:12.520422 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=86919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 17:31:12.520778 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.522401 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.523417 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 17:31:12.523891 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=86920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 17:31:12.524181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.524489 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.526404 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.527979 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.529893 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=86919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 17:31:12.530194 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.530492 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.531089 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.532714 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=86920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 17:31:12.535681 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.535959 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.536262 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.536550 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.536932 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.538586 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=86919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 17:31:12.541528 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.541825 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.542123 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.542413 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.545180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 17:31:12.545479 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.545767 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.551287 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 17:31:12.551676 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.551972 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.552620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=86920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 17:31:12.552914 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.553230 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.553518 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.553798 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.554095 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.554377 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.554660 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.555044 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.555323 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.555604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.555913 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.556178 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.556447 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.558957 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=86919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 17:31:12.559247 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.559537 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.560043 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.560340 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.560628 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.560909 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.561218 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.561611 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.561906 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.562185 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.562468 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.562754 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.563049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 17:31:12.590307 dv-cinder-852364-1-smb devstack@keystone.service[86920]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5621b04859c0 pid: 86920 (default app) Aug 08 17:31:12.593771 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f65465-c06f-4bd0-b538-8f3971d2c681 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:12.594063 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f65465-c06f-4bd0-b538-8f3971d2c681 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:12.594415 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f65465-c06f-4bd0-b538-8f3971d2c681 None None] PATH_INFO: `/v3` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:12.597149 dv-cinder-852364-1-smb devstack@keystone.service[86919]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5621b04859c0 pid: 86919 (default app) Aug 08 17:31:12.598647 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1/1] 10.222.0.70 () {50 vars in 791 bytes} [Mon Aug 8 17:31:12 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:21.379851 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05ca01-46e5-42ae-91ec-eafbf92d7a60 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:21.380434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05ca01-46e5-42ae-91ec-eafbf92d7a60 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:21.380434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05ca01-46e5-42ae-91ec-eafbf92d7a60 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:21.384903 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1/2] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 17:31:21.390691 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4e469-ec31-455a-b6ff-c354dc59b6bc None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:21.391138 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4e469-ec31-455a-b6ff-c354dc59b6bc None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:21.391229 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4e469-ec31-455a-b6ff-c354dc59b6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:21.461805 dv-cinder-852364-1-smb devstack@keystone.service[86920]: INFO dbcounter [None req-a7c4e469-ec31-455a-b6ff-c354dc59b6bc None None] Registered counter for database keystone Aug 08 17:31:21.487612 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG oslo_db.sqlalchemy.engines [None req-a7c4e469-ec31-455a-b6ff-c354dc59b6bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 17:31:21.494916 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writer thread running {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 17:31:21.678287 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG passlib.handlers.bcrypt [None req-a7c4e469-ec31-455a-b6ff-c354dc59b6bc None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86920) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 08 17:31:21.678640 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG passlib.handlers.bcrypt [None req-a7c4e469-ec31-455a-b6ff-c354dc59b6bc None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86920) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 08 17:31:21.733981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-a7c4e469-ec31-455a-b6ff-c354dc59b6bc None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:21.735589 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-a7c4e469-ec31-455a-b6ff-c354dc59b6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:21.866078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 2/3] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 476 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 08 17:31:22.048377 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05ca01-46e5-42ae-91ec-eafbf92d7a60 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:22.125301 dv-cinder-852364-1-smb devstack@keystone.service[86919]: INFO dbcounter [None req-eb05ca01-46e5-42ae-91ec-eafbf92d7a60 None None] Registered counter for database keystone Aug 08 17:31:22.146608 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG oslo_db.sqlalchemy.engines [None req-eb05ca01-46e5-42ae-91ec-eafbf92d7a60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 17:31:22.153460 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writer thread running {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 17:31:22.274148 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05ca01-46e5-42ae-91ec-eafbf92d7a60 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:22.278937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3957b5-0ce7-4984-9121-0f187d3c472c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:22.279550 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3957b5-0ce7-4984-9121-0f187d3c472c admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:22.279827 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3957b5-0ce7-4984-9121-0f187d3c472c admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:22.280098 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3957b5-0ce7-4984-9121-0f187d3c472c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:22.288038 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3957b5-0ce7-4984-9121-0f187d3c472c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:22.341424 dv-cinder-852364-1-smb devstack@keystone.service[86919]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2d3957b5-0ce7-4984-9121-0f187d3c472c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 08 17:31:22.341702 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3957b5-0ce7-4984-9121-0f187d3c472c admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:22.351058 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 2/4] 10.222.0.70 () {58 vars in 1324 bytes} [Mon Aug 8 17:31:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 17:31:22.357561 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4e469-ec31-455a-b6ff-c354dc59b6bc None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:22.372828 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4e469-ec31-455a-b6ff-c354dc59b6bc None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:22.377298 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8ba3f-6af3-419c-b905-846570a774fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:22.378400 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8ba3f-6af3-419c-b905-846570a774fe admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:22.378688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8ba3f-6af3-419c-b905-846570a774fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:22.378973 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8ba3f-6af3-419c-b905-846570a774fe admin admin] PATH_INFO: `/v3/projects/e8e66549226e41208010bac52754a1ba` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:22.380407 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae8ba3f-6af3-419c-b905-846570a774fe admin admin] RBAC: Authorizing `identity:get_project(project_id=e8e66549226e41208010bac52754a1ba)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:22.430435 dv-cinder-852364-1-smb devstack@keystone.service[86920]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8ae8ba3f-6af3-419c-b905-846570a774fe admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 08 17:31:22.430979 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae8ba3f-6af3-419c-b905-846570a774fe admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:22.436354 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 3/5] 10.222.0.70 () {56 vars in 1207 bytes} [Mon Aug 8 17:31:22 2022] GET /identity/v3/projects/e8e66549226e41208010bac52754a1ba => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:24.428864 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049140e-0965-402e-bfde-f4e340f73be1 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:24.429378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049140e-0965-402e-bfde-f4e340f73be1 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:24.429497 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049140e-0965-402e-bfde-f4e340f73be1 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:24.433952 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 3/6] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:31:24.439612 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b8f8e-27a6-4ecf-82aa-ea7c6c8bfb31 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:24.440015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b8f8e-27a6-4ecf-82aa-ea7c6c8bfb31 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:24.440170 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b8f8e-27a6-4ecf-82aa-ea7c6c8bfb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:24.461990 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-3d3b8f8e-27a6-4ecf-82aa-ea7c6c8bfb31 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:24.463526 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-3d3b8f8e-27a6-4ecf-82aa-ea7c6c8bfb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:24.471990 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 4/7] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 08 17:31:24.494762 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049140e-0965-402e-bfde-f4e340f73be1 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:24.506901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049140e-0965-402e-bfde-f4e340f73be1 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:24.511079 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1baad-7f21-4933-bd9c-ea44f2e34b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:24.511676 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1baad-7f21-4933-bd9c-ea44f2e34b24 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:24.512499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1baad-7f21-4933-bd9c-ea44f2e34b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:24.512775 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1baad-7f21-4933-bd9c-ea44f2e34b24 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:24.520359 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec1baad-7f21-4933-bd9c-ea44f2e34b24 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:24.522159 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec1baad-7f21-4933-bd9c-ea44f2e34b24 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:24.531453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 4/8] 10.222.0.70 () {58 vars in 1324 bytes} [Mon Aug 8 17:31:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 17:31:24.536598 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b8f8e-27a6-4ecf-82aa-ea7c6c8bfb31 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:24.545688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b8f8e-27a6-4ecf-82aa-ea7c6c8bfb31 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:24.550049 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380fe58-c45c-4bc6-ac48-026f8c944212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:24.550664 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380fe58-c45c-4bc6-ac48-026f8c944212 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:24.550947 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380fe58-c45c-4bc6-ac48-026f8c944212 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:24.551221 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380fe58-c45c-4bc6-ac48-026f8c944212 admin admin] PATH_INFO: `/v3/users/f82db915cef84d91b03fd2cabdc99332` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:24.552536 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380fe58-c45c-4bc6-ac48-026f8c944212 admin admin] RBAC: Authorizing `identity:get_user(user_id=f82db915cef84d91b03fd2cabdc99332)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:24.554394 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380fe58-c45c-4bc6-ac48-026f8c944212 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:24.555905 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 5/9] 10.222.0.70 () {56 vars in 1198 bytes} [Mon Aug 8 17:31:24 2022] GET /identity/v3/users/f82db915cef84d91b03fd2cabdc99332 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:26.616375 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04b018-6a90-4c3d-9163-a65108345645 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:26.616910 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04b018-6a90-4c3d-9163-a65108345645 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:26.616910 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04b018-6a90-4c3d-9163-a65108345645 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:26.618447 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 5/10] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:31:26.623362 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec8074-d676-4a9f-9108-8a395f89a8e3 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:26.623761 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec8074-d676-4a9f-9108-8a395f89a8e3 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:26.623918 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec8074-d676-4a9f-9108-8a395f89a8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:26.642098 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-9bec8074-d676-4a9f-9108-8a395f89a8e3 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:26.643276 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-9bec8074-d676-4a9f-9108-8a395f89a8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:26.668979 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9ae24-3168-4adb-a9c8-47e423a48b62 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:26.669278 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9ae24-3168-4adb-a9c8-47e423a48b62 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:26.669414 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9ae24-3168-4adb-a9c8-47e423a48b62 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:26.670726 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 6/11] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 17:31:26.675843 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d06871-294f-4692-ac78-b815bfe8539a None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:26.676128 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d06871-294f-4692-ac78-b815bfe8539a None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:26.676403 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d06871-294f-4692-ac78-b815bfe8539a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:26.720118 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG passlib.handlers.bcrypt [None req-21d06871-294f-4692-ac78-b815bfe8539a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86919) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 08 17:31:26.720536 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG passlib.handlers.bcrypt [None req-21d06871-294f-4692-ac78-b815bfe8539a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86919) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 08 17:31:26.723547 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 6/12] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:31:26.747448 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec8074-d676-4a9f-9108-8a395f89a8e3 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:26.768142 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-21d06871-294f-4692-ac78-b815bfe8539a None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:26.769765 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-21d06871-294f-4692-ac78-b815bfe8539a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:26.771208 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:26.852464 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec8074-d676-4a9f-9108-8a395f89a8e3 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:26.870517 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 7/13] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 17:31:26.887285 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5285fa-8bd0-430d-b40e-b500fce4309c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:26.887923 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5285fa-8bd0-430d-b40e-b500fce4309c None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:26.888207 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5285fa-8bd0-430d-b40e-b500fce4309c None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:26.888481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5285fa-8bd0-430d-b40e-b500fce4309c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:26.894094 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d06871-294f-4692-ac78-b815bfe8539a None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:26.900356 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5285fa-8bd0-430d-b40e-b500fce4309c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:31:26.909296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-8c5285fa-8bd0-430d-b40e-b500fce4309c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:31:26.909296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:31:26.909296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:31:26.909296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:31:26.909296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:31:26.909296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:31:26.909296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:31:26.909296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:31:26.909296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:31:26.909296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:31:26.909296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:31:26.909296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:31:26.909296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:31:26.909296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:31:26.909296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:31:26.909296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:31:26.910226 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:31:26.910226 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:31:26.910226 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:31:26.910226 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:31:26.910226 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:31:26.910226 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:31:26.910226 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:31:26.910226 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:31:26.910226 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:31:26.910226 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:31:26.910226 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:31:26.910226 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:31:26.910226 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:31:26.910226 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:31:26.910226 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:31:26.910226 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:31:26.915827 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:31:26.915827 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:31:26.915827 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:31:26.915827 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:31:26.915827 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:31:26.915827 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:31:26.915827 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:31:26.915827 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:31:26.915827 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:31:26.915827 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:31:26.915827 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:31:26.915827 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:31:26.915827 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 7/14] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 8 17:31:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:31:26.916606 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5285fa-8bd0-430d-b40e-b500fce4309c None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:26.996624 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d06871-294f-4692-ac78-b815bfe8539a None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:26.998109 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:26.999049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:27.016496 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5285fa-8bd0-430d-b40e-b500fce4309c None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:27.034367 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714c1ab-d231-46b7-a08a-e223f6be615b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:27.035406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714c1ab-d231-46b7-a08a-e223f6be615b None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:27.035638 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714c1ab-d231-46b7-a08a-e223f6be615b None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:27.035784 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714c1ab-d231-46b7-a08a-e223f6be615b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:27.054172 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476ad13-f103-4156-b386-5b01bcf1a41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:27.054771 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476ad13-f103-4156-b386-5b01bcf1a41f None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:27.055043 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476ad13-f103-4156-b386-5b01bcf1a41f None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:27.055311 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476ad13-f103-4156-b386-5b01bcf1a41f None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:27.056001 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f476ad13-f103-4156-b386-5b01bcf1a41f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:27.056295 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f476ad13-f103-4156-b386-5b01bcf1a41f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:27.057718 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f476ad13-f103-4156-b386-5b01bcf1a41f None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:27.071279 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 8/15] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:31:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:31:27.077116 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476ad13-f103-4156-b386-5b01bcf1a41f None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:27.106315 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5714c1ab-d231-46b7-a08a-e223f6be615b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:27.107947 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5714c1ab-d231-46b7-a08a-e223f6be615b None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:27.212583 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 8/16] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:31:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:27.218895 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714c1ab-d231-46b7-a08a-e223f6be615b None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:27.221960 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:27.283091 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476ad13-f103-4156-b386-5b01bcf1a41f None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:27.317331 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734e665-f8b0-48f1-9ff8-ca3f2c38cc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:27.317963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734e665-f8b0-48f1-9ff8-ca3f2c38cc2c None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:27.318337 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734e665-f8b0-48f1-9ff8-ca3f2c38cc2c None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:27.318620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734e665-f8b0-48f1-9ff8-ca3f2c38cc2c None admin] PATH_INFO: `/v3/users/f82db915cef84d91b03fd2cabdc99332` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:27.319323 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714c1ab-d231-46b7-a08a-e223f6be615b None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:27.319756 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734e665-f8b0-48f1-9ff8-ca3f2c38cc2c None admin] RBAC: Authorizing `identity:get_user(user_id=f82db915cef84d91b03fd2cabdc99332)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:27.321253 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734e665-f8b0-48f1-9ff8-ca3f2c38cc2c None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:27.322829 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 9/17] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:31:27 2022] GET /identity/v3/users/f82db915cef84d91b03fd2cabdc99332 => generated 247 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:31:27.328796 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734e665-f8b0-48f1-9ff8-ca3f2c38cc2c None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:27.343916 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:27.354889 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720aff4-43b9-4f84-ab5c-78e14ce1cea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:27.356295 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720aff4-43b9-4f84-ab5c-78e14ce1cea5 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:27.356583 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720aff4-43b9-4f84-ab5c-78e14ce1cea5 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:27.356854 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720aff4-43b9-4f84-ab5c-78e14ce1cea5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:27.375516 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720aff4-43b9-4f84-ab5c-78e14ce1cea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:27.377010 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720aff4-43b9-4f84-ab5c-78e14ce1cea5 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:27.395657 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-0720aff4-43b9-4f84-ab5c-78e14ce1cea5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:31:27.395657 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:31:27.395657 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:31:27.395657 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:31:27.395657 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:31:27.395657 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:31:27.395657 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:31:27.395657 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:31:27.395657 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:31:27.395657 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:31:27.395657 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:31:27.395657 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:31:27.395657 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:31:27.395657 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:31:27.395657 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:31:27.395657 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:31:27.396611 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:31:27.396611 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:31:27.396611 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:31:27.396611 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:31:27.396611 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:31:27.396611 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:31:27.396611 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:31:27.396611 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:31:27.396611 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:31:27.396611 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:31:27.396611 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:31:27.396611 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:31:27.396611 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:31:27.396611 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:31:27.396611 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:31:27.396611 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:31:27.396611 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:31:27.397479 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:31:27.397479 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:31:27.397479 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:31:27.397479 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 9/18] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:31:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:31:27.404429 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720aff4-43b9-4f84-ab5c-78e14ce1cea5 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:27.433210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734e665-f8b0-48f1-9ff8-ca3f2c38cc2c None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:27.461009 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:27.467552 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69d661-f3ba-49ae-b7fe-07f1001406c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:27.468196 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69d661-f3ba-49ae-b7fe-07f1001406c7 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:27.468480 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69d661-f3ba-49ae-b7fe-07f1001406c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:27.468754 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69d661-f3ba-49ae-b7fe-07f1001406c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:27.470068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e69d661-f3ba-49ae-b7fe-07f1001406c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:27.471523 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e69d661-f3ba-49ae-b7fe-07f1001406c7 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:27.476176 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 10/19] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:31:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:31:27.478847 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69d661-f3ba-49ae-b7fe-07f1001406c7 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:27.505160 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720aff4-43b9-4f84-ab5c-78e14ce1cea5 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:27.539688 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948df53-3ac5-4efb-a1f8-91ce7afda162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:27.540225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948df53-3ac5-4efb-a1f8-91ce7afda162 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:27.540508 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948df53-3ac5-4efb-a1f8-91ce7afda162 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:27.540782 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948df53-3ac5-4efb-a1f8-91ce7afda162 None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:27.541458 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948df53-3ac5-4efb-a1f8-91ce7afda162 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:27.541761 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948df53-3ac5-4efb-a1f8-91ce7afda162 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:27.543253 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948df53-3ac5-4efb-a1f8-91ce7afda162 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:27.560264 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 10/20] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:31:27.560783 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:27.581619 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69d661-f3ba-49ae-b7fe-07f1001406c7 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:27.619092 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b2de4-a4bb-4749-9ae8-727092a0cbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:27.619717 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b2de4-a4bb-4749-9ae8-727092a0cbc6 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:27.619999 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b2de4-a4bb-4749-9ae8-727092a0cbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:27.620277 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b2de4-a4bb-4749-9ae8-727092a0cbc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:27.621095 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b2de4-a4bb-4749-9ae8-727092a0cbc6 None admin] RBAC: Adding query filter params (role.id=5c25aa917ab34baabb795c54dd8a4d02, scope.domain.id=default, user.id=f82db915cef84d91b03fd2cabdc99332) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:27.621412 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b2de4-a4bb-4749-9ae8-727092a0cbc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:27.622917 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b2de4-a4bb-4749-9ae8-727092a0cbc6 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:27.630422 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 11/21] 10.222.0.70 () {56 vars in 1322 bytes} [Mon Aug 8 17:31:27 2022] GET /identity/v3/role_assignments?user.id=f82db915cef84d91b03fd2cabdc99332&scope.domain.id=default&role.id=5c25aa917ab34baabb795c54dd8a4d02 => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:31:29.933871 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de3062-bf84-4575-bc50-2e906d4e92d1 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:29.934405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de3062-bf84-4575-bc50-2e906d4e92d1 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:29.934405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de3062-bf84-4575-bc50-2e906d4e92d1 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:29.935760 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 11/22] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:31:29.943330 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e542db2-8e86-41e8-a9b0-066a4d4faa59 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:29.943750 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e542db2-8e86-41e8-a9b0-066a4d4faa59 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:29.943925 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e542db2-8e86-41e8-a9b0-066a4d4faa59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:29.967392 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-1e542db2-8e86-41e8-a9b0-066a4d4faa59 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:29.968594 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-1e542db2-8e86-41e8-a9b0-066a4d4faa59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:30.059801 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 12/23] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:31:30.102972 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de3062-bf84-4575-bc50-2e906d4e92d1 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:30.229576 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de3062-bf84-4575-bc50-2e906d4e92d1 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:30.252997 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:30.277892 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d1fb9-9850-4da0-9a88-08db82b42509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:30.279518 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d1fb9-9850-4da0-9a88-08db82b42509 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:30.279518 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d1fb9-9850-4da0-9a88-08db82b42509 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:30.279518 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d1fb9-9850-4da0-9a88-08db82b42509 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:30.291388 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d1fb9-9850-4da0-9a88-08db82b42509 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:30.293652 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d1fb9-9850-4da0-9a88-08db82b42509 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:30.316226 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-8c3d1fb9-9850-4da0-9a88-08db82b42509 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:31:30.316226 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:31:30.316226 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:31:30.316226 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:31:30.316226 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:31:30.316226 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:31:30.316226 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:31:30.316226 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:31:30.316226 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:31:30.316226 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:31:30.316226 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:31:30.316226 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:31:30.316226 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:31:30.316226 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:31:30.316226 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:31:30.316226 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:31:30.317178 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:31:30.317178 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:31:30.317178 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:31:30.317178 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:31:30.317178 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:31:30.317178 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:31:30.317178 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:31:30.317178 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:31:30.317178 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:31:30.317178 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:31:30.317178 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:31:30.317178 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:31:30.317178 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:31:30.317178 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:31:30.317178 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:31:30.317178 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:31:30.317178 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:31:30.318003 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:31:30.318003 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:31:30.318003 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:31:30.318003 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 12/24] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:31:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:31:30.323445 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e542db2-8e86-41e8-a9b0-066a4d4faa59 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:30.332725 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2705c1-31ef-4914-8663-7f0eeb4748ab None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:30.333013 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2705c1-31ef-4914-8663-7f0eeb4748ab None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:30.333315 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2705c1-31ef-4914-8663-7f0eeb4748ab None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:30.336783 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 13/25] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:30 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:31:30.342737 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05af8a-9171-456b-8d85-60343fe6e943 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:30.342963 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05af8a-9171-456b-8d85-60343fe6e943 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:30.343215 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05af8a-9171-456b-8d85-60343fe6e943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:30.380022 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-7c05af8a-9171-456b-8d85-60343fe6e943 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:30.381319 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-7c05af8a-9171-456b-8d85-60343fe6e943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:30.475398 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:30.522095 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e542db2-8e86-41e8-a9b0-066a4d4faa59 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:30.539228 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 14/26] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:31:30.540502 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028efe97-58a8-4bf9-94fe-a1ae38cafb15 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:30.540792 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028efe97-58a8-4bf9-94fe-a1ae38cafb15 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:30.541161 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028efe97-58a8-4bf9-94fe-a1ae38cafb15 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:30.542457 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 15/27] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:31:30.554307 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bc818-7686-4054-9ac7-0f260034ef90 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:30.554588 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bc818-7686-4054-9ac7-0f260034ef90 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:30.554863 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bc818-7686-4054-9ac7-0f260034ef90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:30.562330 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1621cb-b532-4dd3-a793-7f02c9edd34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:30.563312 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1621cb-b532-4dd3-a793-7f02c9edd34a None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:30.563793 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1621cb-b532-4dd3-a793-7f02c9edd34a None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:30.564265 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1621cb-b532-4dd3-a793-7f02c9edd34a None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:30.565141 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1621cb-b532-4dd3-a793-7f02c9edd34a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:30.565645 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1621cb-b532-4dd3-a793-7f02c9edd34a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:30.567239 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1621cb-b532-4dd3-a793-7f02c9edd34a None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:30.585580 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 13/28] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:30.606204 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1621cb-b532-4dd3-a793-7f02c9edd34a None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:30.717758 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-e79bc818-7686-4054-9ac7-0f260034ef90 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:30.718977 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-e79bc818-7686-4054-9ac7-0f260034ef90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:30.825590 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1621cb-b532-4dd3-a793-7f02c9edd34a None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:30.834496 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 16/29] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 17:31:30.835349 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bc818-7686-4054-9ac7-0f260034ef90 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:30.864477 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e09af-4a75-4d92-af8b-3a9ce8d1e108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:30.865503 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e09af-4a75-4d92-af8b-3a9ce8d1e108 None admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:30.865990 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e09af-4a75-4d92-af8b-3a9ce8d1e108 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:30.866278 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:30.866672 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e09af-4a75-4d92-af8b-3a9ce8d1e108 None admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:30.867548 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e09af-4a75-4d92-af8b-3a9ce8d1e108 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:30.869313 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e09af-4a75-4d92-af8b-3a9ce8d1e108 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:30.875388 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:30.947024 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bc818-7686-4054-9ac7-0f260034ef90 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:30.991918 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14404ef9-a2c3-4906-907a-991f43857359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:30.992905 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14404ef9-a2c3-4906-907a-991f43857359 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:30.993566 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14404ef9-a2c3-4906-907a-991f43857359 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:30.994073 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14404ef9-a2c3-4906-907a-991f43857359 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:31.007250 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14404ef9-a2c3-4906-907a-991f43857359 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:31:31.014673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-14404ef9-a2c3-4906-907a-991f43857359 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:31:31.014673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:31:31.014673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:31:31.014673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:31:31.014673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:31:31.014673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:31:31.014673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:31:31.014673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:31:31.014673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:31:31.014673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:31:31.014673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:31:31.014673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:31:31.014673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:31:31.014673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:31:31.014673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:31:31.014673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:31:31.015593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:31:31.015593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:31:31.015593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:31:31.015593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:31:31.015593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:31:31.015593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:31:31.015593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:31:31.015593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:31:31.015593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:31:31.015593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:31:31.015593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:31:31.015593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:31:31.015593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:31:31.015593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:31:31.015593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:31:31.015593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:31:31.016368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:31:31.016368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:31:31.016368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:31:31.016368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:31:31.016368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:31:31.016368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:31:31.016368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:31:31.016368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:31:31.016368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:31:31.016368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:31:31.016368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:31:31.016368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:31:31.019237 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 17/30] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 8 17:31:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:31:31.020730 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973af5a-651f-45b8-8658-445a9cc2c14e None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:31.021269 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973af5a-651f-45b8-8658-445a9cc2c14e None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:31.021797 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973af5a-651f-45b8-8658-445a9cc2c14e None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:31.023296 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 18/31] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:31:31.029253 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973af5a-651f-45b8-8658-445a9cc2c14e None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:31.102602 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 14/32] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Aug 8 17:31:30 2022] POST /identity/v3/projects => generated 301 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:31:31.103499 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e09af-4a75-4d92-af8b-3a9ce8d1e108 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:31.154540 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:31.178322 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973af5a-651f-45b8-8658-445a9cc2c14e None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:31.219037 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ec74d-5e8c-48e2-9210-700dc30ae14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:31.219676 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ec74d-5e8c-48e2-9210-700dc30ae14c None admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:31.219965 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ec74d-5e8c-48e2-9210-700dc30ae14c None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:31.220243 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ec74d-5e8c-48e2-9210-700dc30ae14c None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:31.221063 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ec74d-5e8c-48e2-9210-700dc30ae14c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:31.222654 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ec74d-5e8c-48e2-9210-700dc30ae14c None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:31.243327 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e09af-4a75-4d92-af8b-3a9ce8d1e108 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:31.282895 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87956f-4813-4d6c-8d78-148a558809bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:31.283521 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87956f-4813-4d6c-8d78-148a558809bc None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:31.283811 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87956f-4813-4d6c-8d78-148a558809bc None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:31.284092 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87956f-4813-4d6c-8d78-148a558809bc None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:31.284826 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a87956f-4813-4d6c-8d78-148a558809bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:31.285215 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a87956f-4813-4d6c-8d78-148a558809bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:31.286791 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a87956f-4813-4d6c-8d78-148a558809bc None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:31.296905 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 15/33] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:31:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:31.298311 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12532a-1e8a-4c7c-86c4-a2271f097dff None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:31.305459 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12532a-1e8a-4c7c-86c4-a2271f097dff None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:31.305459 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12532a-1e8a-4c7c-86c4-a2271f097dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:31.317639 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-ad12532a-1e8a-4c7c-86c4-a2271f097dff None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:31.319160 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-ad12532a-1e8a-4c7c-86c4-a2271f097dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:31.366896 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:31.393756 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 16/34] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:31:31.394985 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075545fe-0bbd-4a53-b7d8-91c85f2f296e None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:31.395270 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075545fe-0bbd-4a53-b7d8-91c85f2f296e None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:31.395542 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075545fe-0bbd-4a53-b7d8-91c85f2f296e None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:31.396768 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 17/35] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:31:31.397484 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075545fe-0bbd-4a53-b7d8-91c85f2f296e None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:31.454084 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 19/36] 10.222.0.70 () {60 vars in 1131 bytes} [Mon Aug 8 17:31:31 2022] POST /identity/v3/roles => generated 219 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:31:31.467029 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0b09f-8f6c-4048-971f-af506722ee64 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:31.467375 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0b09f-8f6c-4048-971f-af506722ee64 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:31.467600 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0b09f-8f6c-4048-971f-af506722ee64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:31.489686 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-edd0b09f-8f6c-4048-971f-af506722ee64 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:31.491604 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-edd0b09f-8f6c-4048-971f-af506722ee64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:31.532978 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075545fe-0bbd-4a53-b7d8-91c85f2f296e None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:31.567664 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 20/37] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:31:31.568527 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0b09f-8f6c-4048-971f-af506722ee64 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:31.579610 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf46fe-6954-4672-9996-fbc69e5b1034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:31.580373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf46fe-6954-4672-9996-fbc69e5b1034 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:31.580729 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf46fe-6954-4672-9996-fbc69e5b1034 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:31.581108 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf46fe-6954-4672-9996-fbc69e5b1034 None admin] PATH_INFO: `/v3/users/f82db915cef84d91b03fd2cabdc99332` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:31.582402 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf46fe-6954-4672-9996-fbc69e5b1034 None admin] RBAC: Authorizing `identity:get_user(user_id=f82db915cef84d91b03fd2cabdc99332)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:31.583959 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf46fe-6954-4672-9996-fbc69e5b1034 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:31.586070 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 18/38] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:31:31 2022] GET /identity/v3/users/f82db915cef84d91b03fd2cabdc99332 => generated 247 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:31.592016 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628986c4-f227-44c4-91ee-4a449ae9c346 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:31.592375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628986c4-f227-44c4-91ee-4a449ae9c346 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:31.592724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628986c4-f227-44c4-91ee-4a449ae9c346 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:31.594263 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 19/39] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:31:31.595511 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628986c4-f227-44c4-91ee-4a449ae9c346 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:31.648023 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:31.672332 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:31.694647 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0b09f-8f6c-4048-971f-af506722ee64 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:31.706025 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628986c4-f227-44c4-91ee-4a449ae9c346 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:31.729025 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61df93-32d1-4340-bc15-330100018810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:31.729669 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61df93-32d1-4340-bc15-330100018810 None admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:31.729998 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61df93-32d1-4340-bc15-330100018810 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:31.730277 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61df93-32d1-4340-bc15-330100018810 None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:31.730948 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61df93-32d1-4340-bc15-330100018810 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:31.732502 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61df93-32d1-4340-bc15-330100018810 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:31.740125 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058006d8-f169-4235-b819-acba631d10fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:31.740754 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058006d8-f169-4235-b819-acba631d10fc None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:31.741060 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058006d8-f169-4235-b819-acba631d10fc None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:31.741346 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058006d8-f169-4235-b819-acba631d10fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:31.742465 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058006d8-f169-4235-b819-acba631d10fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:31.743931 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058006d8-f169-4235-b819-acba631d10fc None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:31.746179 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 20/40] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:31:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:31:31.746847 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058006d8-f169-4235-b819-acba631d10fc None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:31.806241 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 21/41] 10.222.0.70 () {60 vars in 1131 bytes} [Mon Aug 8 17:31:31 2022] POST /identity/v3/roles => generated 225 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:31:31.807469 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ebe01-56ee-4ece-ae6d-3aa811094c0e None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:31.807765 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ebe01-56ee-4ece-ae6d-3aa811094c0e None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:31.808572 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ebe01-56ee-4ece-ae6d-3aa811094c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:31.835719 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-013ebe01-56ee-4ece-ae6d-3aa811094c0e None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:31.837133 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-013ebe01-56ee-4ece-ae6d-3aa811094c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:31.865501 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058006d8-f169-4235-b819-acba631d10fc None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:31.883413 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:31.910248 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a48b8-de8c-4208-a668-6300bf6f4d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:31.911475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a48b8-de8c-4208-a668-6300bf6f4d57 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:31.911769 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a48b8-de8c-4208-a668-6300bf6f4d57 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:31.912044 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a48b8-de8c-4208-a668-6300bf6f4d57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:31.913664 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a48b8-de8c-4208-a668-6300bf6f4d57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:31.916145 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a48b8-de8c-4208-a668-6300bf6f4d57 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:31.919515 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 21/42] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:31:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:31.920645 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a48b8-de8c-4208-a668-6300bf6f4d57 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:31.932399 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 22/43] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:31:31.933385 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ebe01-56ee-4ece-ae6d-3aa811094c0e None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:32.014114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:32.043987 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a48b8-de8c-4208-a668-6300bf6f4d57 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:32.049661 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ebe01-56ee-4ece-ae6d-3aa811094c0e None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:32.078100 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74462f4a-0802-4bca-8ae7-595b2eb0b26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:32.078756 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74462f4a-0802-4bca-8ae7-595b2eb0b26e None admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:32.079040 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74462f4a-0802-4bca-8ae7-595b2eb0b26e None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:32.079321 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74462f4a-0802-4bca-8ae7-595b2eb0b26e None admin] PATH_INFO: `/v3/domains/default/users/f82db915cef84d91b03fd2cabdc99332/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:32.081288 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74462f4a-0802-4bca-8ae7-595b2eb0b26e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f82db915cef84d91b03fd2cabdc99332, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:32.082745 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74462f4a-0802-4bca-8ae7-595b2eb0b26e None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:32.083623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ee5d5-cc7b-431b-9baa-d06a8073c214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:32.084236 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ee5d5-cc7b-431b-9baa-d06a8073c214 None admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:32.084520 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ee5d5-cc7b-431b-9baa-d06a8073c214 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:32.084854 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ee5d5-cc7b-431b-9baa-d06a8073c214 None admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:32.085763 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ee5d5-cc7b-431b-9baa-d06a8073c214 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:32.087582 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ee5d5-cc7b-431b-9baa-d06a8073c214 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:32.182486 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 22/44] 10.222.0.70 () {58 vars in 1361 bytes} [Mon Aug 8 17:31:31 2022] PUT /identity/v3/domains/default/users/f82db915cef84d91b03fd2cabdc99332/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:31:32.183328 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74462f4a-0802-4bca-8ae7-595b2eb0b26e None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:32.215759 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 23/45] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Aug 8 17:31:31 2022] POST /identity/v3/projects => generated 312 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:31:32.248717 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:32.318503 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74462f4a-0802-4bca-8ae7-595b2eb0b26e None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:32.358609 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06050a-b100-4318-bc72-c18cc505d153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:32.359605 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06050a-b100-4318-bc72-c18cc505d153 None admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:32.360026 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06050a-b100-4318-bc72-c18cc505d153 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:32.360479 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06050a-b100-4318-bc72-c18cc505d153 None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:32.361347 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe06050a-b100-4318-bc72-c18cc505d153 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:32.362932 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe06050a-b100-4318-bc72-c18cc505d153 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:32.430177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 23/46] 10.222.0.70 () {60 vars in 1131 bytes} [Mon Aug 8 17:31:32 2022] POST /identity/v3/roles => generated 223 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:31:34.212541 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5c629-9f67-4208-8b11-1aca3cd071cb None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:34.213107 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5c629-9f67-4208-8b11-1aca3cd071cb None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:34.213107 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5c629-9f67-4208-8b11-1aca3cd071cb None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:34.214470 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 24/47] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:31:34.219669 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83debc3-bfcd-41a3-96e4-52c1bb4dacbe None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:34.220093 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83debc3-bfcd-41a3-96e4-52c1bb4dacbe None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:34.220219 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83debc3-bfcd-41a3-96e4-52c1bb4dacbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:34.238351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-d83debc3-bfcd-41a3-96e4-52c1bb4dacbe None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:34.239782 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-d83debc3-bfcd-41a3-96e4-52c1bb4dacbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:34.257126 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a157e88-52e8-4daa-a162-3e906033864e None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:34.257424 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a157e88-52e8-4daa-a162-3e906033864e None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:34.257707 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a157e88-52e8-4daa-a162-3e906033864e None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:34.259037 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 25/48] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 17:31:34.264137 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d229f13-ac63-496c-9021-02e009661684 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:34.264423 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d229f13-ac63-496c-9021-02e009661684 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:34.264705 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d229f13-ac63-496c-9021-02e009661684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:34.282331 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-9d229f13-ac63-496c-9021-02e009661684 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:34.283542 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-9d229f13-ac63-496c-9021-02e009661684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:34.304895 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 24/49] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:31:34.327742 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83debc3-bfcd-41a3-96e4-52c1bb4dacbe None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:34.350133 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 26/50] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 17:31:34.357800 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:34.373970 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d229f13-ac63-496c-9021-02e009661684 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:34.422767 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:34.429632 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83debc3-bfcd-41a3-96e4-52c1bb4dacbe None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:34.464461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb94a5-e884-403c-aeac-98f3b7c7ee8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:34.465105 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb94a5-e884-403c-aeac-98f3b7c7ee8e None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:34.465353 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb94a5-e884-403c-aeac-98f3b7c7ee8e None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:34.465629 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb94a5-e884-403c-aeac-98f3b7c7ee8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:34.472458 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d229f13-ac63-496c-9021-02e009661684 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:34.475957 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb94a5-e884-403c-aeac-98f3b7c7ee8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:31:34.482030 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-0cdb94a5-e884-403c-aeac-98f3b7c7ee8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:31:34.482030 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:31:34.482030 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:31:34.482030 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:31:34.482030 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:31:34.482030 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:31:34.482030 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:31:34.482030 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:31:34.482030 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:31:34.482030 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:31:34.482030 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:31:34.482030 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:31:34.482030 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:31:34.482030 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:31:34.482030 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:31:34.482030 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:31:34.484002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:31:34.484002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:31:34.484002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:31:34.484002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:31:34.484002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:31:34.484002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:31:34.484002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:31:34.484002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:31:34.484002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:31:34.484002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:31:34.484002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:31:34.484002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:31:34.484002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:31:34.484002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:31:34.484002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:31:34.484002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:31:34.485094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:31:34.485094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:31:34.485094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:31:34.485094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:31:34.485094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:31:34.485094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:31:34.485094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:31:34.485094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:31:34.485094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:31:34.485094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:31:34.485094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:31:34.485094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:31:34.485094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 25/51] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 8 17:31:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:31:34.489509 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb94a5-e884-403c-aeac-98f3b7c7ee8e None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:34.508522 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc8aa4-4d5d-4bf5-9c8e-3d8d186333ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:34.509183 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc8aa4-4d5d-4bf5-9c8e-3d8d186333ec None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:34.509466 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc8aa4-4d5d-4bf5-9c8e-3d8d186333ec None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:34.509739 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc8aa4-4d5d-4bf5-9c8e-3d8d186333ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:34.510908 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc8aa4-4d5d-4bf5-9c8e-3d8d186333ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:34.512375 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc8aa4-4d5d-4bf5-9c8e-3d8d186333ec None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:34.513963 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 27/52] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:31:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:31:34.519626 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc8aa4-4d5d-4bf5-9c8e-3d8d186333ec None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:34.582967 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:34.591952 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb94a5-e884-403c-aeac-98f3b7c7ee8e None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:34.617978 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc8aa4-4d5d-4bf5-9c8e-3d8d186333ec None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:34.625332 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74d155-6efa-4a4e-bb29-9e4ef3092fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:34.625936 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74d155-6efa-4a4e-bb29-9e4ef3092fa8 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:34.626213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74d155-6efa-4a4e-bb29-9e4ef3092fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:34.626484 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74d155-6efa-4a4e-bb29-9e4ef3092fa8 None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:34.627140 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74d155-6efa-4a4e-bb29-9e4ef3092fa8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:34.627439 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74d155-6efa-4a4e-bb29-9e4ef3092fa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:34.628830 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74d155-6efa-4a4e-bb29-9e4ef3092fa8 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:34.635476 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:34.637142 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 26/53] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:31:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:34.642637 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74d155-6efa-4a4e-bb29-9e4ef3092fa8 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:34.653526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76582a03-9514-444d-a491-6d3f7e367143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:34.654142 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76582a03-9514-444d-a491-6d3f7e367143 None admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:34.654427 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76582a03-9514-444d-a491-6d3f7e367143 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:34.654710 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76582a03-9514-444d-a491-6d3f7e367143 None admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:34.655397 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76582a03-9514-444d-a491-6d3f7e367143 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:34.656836 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76582a03-9514-444d-a491-6d3f7e367143 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:34.728303 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 28/54] 10.222.0.70 () {60 vars in 1140 bytes} [Mon Aug 8 17:31:34 2022] POST /identity/v3/projects => generated 298 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:31:34.738332 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74d155-6efa-4a4e-bb29-9e4ef3092fa8 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:34.775924 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a11d04-5a52-4c4b-8cab-8606dddf425f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:34.776721 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a11d04-5a52-4c4b-8cab-8606dddf425f None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:34.777188 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a11d04-5a52-4c4b-8cab-8606dddf425f None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:34.777473 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a11d04-5a52-4c4b-8cab-8606dddf425f None admin] PATH_INFO: `/v3/users/f82db915cef84d91b03fd2cabdc99332` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:34.778819 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a11d04-5a52-4c4b-8cab-8606dddf425f None admin] RBAC: Authorizing `identity:get_user(user_id=f82db915cef84d91b03fd2cabdc99332)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:34.780339 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a11d04-5a52-4c4b-8cab-8606dddf425f None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:34.782258 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 27/55] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:31:34 2022] GET /identity/v3/users/f82db915cef84d91b03fd2cabdc99332 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:34.788166 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76582a03-9514-444d-a491-6d3f7e367143 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:34.893278 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76582a03-9514-444d-a491-6d3f7e367143 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:34.927839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210471dc-c41f-474d-a96c-54a32e04c041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:34.928484 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210471dc-c41f-474d-a96c-54a32e04c041 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:34.928773 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210471dc-c41f-474d-a96c-54a32e04c041 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:34.929094 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210471dc-c41f-474d-a96c-54a32e04c041 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:34.930250 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210471dc-c41f-474d-a96c-54a32e04c041 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:34.931712 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210471dc-c41f-474d-a96c-54a32e04c041 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:34.934071 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 29/56] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:31:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:34.939835 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a11d04-5a52-4c4b-8cab-8606dddf425f None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:34.964288 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:35.039414 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a11d04-5a52-4c4b-8cab-8606dddf425f None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:35.073757 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc0033-92d4-4e32-86a1-3e96e1ff0f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:35.074376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc0033-92d4-4e32-86a1-3e96e1ff0f66 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:35.074660 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc0033-92d4-4e32-86a1-3e96e1ff0f66 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:35.074934 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc0033-92d4-4e32-86a1-3e96e1ff0f66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:35.075658 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc0033-92d4-4e32-86a1-3e96e1ff0f66 None admin] RBAC: Adding query filter params (role.id=5c25aa917ab34baabb795c54dd8a4d02, scope.domain.id=default, user.id=f82db915cef84d91b03fd2cabdc99332) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:35.075967 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc0033-92d4-4e32-86a1-3e96e1ff0f66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:35.077444 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc0033-92d4-4e32-86a1-3e96e1ff0f66 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:35.083190 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 28/57] 10.222.0.70 () {56 vars in 1322 bytes} [Mon Aug 8 17:31:34 2022] GET /identity/v3/role_assignments?user.id=f82db915cef84d91b03fd2cabdc99332&scope.domain.id=default&role.id=5c25aa917ab34baabb795c54dd8a4d02 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:36.736182 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add29473-5bd5-4008-96d7-a6176c15b11e None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:36.736695 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add29473-5bd5-4008-96d7-a6176c15b11e None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:36.736780 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add29473-5bd5-4008-96d7-a6176c15b11e None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:36.738104 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 30/58] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:31:36.743378 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d75d6a-0b6b-44ac-a89e-18201fe9fb69 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:36.743744 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d75d6a-0b6b-44ac-a89e-18201fe9fb69 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:36.743932 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d75d6a-0b6b-44ac-a89e-18201fe9fb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:36.766132 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-84d75d6a-0b6b-44ac-a89e-18201fe9fb69 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:36.767368 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-84d75d6a-0b6b-44ac-a89e-18201fe9fb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:36.834780 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 29/59] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:31:36.859202 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add29473-5bd5-4008-96d7-a6176c15b11e None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:36.902459 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:36.963619 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add29473-5bd5-4008-96d7-a6176c15b11e None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:36.999870 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b7e89-3038-459d-a3de-ae5fc8626bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:37.000435 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b7e89-3038-459d-a3de-ae5fc8626bcb None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:37.000723 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b7e89-3038-459d-a3de-ae5fc8626bcb None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:37.001004 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b7e89-3038-459d-a3de-ae5fc8626bcb None admin] PATH_INFO: `/v3/domains/default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:37.002148 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b7e89-3038-459d-a3de-ae5fc8626bcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:37.003609 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b7e89-3038-459d-a3de-ae5fc8626bcb None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:37.005235 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 31/60] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:31:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:37.012133 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d75d6a-0b6b-44ac-a89e-18201fe9fb69 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:37.029408 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:37.110144 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d75d6a-0b6b-44ac-a89e-18201fe9fb69 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:37.145234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643d276-170b-4662-8d67-03c8961bea44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:37.145822 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643d276-170b-4662-8d67-03c8961bea44 None admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:37.146103 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643d276-170b-4662-8d67-03c8961bea44 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:37.146372 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643d276-170b-4662-8d67-03c8961bea44 None admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:37.147013 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643d276-170b-4662-8d67-03c8961bea44 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:37.148445 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643d276-170b-4662-8d67-03c8961bea44 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:37.235803 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 30/61] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Aug 8 17:31:37 2022] POST /identity/v3/users => generated 275 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:31:40.412225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ff59b-4745-49cc-b400-ceec9380eaf7 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:40.412577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4fa4b-6c38-4614-a524-931c7df10701 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:40.412932 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ff59b-4745-49cc-b400-ceec9380eaf7 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:40.413016 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4fa4b-6c38-4614-a524-931c7df10701 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:40.413114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ff59b-4745-49cc-b400-ceec9380eaf7 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:40.413181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4fa4b-6c38-4614-a524-931c7df10701 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:40.413913 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 31/62] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:31:40.414100 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 32/63] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:31:40.419554 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497f174-2c72-4057-b953-8f38e7642312 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:40.419847 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497f174-2c72-4057-b953-8f38e7642312 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:40.420130 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497f174-2c72-4057-b953-8f38e7642312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:40.423970 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79c744-c14c-4053-9e76-64562d67d59f None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:40.424261 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79c744-c14c-4053-9e76-64562d67d59f None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:40.424538 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79c744-c14c-4053-9e76-64562d67d59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:40.453563 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-ca79c744-c14c-4053-9e76-64562d67d59f None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:40.454789 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-ca79c744-c14c-4053-9e76-64562d67d59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:40.460854 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-0497f174-2c72-4057-b953-8f38e7642312 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:40.462056 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-0497f174-2c72-4057-b953-8f38e7642312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:40.554030 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 33/64] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:31:40.555412 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f221371-74bb-47d5-a2ab-82da62c3ac45 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:40.555706 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f221371-74bb-47d5-a2ab-82da62c3ac45 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:40.556089 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f221371-74bb-47d5-a2ab-82da62c3ac45 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:40.557659 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 34/65] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:31:40.562388 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06d501-6172-4f55-a83a-eb096027bb34 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:40.562777 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06d501-6172-4f55-a83a-eb096027bb34 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:40.563061 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06d501-6172-4f55-a83a-eb096027bb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:40.577092 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 32/66] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:31:40.589194 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497f174-2c72-4057-b953-8f38e7642312 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:40.593053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-8a06d501-6172-4f55-a83a-eb096027bb34 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:40.593053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-8a06d501-6172-4f55-a83a-eb096027bb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:40.596833 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:40.632343 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:40.685499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 35/67] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:31:40.687334 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06d501-6172-4f55-a83a-eb096027bb34 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:40.727451 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497f174-2c72-4057-b953-8f38e7642312 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:40.781540 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103221a-4d83-4c1f-bd9a-b16d11b200de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:40.782187 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103221a-4d83-4c1f-bd9a-b16d11b200de None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:40.782474 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103221a-4d83-4c1f-bd9a-b16d11b200de None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:40.782751 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103221a-4d83-4c1f-bd9a-b16d11b200de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:40.797506 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103221a-4d83-4c1f-bd9a-b16d11b200de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:31:40.804832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-0103221a-4d83-4c1f-bd9a-b16d11b200de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:31:40.804832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:31:40.804832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:31:40.804832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:31:40.804832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:31:40.804832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:31:40.804832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:31:40.804832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:31:40.804832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:31:40.804832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:31:40.804832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:31:40.804832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:31:40.804832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:31:40.804832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:31:40.804832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:31:40.804832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:31:40.805731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:31:40.805731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:31:40.805731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:31:40.805731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:31:40.805731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:31:40.805731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:31:40.805731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:31:40.805731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:31:40.805731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:31:40.805731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:31:40.805731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:31:40.805731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:31:40.805731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:31:40.805731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:31:40.805731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:31:40.805731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:31:40.806512 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:31:40.806512 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:31:40.806512 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:31:40.806512 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:31:40.806512 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:31:40.806512 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:31:40.806512 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:31:40.806512 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:31:40.806512 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:31:40.806512 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:31:40.806512 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:31:40.806512 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:31:40.812811 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 33/68] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 8 17:31:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:31:40.814102 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103221a-4d83-4c1f-bd9a-b16d11b200de None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:40.815955 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06d501-6172-4f55-a83a-eb096027bb34 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:40.864065 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13a194-08e0-430c-8101-1f372351184f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:40.864723 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13a194-08e0-430c-8101-1f372351184f None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:40.865009 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13a194-08e0-430c-8101-1f372351184f None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:40.865309 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13a194-08e0-430c-8101-1f372351184f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:40.879846 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d13a194-08e0-430c-8101-1f372351184f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:31:40.887046 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-9d13a194-08e0-430c-8101-1f372351184f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 17:31:40.887046 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:31:40.887046 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:31:40.887046 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:31:40.887046 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:31:40.887046 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:31:40.887046 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:31:40.887046 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:31:40.887046 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:31:40.887046 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:31:40.887046 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:31:40.887046 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:31:40.887046 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:31:40.887046 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:31:40.887046 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:31:40.887046 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:31:40.887897 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:31:40.887897 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:31:40.887897 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:31:40.887897 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:31:40.887897 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:31:40.887897 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:31:40.887897 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:31:40.887897 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:31:40.887897 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:31:40.887897 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:31:40.887897 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:31:40.887897 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:31:40.887897 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:31:40.887897 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:31:40.887897 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:31:40.887897 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:31:40.888658 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:31:40.888658 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:31:40.888658 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:31:40.888658 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:31:40.888658 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:31:40.888658 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:31:40.888658 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:31:40.888658 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:31:40.888658 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:31:40.888658 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:31:40.888658 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 17:31:40.888658 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:31:40.888658 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 36/69] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 8 17:31:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:31:40.890140 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13a194-08e0-430c-8101-1f372351184f None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:40.896632 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:40.925971 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:40.937133 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103221a-4d83-4c1f-bd9a-b16d11b200de None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:40.974259 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee710936-496f-4998-af5d-d3630908e409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:40.974891 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee710936-496f-4998-af5d-d3630908e409 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:40.975172 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee710936-496f-4998-af5d-d3630908e409 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:40.975445 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee710936-496f-4998-af5d-d3630908e409 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:40.986629 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee710936-496f-4998-af5d-d3630908e409 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:31:40.992058 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-ee710936-496f-4998-af5d-d3630908e409 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 17:31:40.992058 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:31:40.992058 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:31:40.992058 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:31:40.992058 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:31:40.992058 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:31:40.992058 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:31:40.992058 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:31:40.992058 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:31:40.992058 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:31:40.992058 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:31:40.992058 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:31:40.992058 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:31:40.992058 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:31:40.992058 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:31:40.992058 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:31:40.992909 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:31:40.992909 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:31:40.992909 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:31:40.992909 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:31:40.992909 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:31:40.992909 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:31:40.992909 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:31:40.992909 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:31:40.992909 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:31:40.992909 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:31:40.992909 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:31:40.992909 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:31:40.992909 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:31:40.992909 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:31:40.992909 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:31:40.992909 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:31:40.993753 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:31:40.993753 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:31:40.993753 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:31:40.993753 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:31:40.993753 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:31:40.993753 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:31:40.993753 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:31:40.993753 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:31:40.993753 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:31:40.993753 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:31:40.993753 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 17:31:40.993753 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:31:40.993753 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 34/70] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:31:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:31:40.994420 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee710936-496f-4998-af5d-d3630908e409 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:41.008799 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13a194-08e0-430c-8101-1f372351184f None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:41.047370 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0eab5-d8e4-4f3f-8657-a83d74db22ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:41.047993 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0eab5-d8e4-4f3f-8657-a83d74db22ae None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:41.048279 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0eab5-d8e4-4f3f-8657-a83d74db22ae None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:41.048560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0eab5-d8e4-4f3f-8657-a83d74db22ae None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:41.049259 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e0eab5-d8e4-4f3f-8657-a83d74db22ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:41.049569 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e0eab5-d8e4-4f3f-8657-a83d74db22ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:41.050960 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e0eab5-d8e4-4f3f-8657-a83d74db22ae None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:41.063278 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 37/71] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:31:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:41.064580 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026a91d-8ddf-4f57-8ccf-3e292907e36a None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:41.064881 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026a91d-8ddf-4f57-8ccf-3e292907e36a None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:41.065220 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026a91d-8ddf-4f57-8ccf-3e292907e36a None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:41.066575 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 38/72] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:31:41.069825 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026a91d-8ddf-4f57-8ccf-3e292907e36a None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:41.103179 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee710936-496f-4998-af5d-d3630908e409 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:41.128262 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:41.139290 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072ff2c-ecf0-4537-bcd4-39d4abac09f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:41.139900 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072ff2c-ecf0-4537-bcd4-39d4abac09f0 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:41.140178 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072ff2c-ecf0-4537-bcd4-39d4abac09f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:41.140449 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072ff2c-ecf0-4537-bcd4-39d4abac09f0 None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:41.141135 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072ff2c-ecf0-4537-bcd4-39d4abac09f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:41.141435 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072ff2c-ecf0-4537-bcd4-39d4abac09f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:41.142822 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072ff2c-ecf0-4537-bcd4-39d4abac09f0 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:41.150961 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 35/73] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:31:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:41.152515 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072ff2c-ecf0-4537-bcd4-39d4abac09f0 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:41.167323 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:41.180121 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026a91d-8ddf-4f57-8ccf-3e292907e36a None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:41.215334 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954f1b6-a075-46fb-8a1d-73f1ef73ed8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:41.215897 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954f1b6-a075-46fb-8a1d-73f1ef73ed8d None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:41.216186 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954f1b6-a075-46fb-8a1d-73f1ef73ed8d None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:41.216464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954f1b6-a075-46fb-8a1d-73f1ef73ed8d None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:41.217164 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e954f1b6-a075-46fb-8a1d-73f1ef73ed8d None admin] RBAC: Adding query filter params (name=member) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:41.217476 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e954f1b6-a075-46fb-8a1d-73f1ef73ed8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:41.218866 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e954f1b6-a075-46fb-8a1d-73f1ef73ed8d None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:41.226768 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 39/74] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 8 17:31:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:41.227912 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6aa0d-541c-4cf9-9d65-00780e8318c7 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:41.228203 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6aa0d-541c-4cf9-9d65-00780e8318c7 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:41.228479 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6aa0d-541c-4cf9-9d65-00780e8318c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:41.246398 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-29a6aa0d-541c-4cf9-9d65-00780e8318c7 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:41.247619 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-29a6aa0d-541c-4cf9-9d65-00780e8318c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:41.256420 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072ff2c-ecf0-4537-bcd4-39d4abac09f0 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:41.289590 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737d85c-3137-4f1b-a980-a53f05a40367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:41.290213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737d85c-3137-4f1b-a980-a53f05a40367 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:41.290498 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737d85c-3137-4f1b-a980-a53f05a40367 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:41.290779 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737d85c-3137-4f1b-a980-a53f05a40367 None admin] PATH_INFO: `/v3/users/f82db915cef84d91b03fd2cabdc99332` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:41.292588 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737d85c-3137-4f1b-a980-a53f05a40367 None admin] RBAC: Authorizing `identity:get_user(user_id=f82db915cef84d91b03fd2cabdc99332)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:41.294076 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737d85c-3137-4f1b-a980-a53f05a40367 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:41.300315 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 36/75] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:31:41 2022] GET /identity/v3/users/f82db915cef84d91b03fd2cabdc99332 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:41.300315 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108ae6c-0fba-476d-ad0c-8fd98b40b0c6 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:41.300315 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108ae6c-0fba-476d-ad0c-8fd98b40b0c6 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:41.300315 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108ae6c-0fba-476d-ad0c-8fd98b40b0c6 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:41.300315 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 37/76] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:31:41.300315 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108ae6c-0fba-476d-ad0c-8fd98b40b0c6 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:41.315329 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 40/77] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:31:41.316201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6aa0d-541c-4cf9-9d65-00780e8318c7 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:41.356946 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:41.397516 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:41.410760 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108ae6c-0fba-476d-ad0c-8fd98b40b0c6 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:41.417338 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6aa0d-541c-4cf9-9d65-00780e8318c7 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:41.445124 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d44428-5f07-49c5-abc2-4741dc10c757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:41.445743 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d44428-5f07-49c5-abc2-4741dc10c757 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:41.446023 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d44428-5f07-49c5-abc2-4741dc10c757 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:41.446294 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d44428-5f07-49c5-abc2-4741dc10c757 None admin] PATH_INFO: `/v3/users/b6be772778914724a2fb0603b4f3373c` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:41.453362 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c369fd8-67ca-4517-8e5f-dc6e91e55302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:41.454000 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c369fd8-67ca-4517-8e5f-dc6e91e55302 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:41.454286 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c369fd8-67ca-4517-8e5f-dc6e91e55302 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:41.454571 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c369fd8-67ca-4517-8e5f-dc6e91e55302 None admin] PATH_INFO: `/v3/users/b6be772778914724a2fb0603b4f3373c` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:41.460663 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d44428-5f07-49c5-abc2-4741dc10c757 None admin] RBAC: Authorizing `identity:get_user(user_id=b6be772778914724a2fb0603b4f3373c)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:41.462156 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d44428-5f07-49c5-abc2-4741dc10c757 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:41.464093 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 38/78] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:31:41 2022] GET /identity/v3/users/b6be772778914724a2fb0603b4f3373c => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:41.464878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d44428-5f07-49c5-abc2-4741dc10c757 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:41.470869 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c369fd8-67ca-4517-8e5f-dc6e91e55302 None admin] RBAC: Authorizing `identity:get_user(user_id=b6be772778914724a2fb0603b4f3373c)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:41.472283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c369fd8-67ca-4517-8e5f-dc6e91e55302 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:41.474008 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 41/79] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:31:41 2022] GET /identity/v3/users/b6be772778914724a2fb0603b4f3373c => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:41.475160 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2a950-08db-4f10-be66-374e396c875d None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:41.475448 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2a950-08db-4f10-be66-374e396c875d None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:41.475726 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2a950-08db-4f10-be66-374e396c875d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:41.493634 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-b4b2a950-08db-4f10-be66-374e396c875d None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:41.495552 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-b4b2a950-08db-4f10-be66-374e396c875d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:41.562430 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 42/80] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:31:41.563343 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2a950-08db-4f10-be66-374e396c875d None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:41.575422 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d44428-5f07-49c5-abc2-4741dc10c757 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:41.586430 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:41.611774 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ff0db-f584-44ac-bdf1-e377fdfef9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:41.612390 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ff0db-f584-44ac-bdf1-e377fdfef9fc None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:41.612670 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ff0db-f584-44ac-bdf1-e377fdfef9fc None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:41.612943 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ff0db-f584-44ac-bdf1-e377fdfef9fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:41.633108 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:41.665747 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2a950-08db-4f10-be66-374e396c875d None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:41.680789 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ff0db-f584-44ac-bdf1-e377fdfef9fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:41.682884 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ff0db-f584-44ac-bdf1-e377fdfef9fc None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:41.701454 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8afd4-e631-4bed-9a01-e3408fa84955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:41.702081 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8afd4-e631-4bed-9a01-e3408fa84955 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:41.702362 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8afd4-e631-4bed-9a01-e3408fa84955 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:41.702641 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8afd4-e631-4bed-9a01-e3408fa84955 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:41.712743 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8afd4-e631-4bed-9a01-e3408fa84955 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:31:41.717593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-8df8afd4-e631-4bed-9a01-e3408fa84955 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 17:31:41.717593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:31:41.717593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:31:41.717593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:31:41.717593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:31:41.717593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:31:41.717593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:31:41.717593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:31:41.717593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:31:41.717593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:31:41.717593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:31:41.717593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:31:41.717593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:31:41.717593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:31:41.717593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:31:41.717593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:31:41.718489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:31:41.718489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:31:41.718489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:31:41.718489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:31:41.718489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:31:41.718489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:31:41.718489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:31:41.718489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:31:41.718489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:31:41.718489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:31:41.718489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:31:41.718489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:31:41.718489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:31:41.718489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:31:41.718489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:31:41.718489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:31:41.719283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:31:41.719283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:31:41.719283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:31:41.719283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:31:41.719283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:31:41.719283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:31:41.719283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:31:41.719283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:31:41.719283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:31:41.719283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:31:41.719283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 17:31:41.719283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:31:41.719283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 43/81] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:31:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:31:41.720204 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8afd4-e631-4bed-9a01-e3408fa84955 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:41.782287 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 39/82] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:31:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:31:41.783055 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ff0db-f584-44ac-bdf1-e377fdfef9fc None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:41.794597 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:41.826699 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8afd4-e631-4bed-9a01-e3408fa84955 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:41.853122 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:41.861240 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d8cfe-dfc1-4d9e-9bea-a36c8198d865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:41.862043 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d8cfe-dfc1-4d9e-9bea-a36c8198d865 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:41.862484 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d8cfe-dfc1-4d9e-9bea-a36c8198d865 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:41.862764 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d8cfe-dfc1-4d9e-9bea-a36c8198d865 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:41.879812 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ff0db-f584-44ac-bdf1-e377fdfef9fc None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:41.913995 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e36133-095d-4bc3-a148-7b849478d20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:41.914602 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e36133-095d-4bc3-a148-7b849478d20b None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:41.914889 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e36133-095d-4bc3-a148-7b849478d20b None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:41.915164 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e36133-095d-4bc3-a148-7b849478d20b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:41.930670 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d8cfe-dfc1-4d9e-9bea-a36c8198d865 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:41.932235 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d8cfe-dfc1-4d9e-9bea-a36c8198d865 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:41.982406 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e36133-095d-4bc3-a148-7b849478d20b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:41.983862 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e36133-095d-4bc3-a148-7b849478d20b None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:41.995310 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:42.031809 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 44/83] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:31:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:31:42.033085 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d8cfe-dfc1-4d9e-9bea-a36c8198d865 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:42.063540 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:42.084675 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 40/84] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:31:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:31:42.085655 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e36133-095d-4bc3-a148-7b849478d20b None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:42.138330 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d8cfe-dfc1-4d9e-9bea-a36c8198d865 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:42.173205 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d745f01-d9b1-4b63-80c8-a732caae6a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:42.173824 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d745f01-d9b1-4b63-80c8-a732caae6a22 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:42.174106 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d745f01-d9b1-4b63-80c8-a732caae6a22 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:42.174382 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d745f01-d9b1-4b63-80c8-a732caae6a22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:42.175480 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d745f01-d9b1-4b63-80c8-a732caae6a22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:42.176916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d745f01-d9b1-4b63-80c8-a732caae6a22 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:42.178493 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 45/85] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:31:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:42.181856 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d745f01-d9b1-4b63-80c8-a732caae6a22 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:42.184171 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e36133-095d-4bc3-a148-7b849478d20b None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:42.194793 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:42.218043 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161bf9c6-e97b-4809-b318-c3b3760975a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:42.218654 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161bf9c6-e97b-4809-b318-c3b3760975a4 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:42.218942 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161bf9c6-e97b-4809-b318-c3b3760975a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:42.219218 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161bf9c6-e97b-4809-b318-c3b3760975a4 None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:42.219879 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161bf9c6-e97b-4809-b318-c3b3760975a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:42.220185 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161bf9c6-e97b-4809-b318-c3b3760975a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:42.221622 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161bf9c6-e97b-4809-b318-c3b3760975a4 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:42.230453 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 41/86] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 8 17:31:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:42.231402 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161bf9c6-e97b-4809-b318-c3b3760975a4 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:42.281518 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:42.290999 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d745f01-d9b1-4b63-80c8-a732caae6a22 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:42.321158 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157f19e-19cc-48af-8fac-68782e3f4bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:42.321830 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157f19e-19cc-48af-8fac-68782e3f4bc8 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:42.322118 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157f19e-19cc-48af-8fac-68782e3f4bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:42.322400 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157f19e-19cc-48af-8fac-68782e3f4bc8 None admin] PATH_INFO: `/v3/projects/dbe071067d79437b8969c9883cc256df` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:42.324169 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d157f19e-19cc-48af-8fac-68782e3f4bc8 None admin] RBAC: Authorizing `identity:get_project(project_id=dbe071067d79437b8969c9883cc256df)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:42.325650 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d157f19e-19cc-48af-8fac-68782e3f4bc8 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:42.327286 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 46/87] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:31:42 2022] GET /identity/v3/projects/dbe071067d79437b8969c9883cc256df => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:42.328046 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157f19e-19cc-48af-8fac-68782e3f4bc8 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:42.330591 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161bf9c6-e97b-4809-b318-c3b3760975a4 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:42.364939 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a828271-445d-4a2c-a7ec-ee7e46106292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:42.365585 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a828271-445d-4a2c-a7ec-ee7e46106292 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:42.365866 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a828271-445d-4a2c-a7ec-ee7e46106292 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:42.366142 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a828271-445d-4a2c-a7ec-ee7e46106292 None admin] PATH_INFO: `/v3/projects/dbe071067d79437b8969c9883cc256df` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:42.367259 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a828271-445d-4a2c-a7ec-ee7e46106292 None admin] RBAC: Authorizing `identity:get_project(project_id=dbe071067d79437b8969c9883cc256df)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:42.368704 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a828271-445d-4a2c-a7ec-ee7e46106292 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:42.370902 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 42/88] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:31:42 2022] GET /identity/v3/projects/dbe071067d79437b8969c9883cc256df => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:42.371649 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a828271-445d-4a2c-a7ec-ee7e46106292 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:42.418475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:42.429283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157f19e-19cc-48af-8fac-68782e3f4bc8 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:42.468348 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235e7ee-fa5f-4ad1-8194-934519a223f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:42.468996 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235e7ee-fa5f-4ad1-8194-934519a223f5 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:42.469712 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235e7ee-fa5f-4ad1-8194-934519a223f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:42.469996 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235e7ee-fa5f-4ad1-8194-934519a223f5 None admin] PATH_INFO: `/v3/projects/dbe071067d79437b8969c9883cc256df` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:42.471389 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235e7ee-fa5f-4ad1-8194-934519a223f5 None admin] RBAC: Authorizing `identity:get_project(project_id=dbe071067d79437b8969c9883cc256df)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:42.472828 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235e7ee-fa5f-4ad1-8194-934519a223f5 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:42.480139 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 47/89] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:31:42 2022] GET /identity/v3/projects/dbe071067d79437b8969c9883cc256df => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:42.480139 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235e7ee-fa5f-4ad1-8194-934519a223f5 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:42.486798 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a828271-445d-4a2c-a7ec-ee7e46106292 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:42.508274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:42.520616 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c43500-2ca8-4d09-a68e-7744f3b56ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:42.521266 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c43500-2ca8-4d09-a68e-7744f3b56ac5 None admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:42.521554 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c43500-2ca8-4d09-a68e-7744f3b56ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:42.521833 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c43500-2ca8-4d09-a68e-7744f3b56ac5 None admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:42.522477 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c43500-2ca8-4d09-a68e-7744f3b56ac5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:42.523946 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c43500-2ca8-4d09-a68e-7744f3b56ac5 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:42.578719 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235e7ee-fa5f-4ad1-8194-934519a223f5 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:42.613738 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 43/90] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Aug 8 17:31:42 2022] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:31:42.614641 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c43500-2ca8-4d09-a68e-7744f3b56ac5 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:42.614879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881f8b8-e7af-4563-9ba4-871de901e43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:42.615455 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881f8b8-e7af-4563-9ba4-871de901e43f None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:42.615893 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881f8b8-e7af-4563-9ba4-871de901e43f None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:42.616041 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881f8b8-e7af-4563-9ba4-871de901e43f None admin] PATH_INFO: `/v3/users/b6be772778914724a2fb0603b4f3373c` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:42.617236 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881f8b8-e7af-4563-9ba4-871de901e43f None admin] RBAC: Authorizing `identity:get_user(user_id=b6be772778914724a2fb0603b4f3373c)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:42.618733 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881f8b8-e7af-4563-9ba4-871de901e43f None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:42.621065 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 48/91] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:31:42 2022] GET /identity/v3/users/b6be772778914724a2fb0603b4f3373c => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:42.621909 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881f8b8-e7af-4563-9ba4-871de901e43f None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:42.739538 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:42.748828 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c43500-2ca8-4d09-a68e-7744f3b56ac5 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:42.778212 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:42.781713 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881f8b8-e7af-4563-9ba4-871de901e43f None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:42.793191 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42238854-f052-46b7-98b0-07c02641d7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:42.794050 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42238854-f052-46b7-98b0-07c02641d7aa None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:42.794954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42238854-f052-46b7-98b0-07c02641d7aa None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:42.794954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42238854-f052-46b7-98b0-07c02641d7aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:42.795523 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42238854-f052-46b7-98b0-07c02641d7aa None admin] RBAC: Adding query filter params (role.id=5c25aa917ab34baabb795c54dd8a4d02, scope.project.id=dbe071067d79437b8969c9883cc256df, user.id=f82db915cef84d91b03fd2cabdc99332) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:42.795863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42238854-f052-46b7-98b0-07c02641d7aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:42.797646 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42238854-f052-46b7-98b0-07c02641d7aa None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:42.804440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 44/92] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:31:42 2022] GET /identity/v3/role_assignments?user.id=f82db915cef84d91b03fd2cabdc99332&scope.project.id=dbe071067d79437b8969c9883cc256df&role.id=5c25aa917ab34baabb795c54dd8a4d02 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:42.806014 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42238854-f052-46b7-98b0-07c02641d7aa None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:42.851094 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c731e-b9e3-4232-93ed-9bbf8a9bd149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:42.851094 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c731e-b9e3-4232-93ed-9bbf8a9bd149 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:42.851094 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c731e-b9e3-4232-93ed-9bbf8a9bd149 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:42.851094 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c731e-b9e3-4232-93ed-9bbf8a9bd149 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:42.851631 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c731e-b9e3-4232-93ed-9bbf8a9bd149 None admin] RBAC: Adding query filter params (role.id=0ff11803573b472ab020a59b7f452dcd, scope.project.id=dbe071067d79437b8969c9883cc256df, user.id=b6be772778914724a2fb0603b4f3373c) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:42.851951 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c731e-b9e3-4232-93ed-9bbf8a9bd149 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:42.858880 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c731e-b9e3-4232-93ed-9bbf8a9bd149 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:42.870349 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 49/93] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:31:42 2022] GET /identity/v3/role_assignments?user.id=b6be772778914724a2fb0603b4f3373c&scope.project.id=dbe071067d79437b8969c9883cc256df&role.id=0ff11803573b472ab020a59b7f452dcd => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:42.871857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c731e-b9e3-4232-93ed-9bbf8a9bd149 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:42.946622 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42238854-f052-46b7-98b0-07c02641d7aa None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:42.996638 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbcaaf-638b-4832-b2a3-276b7cb89e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:42.997431 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbcaaf-638b-4832-b2a3-276b7cb89e33 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:42.997640 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbcaaf-638b-4832-b2a3-276b7cb89e33 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:42.997920 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbcaaf-638b-4832-b2a3-276b7cb89e33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:42.998673 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbcaaf-638b-4832-b2a3-276b7cb89e33 None admin] RBAC: Adding query filter params (role.id=adc45cdd4c9543b3b8b24141870f4b11, scope.project.id=dbe071067d79437b8969c9883cc256df, user.id=b6be772778914724a2fb0603b4f3373c) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:42.999167 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbcaaf-638b-4832-b2a3-276b7cb89e33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:43.003619 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbcaaf-638b-4832-b2a3-276b7cb89e33 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:43.008899 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c731e-b9e3-4232-93ed-9bbf8a9bd149 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:43.011171 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 45/94] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:31:42 2022] GET /identity/v3/role_assignments?user.id=b6be772778914724a2fb0603b4f3373c&scope.project.id=dbe071067d79437b8969c9883cc256df&role.id=adc45cdd4c9543b3b8b24141870f4b11 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:43.056275 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bb64d-703b-42ac-88a9-2d6ab4bb8fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:43.057467 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bb64d-703b-42ac-88a9-2d6ab4bb8fc4 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:43.057770 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bb64d-703b-42ac-88a9-2d6ab4bb8fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:43.058055 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bb64d-703b-42ac-88a9-2d6ab4bb8fc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:43.096822 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:43.144471 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72bb64d-703b-42ac-88a9-2d6ab4bb8fc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:43.145949 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72bb64d-703b-42ac-88a9-2d6ab4bb8fc4 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:43.260261 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 50/95] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:31:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:31:43.266396 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbcaaf-638b-4832-b2a3-276b7cb89e33 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:43.311616 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:43.425829 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbcaaf-638b-4832-b2a3-276b7cb89e33 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:43.465426 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df8348-c70a-4ff2-aa55-1c267e692a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:43.466074 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df8348-c70a-4ff2-aa55-1c267e692a9b None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:43.466460 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df8348-c70a-4ff2-aa55-1c267e692a9b None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:43.466970 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df8348-c70a-4ff2-aa55-1c267e692a9b None admin] PATH_INFO: `/v3/projects/373e66d0f6cf44aea2f2ab47596d2137` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:43.468473 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df8348-c70a-4ff2-aa55-1c267e692a9b None admin] RBAC: Authorizing `identity:get_project(project_id=373e66d0f6cf44aea2f2ab47596d2137)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:43.469966 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df8348-c70a-4ff2-aa55-1c267e692a9b None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:43.471811 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 46/96] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:31:43 2022] GET /identity/v3/projects/373e66d0f6cf44aea2f2ab47596d2137 => generated 312 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:43.477739 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bb64d-703b-42ac-88a9-2d6ab4bb8fc4 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:43.552816 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:43.597395 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bb64d-703b-42ac-88a9-2d6ab4bb8fc4 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:43.635903 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacdc1df-065d-4c65-ab6e-fdc5f1adb304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:43.636305 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdc1df-065d-4c65-ab6e-fdc5f1adb304 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:43.636593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdc1df-065d-4c65-ab6e-fdc5f1adb304 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:43.636874 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdc1df-065d-4c65-ab6e-fdc5f1adb304 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:43.637647 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacdc1df-065d-4c65-ab6e-fdc5f1adb304 None admin] RBAC: Adding query filter params (role.id=adc45cdd4c9543b3b8b24141870f4b11, scope.project.id=373e66d0f6cf44aea2f2ab47596d2137, user.id=b6be772778914724a2fb0603b4f3373c) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:43.637960 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacdc1df-065d-4c65-ab6e-fdc5f1adb304 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:43.639419 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacdc1df-065d-4c65-ab6e-fdc5f1adb304 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:43.645407 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 51/97] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:31:43 2022] GET /identity/v3/role_assignments?user.id=b6be772778914724a2fb0603b4f3373c&scope.project.id=373e66d0f6cf44aea2f2ab47596d2137&role.id=adc45cdd4c9543b3b8b24141870f4b11 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:45.654158 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eef36d-0d54-4942-b152-9ca0f4e4d1c7 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:45.654666 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eef36d-0d54-4942-b152-9ca0f4e4d1c7 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:45.654739 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eef36d-0d54-4942-b152-9ca0f4e4d1c7 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:45.656350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 47/98] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:31:45.661173 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b926e-f383-4d71-94b6-f3f2241e9968 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:45.661671 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b926e-f383-4d71-94b6-f3f2241e9968 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:45.661756 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b926e-f383-4d71-94b6-f3f2241e9968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:45.684467 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffc0d5-99c4-4486-b3ea-20c965c1a911 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:45.684752 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffc0d5-99c4-4486-b3ea-20c965c1a911 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:45.685024 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffc0d5-99c4-4486-b3ea-20c965c1a911 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:45.686511 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 48/99] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 17:31:45.690036 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-e87b926e-f383-4d71-94b6-f3f2241e9968 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:45.691870 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d2b64-08b3-46cf-a511-5177bcebe195 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:45.692158 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d2b64-08b3-46cf-a511-5177bcebe195 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:45.692437 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d2b64-08b3-46cf-a511-5177bcebe195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:45.697885 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-e87b926e-f383-4d71-94b6-f3f2241e9968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:45.719943 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-259d2b64-08b3-46cf-a511-5177bcebe195 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:45.721169 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-259d2b64-08b3-46cf-a511-5177bcebe195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:45.830763 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 52/100] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 17:31:45.833064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b3bc8-bb9e-4e68-9e04-775d5ef5b6e9 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:45.833620 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b3bc8-bb9e-4e68-9e04-775d5ef5b6e9 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:45.834098 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b3bc8-bb9e-4e68-9e04-775d5ef5b6e9 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:45.836428 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 53/101] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:31:45.853715 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc43b8-bfdc-4cda-b039-85ad06b4e2b9 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:45.854649 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc43b8-bfdc-4cda-b039-85ad06b4e2b9 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:45.855132 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc43b8-bfdc-4cda-b039-85ad06b4e2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:45.868548 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 49/102] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:31:45.877368 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d2b64-08b3-46cf-a511-5177bcebe195 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:45.879529 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-35cc43b8-bfdc-4cda-b039-85ad06b4e2b9 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:45.881239 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-35cc43b8-bfdc-4cda-b039-85ad06b4e2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:45.946642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:45.958293 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 54/103] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 17:31:45.969020 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:45.969490 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc43b8-bfdc-4cda-b039-85ad06b4e2b9 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:46.078375 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc43b8-bfdc-4cda-b039-85ad06b4e2b9 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:46.079269 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d2b64-08b3-46cf-a511-5177bcebe195 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:46.115775 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d900c-41ef-47a4-9555-caa8fcd2f439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:46.116743 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d900c-41ef-47a4-9555-caa8fcd2f439 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:46.117288 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d900c-41ef-47a4-9555-caa8fcd2f439 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:46.117838 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d900c-41ef-47a4-9555-caa8fcd2f439 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:46.126522 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f3aff-d07b-47f8-9279-6a80e8c86a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:46.127340 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f3aff-d07b-47f8-9279-6a80e8c86a85 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:46.127554 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f3aff-d07b-47f8-9279-6a80e8c86a85 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:46.127837 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f3aff-d07b-47f8-9279-6a80e8c86a85 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:46.130998 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d900c-41ef-47a4-9555-caa8fcd2f439 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:31:46.137346 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-fd6d900c-41ef-47a4-9555-caa8fcd2f439 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 17:31:46.137346 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:31:46.137346 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:31:46.137346 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:31:46.137346 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:31:46.137346 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:31:46.137346 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:31:46.137346 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:31:46.137346 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:31:46.137346 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:31:46.137346 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:31:46.137346 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:31:46.137346 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:31:46.137346 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:31:46.137346 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:31:46.137346 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:31:46.138281 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:31:46.138281 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:31:46.138281 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:31:46.138281 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:31:46.138281 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:31:46.138281 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:31:46.138281 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:31:46.138281 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:31:46.138281 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:31:46.138281 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:31:46.138281 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:31:46.138281 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:31:46.138281 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:31:46.138281 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:31:46.138281 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:31:46.138281 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:31:46.139060 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:31:46.139060 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:31:46.139060 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:31:46.139060 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:31:46.139060 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:31:46.139060 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:31:46.139060 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:31:46.139060 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:31:46.139060 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:31:46.139060 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:31:46.139060 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 17:31:46.139060 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:31:46.139655 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f3aff-d07b-47f8-9279-6a80e8c86a85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:31:46.141418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 55/104] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 8 17:31:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:31:46.142374 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d900c-41ef-47a4-9555-caa8fcd2f439 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:46.144563 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-7a7f3aff-d07b-47f8-9279-6a80e8c86a85 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 17:31:46.144563 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:31:46.144563 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:31:46.144563 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:31:46.144563 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:31:46.144563 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:31:46.144563 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:31:46.144563 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:31:46.144563 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:31:46.144563 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:31:46.144563 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:31:46.144563 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:31:46.144563 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:31:46.144563 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:31:46.144563 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:31:46.144563 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:31:46.145475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:31:46.145475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:31:46.145475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:31:46.145475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:31:46.145475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:31:46.145475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:31:46.145475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:31:46.145475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:31:46.145475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:31:46.145475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:31:46.145475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:31:46.145475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:31:46.145475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:31:46.145475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:31:46.145475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:31:46.145475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:31:46.146323 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:31:46.146323 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:31:46.146323 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:31:46.146323 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:31:46.146323 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:31:46.146323 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:31:46.146323 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:31:46.146323 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:31:46.146323 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:31:46.146323 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:31:46.146323 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 17:31:46.146323 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:31:46.146323 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 50/105] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:31:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:31:46.147191 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75110f75-d47f-4e4d-93f7-2bb72659f73e None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:46.147449 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75110f75-d47f-4e4d-93f7-2bb72659f73e None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:46.147732 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75110f75-d47f-4e4d-93f7-2bb72659f73e None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:46.153116 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 51/106] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:31:46.154300 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75110f75-d47f-4e4d-93f7-2bb72659f73e None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:46.226150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:46.264995 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:46.280029 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d900c-41ef-47a4-9555-caa8fcd2f439 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:46.290245 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75110f75-d47f-4e4d-93f7-2bb72659f73e None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:46.328357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e74789-e62f-477d-ad3f-d52bb7669ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:46.329587 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e74789-e62f-477d-ad3f-d52bb7669ed0 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:46.330075 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e74789-e62f-477d-ad3f-d52bb7669ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:46.330549 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e74789-e62f-477d-ad3f-d52bb7669ed0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:46.330650 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2c9ed-ea40-481b-96dd-d43cd7c469a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:46.331207 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2c9ed-ea40-481b-96dd-d43cd7c469a6 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:46.331496 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2c9ed-ea40-481b-96dd-d43cd7c469a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:46.331769 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2c9ed-ea40-481b-96dd-d43cd7c469a6 None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:46.332442 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb2c9ed-ea40-481b-96dd-d43cd7c469a6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:46.332746 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb2c9ed-ea40-481b-96dd-d43cd7c469a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:46.334334 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb2c9ed-ea40-481b-96dd-d43cd7c469a6 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:46.343677 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 52/107] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 8 17:31:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:46.344657 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2c9ed-ea40-481b-96dd-d43cd7c469a6 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:46.345582 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e74789-e62f-477d-ad3f-d52bb7669ed0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:31:46.351692 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-97e74789-e62f-477d-ad3f-d52bb7669ed0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:31:46.351692 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:31:46.351692 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:31:46.351692 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:31:46.351692 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:31:46.351692 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:31:46.351692 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:31:46.351692 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:31:46.351692 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:31:46.351692 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:31:46.351692 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:31:46.351692 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:31:46.351692 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:31:46.351692 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:31:46.351692 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:31:46.351692 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:31:46.352570 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:31:46.352570 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:31:46.352570 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:31:46.352570 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:31:46.352570 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:31:46.352570 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:31:46.352570 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:31:46.352570 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:31:46.352570 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:31:46.352570 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:31:46.352570 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:31:46.352570 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:31:46.352570 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:31:46.352570 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:31:46.352570 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:31:46.352570 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:31:46.354369 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:31:46.354369 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:31:46.354369 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:31:46.354369 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:31:46.354369 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:31:46.354369 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:31:46.354369 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:31:46.354369 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:31:46.354369 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:31:46.354369 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:31:46.354369 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:31:46.354369 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:31:46.356908 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 56/108] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 8 17:31:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:31:46.359237 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a67ed-6882-47c0-b364-71f094a5de26 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:46.360041 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a67ed-6882-47c0-b364-71f094a5de26 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:46.360534 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a67ed-6882-47c0-b364-71f094a5de26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:46.385331 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-6b8a67ed-6882-47c0-b364-71f094a5de26 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:46.386915 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-6b8a67ed-6882-47c0-b364-71f094a5de26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:46.469416 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2c9ed-ea40-481b-96dd-d43cd7c469a6 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:46.478429 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 57/109] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:31:46.478429 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a67ed-6882-47c0-b364-71f094a5de26 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:46.508688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e959027-f033-4d21-a424-e94bda355ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:46.509334 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e959027-f033-4d21-a424-e94bda355ba4 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:46.509621 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e959027-f033-4d21-a424-e94bda355ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:46.510116 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e959027-f033-4d21-a424-e94bda355ba4 None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:46.510791 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e959027-f033-4d21-a424-e94bda355ba4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:46.511100 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e959027-f033-4d21-a424-e94bda355ba4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:46.512487 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e959027-f033-4d21-a424-e94bda355ba4 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:46.519737 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:46.521955 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 53/110] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:31:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:46.527645 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e959027-f033-4d21-a424-e94bda355ba4 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:46.536896 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:46.584556 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a67ed-6882-47c0-b364-71f094a5de26 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:46.622014 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428e82d-2f02-44ff-bc72-9b1f646aafaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:46.622742 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428e82d-2f02-44ff-bc72-9b1f646aafaa None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:46.622992 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428e82d-2f02-44ff-bc72-9b1f646aafaa None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:46.623225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428e82d-2f02-44ff-bc72-9b1f646aafaa None admin] PATH_INFO: `/v3/users/e186c97892074e0fbccec1ab89d7e033` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:46.635630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e959027-f033-4d21-a424-e94bda355ba4 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:46.637143 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428e82d-2f02-44ff-bc72-9b1f646aafaa None admin] RBAC: Authorizing `identity:get_user(user_id=e186c97892074e0fbccec1ab89d7e033)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:46.638971 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428e82d-2f02-44ff-bc72-9b1f646aafaa None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:46.640640 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 58/111] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:31:46 2022] GET /identity/v3/users/e186c97892074e0fbccec1ab89d7e033 => generated 289 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:46.641835 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350ec28-22b1-435b-9e4c-711375f6b6d6 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:46.642123 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350ec28-22b1-435b-9e4c-711375f6b6d6 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:46.642402 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350ec28-22b1-435b-9e4c-711375f6b6d6 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:46.643864 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 59/112] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:31:46.644571 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350ec28-22b1-435b-9e4c-711375f6b6d6 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:46.685355 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828c9f4-acb2-4f20-a2aa-62a43cacdd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:46.687681 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828c9f4-acb2-4f20-a2aa-62a43cacdd9c None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:46.688175 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828c9f4-acb2-4f20-a2aa-62a43cacdd9c None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:46.688671 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828c9f4-acb2-4f20-a2aa-62a43cacdd9c None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:46.689574 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828c9f4-acb2-4f20-a2aa-62a43cacdd9c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:46.690084 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828c9f4-acb2-4f20-a2aa-62a43cacdd9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:46.691672 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828c9f4-acb2-4f20-a2aa-62a43cacdd9c None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:46.703704 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 54/113] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:31:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:46.704825 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828c9f4-acb2-4f20-a2aa-62a43cacdd9c None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:46.751743 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:46.758740 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350ec28-22b1-435b-9e4c-711375f6b6d6 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:46.779198 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:46.793669 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c4e71-90a6-4cff-80f8-7d958628ede0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:46.794308 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c4e71-90a6-4cff-80f8-7d958628ede0 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:46.794635 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c4e71-90a6-4cff-80f8-7d958628ede0 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:46.794979 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c4e71-90a6-4cff-80f8-7d958628ede0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:46.805137 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c4e71-90a6-4cff-80f8-7d958628ede0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:31:46.810388 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-9f2c4e71-90a6-4cff-80f8-7d958628ede0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 17:31:46.810388 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:31:46.810388 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:31:46.810388 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:31:46.810388 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:31:46.810388 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:31:46.810388 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:31:46.810388 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:31:46.810388 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:31:46.810388 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:31:46.810388 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:31:46.810388 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:31:46.810388 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:31:46.810388 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:31:46.810388 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:31:46.810388 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:31:46.811282 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:31:46.811282 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:31:46.811282 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:31:46.811282 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:31:46.811282 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:31:46.811282 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:31:46.811282 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:31:46.811282 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:31:46.811282 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:31:46.811282 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:31:46.811282 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:31:46.811282 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:31:46.811282 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:31:46.811282 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:31:46.811282 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:31:46.811282 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:31:46.812072 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:31:46.812072 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:31:46.812072 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:31:46.812072 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:31:46.812072 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:31:46.812072 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:31:46.812072 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:31:46.812072 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:31:46.812072 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:31:46.812072 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:31:46.812072 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 17:31:46.812072 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:31:46.812072 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 60/114] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:31:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:31:46.812746 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c4e71-90a6-4cff-80f8-7d958628ede0 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:46.815145 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828c9f4-acb2-4f20-a2aa-62a43cacdd9c None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:46.848139 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265563b6-c6fd-4c64-91c0-7efd50d6a0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:46.848765 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265563b6-c6fd-4c64-91c0-7efd50d6a0cb None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:46.849076 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265563b6-c6fd-4c64-91c0-7efd50d6a0cb None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:46.849363 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265563b6-c6fd-4c64-91c0-7efd50d6a0cb None admin] PATH_INFO: `/v3/users/b6be772778914724a2fb0603b4f3373c` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:46.850501 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265563b6-c6fd-4c64-91c0-7efd50d6a0cb None admin] RBAC: Authorizing `identity:get_user(user_id=b6be772778914724a2fb0603b4f3373c)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:46.851965 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265563b6-c6fd-4c64-91c0-7efd50d6a0cb None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:46.854123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 55/115] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:31:46 2022] GET /identity/v3/users/b6be772778914724a2fb0603b4f3373c => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:46.855373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bce7d3-cb53-454b-956a-e39c920c3b48 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:46.855660 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bce7d3-cb53-454b-956a-e39c920c3b48 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:46.855936 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bce7d3-cb53-454b-956a-e39c920c3b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:46.874177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-24bce7d3-cb53-454b-956a-e39c920c3b48 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:46.875369 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-24bce7d3-cb53-454b-956a-e39c920c3b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:46.915539 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c4e71-90a6-4cff-80f8-7d958628ede0 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:46.941850 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 56/116] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:31:46.942696 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bce7d3-cb53-454b-956a-e39c920c3b48 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:46.950532 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a8cc2-fb1c-481e-8170-7a66a6f007ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:46.951147 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a8cc2-fb1c-481e-8170-7a66a6f007ed None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:46.951437 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a8cc2-fb1c-481e-8170-7a66a6f007ed None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:46.951714 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a8cc2-fb1c-481e-8170-7a66a6f007ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:46.976870 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:47.021478 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a8cc2-fb1c-481e-8170-7a66a6f007ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:47.021858 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:47.022880 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a8cc2-fb1c-481e-8170-7a66a6f007ed None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:47.056328 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bce7d3-cb53-454b-956a-e39c920c3b48 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:47.090071 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8ff04-8146-492e-990b-ccc7a6462271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:47.090944 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8ff04-8146-492e-990b-ccc7a6462271 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:47.091229 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8ff04-8146-492e-990b-ccc7a6462271 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:47.091505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8ff04-8146-492e-990b-ccc7a6462271 None admin] PATH_INFO: `/v3/users/f82db915cef84d91b03fd2cabdc99332` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:47.092620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8ff04-8146-492e-990b-ccc7a6462271 None admin] RBAC: Authorizing `identity:get_user(user_id=f82db915cef84d91b03fd2cabdc99332)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:47.094091 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8ff04-8146-492e-990b-ccc7a6462271 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:47.095655 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 57/117] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:31:46 2022] GET /identity/v3/users/f82db915cef84d91b03fd2cabdc99332 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:47.100433 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9338e-832a-4275-956f-1b9e75695def None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:47.100433 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9338e-832a-4275-956f-1b9e75695def None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:47.100433 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9338e-832a-4275-956f-1b9e75695def None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:47.100433 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 58/118] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:31:47.100866 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9338e-832a-4275-956f-1b9e75695def None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:47.124958 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 61/119] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:31:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:31:47.126025 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a8cc2-fb1c-481e-8170-7a66a6f007ed None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:47.179520 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:47.205445 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9338e-832a-4275-956f-1b9e75695def None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:47.229973 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a8cc2-fb1c-481e-8170-7a66a6f007ed None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:47.240090 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08571d39-cee4-46ee-ba7d-c883aeb547c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:47.240697 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08571d39-cee4-46ee-ba7d-c883aeb547c3 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:47.240979 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08571d39-cee4-46ee-ba7d-c883aeb547c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:47.241286 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08571d39-cee4-46ee-ba7d-c883aeb547c3 None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:47.241944 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08571d39-cee4-46ee-ba7d-c883aeb547c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:47.242251 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08571d39-cee4-46ee-ba7d-c883aeb547c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:47.243634 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08571d39-cee4-46ee-ba7d-c883aeb547c3 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:47.245013 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:47.252343 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 59/120] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 8 17:31:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:47.253171 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08571d39-cee4-46ee-ba7d-c883aeb547c3 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:47.259752 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f9d5b-bffd-41bd-ba1e-6718c72a9f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:47.260547 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f9d5b-bffd-41bd-ba1e-6718c72a9f9d None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:47.260838 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f9d5b-bffd-41bd-ba1e-6718c72a9f9d None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:47.261165 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f9d5b-bffd-41bd-ba1e-6718c72a9f9d None admin] PATH_INFO: `/v3/projects/dbe071067d79437b8969c9883cc256df` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:47.262313 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f9d5b-bffd-41bd-ba1e-6718c72a9f9d None admin] RBAC: Authorizing `identity:get_project(project_id=dbe071067d79437b8969c9883cc256df)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:47.263882 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f9d5b-bffd-41bd-ba1e-6718c72a9f9d None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:47.265556 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 62/121] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:31:47 2022] GET /identity/v3/projects/dbe071067d79437b8969c9883cc256df => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:47.266314 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f9d5b-bffd-41bd-ba1e-6718c72a9f9d None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:47.359193 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08571d39-cee4-46ee-ba7d-c883aeb547c3 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:47.368350 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f9d5b-bffd-41bd-ba1e-6718c72a9f9d None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:47.392250 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388982e9-104f-4624-9c3e-411759c68c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:47.392444 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:47.393240 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388982e9-104f-4624-9c3e-411759c68c32 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:47.393690 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388982e9-104f-4624-9c3e-411759c68c32 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:47.394113 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388982e9-104f-4624-9c3e-411759c68c32 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:47.395406 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388982e9-104f-4624-9c3e-411759c68c32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:47.396896 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388982e9-104f-4624-9c3e-411759c68c32 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:47.398546 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 60/122] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:31:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:47.405813 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37864ae8-3de1-49e1-8273-3ee101a7e2d3 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:47.405813 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37864ae8-3de1-49e1-8273-3ee101a7e2d3 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:47.405813 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37864ae8-3de1-49e1-8273-3ee101a7e2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:47.409454 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb210723-abff-473d-8edf-5df24562bd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:47.410094 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb210723-abff-473d-8edf-5df24562bd4c None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:47.410379 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb210723-abff-473d-8edf-5df24562bd4c None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:47.410706 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb210723-abff-473d-8edf-5df24562bd4c None admin] PATH_INFO: `/v3/projects/dbe071067d79437b8969c9883cc256df` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:47.411962 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb210723-abff-473d-8edf-5df24562bd4c None admin] RBAC: Authorizing `identity:get_project(project_id=dbe071067d79437b8969c9883cc256df)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:47.413430 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb210723-abff-473d-8edf-5df24562bd4c None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:47.415084 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 63/123] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:31:47 2022] GET /identity/v3/projects/dbe071067d79437b8969c9883cc256df => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:47.415852 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb210723-abff-473d-8edf-5df24562bd4c None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:47.422520 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-37864ae8-3de1-49e1-8273-3ee101a7e2d3 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:47.423733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-37864ae8-3de1-49e1-8273-3ee101a7e2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:47.483483 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:47.492579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 61/124] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:31:47.502196 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37864ae8-3de1-49e1-8273-3ee101a7e2d3 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:47.521631 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb210723-abff-473d-8edf-5df24562bd4c None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:47.556505 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29c813-fbe2-4848-b0b8-2228550706ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:47.557190 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29c813-fbe2-4848-b0b8-2228550706ff None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:47.557474 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29c813-fbe2-4848-b0b8-2228550706ff None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:47.557751 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29c813-fbe2-4848-b0b8-2228550706ff None admin] PATH_INFO: `/v3/projects/dbe071067d79437b8969c9883cc256df` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:47.558896 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29c813-fbe2-4848-b0b8-2228550706ff None admin] RBAC: Authorizing `identity:get_project(project_id=dbe071067d79437b8969c9883cc256df)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:47.560348 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29c813-fbe2-4848-b0b8-2228550706ff None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:47.565084 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 64/125] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:31:47 2022] GET /identity/v3/projects/dbe071067d79437b8969c9883cc256df => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:47.565084 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29c813-fbe2-4848-b0b8-2228550706ff None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:47.600004 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37864ae8-3de1-49e1-8273-3ee101a7e2d3 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:47.623006 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:47.633602 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4278345-a785-41f9-952d-6d8f3aa5c11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:47.640419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4278345-a785-41f9-952d-6d8f3aa5c11e None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:47.640419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4278345-a785-41f9-952d-6d8f3aa5c11e None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:47.640419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4278345-a785-41f9-952d-6d8f3aa5c11e None admin] PATH_INFO: `/v3/users/b6be772778914724a2fb0603b4f3373c` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:47.640419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4278345-a785-41f9-952d-6d8f3aa5c11e None admin] RBAC: Authorizing `identity:get_user(user_id=b6be772778914724a2fb0603b4f3373c)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:47.640419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4278345-a785-41f9-952d-6d8f3aa5c11e None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:47.640419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 62/126] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:31:47 2022] GET /identity/v3/users/b6be772778914724a2fb0603b4f3373c => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:47.641198 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4278345-a785-41f9-952d-6d8f3aa5c11e None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:47.664968 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29c813-fbe2-4848-b0b8-2228550706ff None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:47.702403 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:47.705794 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311a3ec-a76e-4fe3-982b-da1a14fedb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:47.706457 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311a3ec-a76e-4fe3-982b-da1a14fedb43 None admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:47.706745 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311a3ec-a76e-4fe3-982b-da1a14fedb43 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:47.707023 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311a3ec-a76e-4fe3-982b-da1a14fedb43 None admin] PATH_INFO: `/v3/projects/dbe071067d79437b8969c9883cc256df/users/b6be772778914724a2fb0603b4f3373c/roles/0ff11803573b472ab020a59b7f452dcd` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:47.709276 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3311a3ec-a76e-4fe3-982b-da1a14fedb43 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbe071067d79437b8969c9883cc256df, user_id=b6be772778914724a2fb0603b4f3373c, role_id=0ff11803573b472ab020a59b7f452dcd)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:47.716190 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3311a3ec-a76e-4fe3-982b-da1a14fedb43 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:47.741797 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4278345-a785-41f9-952d-6d8f3aa5c11e None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:47.776634 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946ecfc-a482-475d-9aa0-2b7b196b60d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:47.777265 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946ecfc-a482-475d-9aa0-2b7b196b60d1 None admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:47.777547 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946ecfc-a482-475d-9aa0-2b7b196b60d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:47.778035 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 65/127] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 8 17:31:47 2022] PUT /identity/v3/projects/dbe071067d79437b8969c9883cc256df/users/b6be772778914724a2fb0603b4f3373c/roles/0ff11803573b472ab020a59b7f452dcd => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:31:47.778473 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946ecfc-a482-475d-9aa0-2b7b196b60d1 None admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:47.778473 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6946ecfc-a482-475d-9aa0-2b7b196b60d1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:47.778611 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311a3ec-a76e-4fe3-982b-da1a14fedb43 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:47.779860 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6946ecfc-a482-475d-9aa0-2b7b196b60d1 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:47.875250 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 63/128] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Aug 8 17:31:47 2022] POST /identity/v3/projects => generated 302 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:31:47.876204 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946ecfc-a482-475d-9aa0-2b7b196b60d1 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:47.931749 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311a3ec-a76e-4fe3-982b-da1a14fedb43 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:47.958822 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:47.975781 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d9bde-9f71-4e4c-8204-287204e64f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:47.976720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d9bde-9f71-4e4c-8204-287204e64f7f None admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:47.977017 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d9bde-9f71-4e4c-8204-287204e64f7f None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:47.977329 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d9bde-9f71-4e4c-8204-287204e64f7f None admin] PATH_INFO: `/v3/projects/dbe071067d79437b8969c9883cc256df/users/f82db915cef84d91b03fd2cabdc99332/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:47.979895 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d9bde-9f71-4e4c-8204-287204e64f7f None admin] RBAC: Authorizing `identity:create_grant(project_id=dbe071067d79437b8969c9883cc256df, user_id=f82db915cef84d91b03fd2cabdc99332, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:47.981569 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d9bde-9f71-4e4c-8204-287204e64f7f None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:48.014023 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946ecfc-a482-475d-9aa0-2b7b196b60d1 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:48.032356 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:48.055033 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fffa34e-3ef2-4b21-8a9a-e240b1151aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:48.055852 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffa34e-3ef2-4b21-8a9a-e240b1151aef None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:48.056213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffa34e-3ef2-4b21-8a9a-e240b1151aef None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:48.056674 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffa34e-3ef2-4b21-8a9a-e240b1151aef None admin] PATH_INFO: `/v3/roles/member` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:48.063608 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 66/129] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 8 17:31:47 2022] PUT /identity/v3/projects/dbe071067d79437b8969c9883cc256df/users/f82db915cef84d91b03fd2cabdc99332/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:31:48.064976 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d9bde-9f71-4e4c-8204-287204e64f7f None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:48.070263 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fffa34e-3ef2-4b21-8a9a-e240b1151aef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:31:48.075492 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-3fffa34e-3ef2-4b21-8a9a-e240b1151aef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 17:31:48.075492 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:31:48.075492 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:31:48.075492 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:31:48.075492 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:31:48.075492 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:31:48.075492 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:31:48.075492 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:31:48.075492 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:31:48.075492 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:31:48.075492 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:31:48.075492 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:31:48.075492 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:31:48.075492 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:31:48.075492 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:31:48.075492 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:31:48.076530 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:31:48.076530 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:31:48.076530 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:31:48.076530 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:31:48.076530 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:31:48.076530 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:31:48.076530 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:31:48.076530 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:31:48.076530 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:31:48.076530 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:31:48.076530 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:31:48.076530 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:31:48.076530 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:31:48.076530 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:31:48.076530 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:31:48.076530 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:31:48.077501 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:31:48.077501 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:31:48.077501 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:31:48.077501 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:31:48.077501 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:31:48.077501 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:31:48.077501 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:31:48.077501 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:31:48.077501 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:31:48.077501 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:31:48.077501 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 17:31:48.077501 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:31:48.077501 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 64/130] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:31:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:31:48.078245 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fffa34e-3ef2-4b21-8a9a-e240b1151aef None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:48.220810 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d9bde-9f71-4e4c-8204-287204e64f7f None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:48.259066 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fffa34e-3ef2-4b21-8a9a-e240b1151aef None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:48.274950 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d3c02-9fb9-485c-bede-9d9d81476023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:48.276102 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d3c02-9fb9-485c-bede-9d9d81476023 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:48.276388 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d3c02-9fb9-485c-bede-9d9d81476023 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:48.276757 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d3c02-9fb9-485c-bede-9d9d81476023 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:48.277612 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d3c02-9fb9-485c-bede-9d9d81476023 None admin] RBAC: Adding query filter params (role.id=ff9689d3969d49a19db320a3514ddb56, scope.project.id=dbe071067d79437b8969c9883cc256df, user.id=e186c97892074e0fbccec1ab89d7e033) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:48.277929 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d3c02-9fb9-485c-bede-9d9d81476023 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:48.279754 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d3c02-9fb9-485c-bede-9d9d81476023 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:48.285736 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 67/131] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:31:48 2022] GET /identity/v3/role_assignments?user.id=e186c97892074e0fbccec1ab89d7e033&scope.project.id=dbe071067d79437b8969c9883cc256df&role.id=ff9689d3969d49a19db320a3514ddb56 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:48.286557 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d3c02-9fb9-485c-bede-9d9d81476023 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:48.303246 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208cbd8-896a-4325-8225-71560399e00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:48.304241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208cbd8-896a-4325-8225-71560399e00e None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:48.304702 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208cbd8-896a-4325-8225-71560399e00e None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:48.305268 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208cbd8-896a-4325-8225-71560399e00e None admin] PATH_INFO: `/v3/projects/dbe071067d79437b8969c9883cc256df` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:48.307512 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c208cbd8-896a-4325-8225-71560399e00e None admin] RBAC: Authorizing `identity:get_project(project_id=dbe071067d79437b8969c9883cc256df)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:48.309442 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c208cbd8-896a-4325-8225-71560399e00e None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:48.313276 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 65/132] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:31:48 2022] GET /identity/v3/projects/dbe071067d79437b8969c9883cc256df => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:48.319253 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208cbd8-896a-4325-8225-71560399e00e None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:48.356587 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:48.390664 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:48.481849 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d3c02-9fb9-485c-bede-9d9d81476023 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:48.491166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208cbd8-896a-4325-8225-71560399e00e None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:48.561206 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816cac5-6b02-4f15-b417-eaf5410e25bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:48.561898 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816cac5-6b02-4f15-b417-eaf5410e25bb None admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:48.562194 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816cac5-6b02-4f15-b417-eaf5410e25bb None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:48.562481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816cac5-6b02-4f15-b417-eaf5410e25bb None admin] PATH_INFO: `/v3/projects/dbe071067d79437b8969c9883cc256df/users/b6be772778914724a2fb0603b4f3373c/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:48.564558 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816cac5-6b02-4f15-b417-eaf5410e25bb None admin] RBAC: Authorizing `identity:create_grant(project_id=dbe071067d79437b8969c9883cc256df, user_id=b6be772778914724a2fb0603b4f3373c, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:48.566181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816cac5-6b02-4f15-b417-eaf5410e25bb None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:48.567571 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d47c30-44eb-4a07-8223-ca87750aa01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:48.568202 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d47c30-44eb-4a07-8223-ca87750aa01c None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:48.568486 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d47c30-44eb-4a07-8223-ca87750aa01c None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:48.568761 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d47c30-44eb-4a07-8223-ca87750aa01c None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:48.569498 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d47c30-44eb-4a07-8223-ca87750aa01c None admin] RBAC: Adding query filter params (name=member) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:48.569811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d47c30-44eb-4a07-8223-ca87750aa01c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:48.571244 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d47c30-44eb-4a07-8223-ca87750aa01c None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:48.592942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 68/133] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 8 17:31:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:48.598301 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d47c30-44eb-4a07-8223-ca87750aa01c None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:48.659260 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 66/134] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 8 17:31:48 2022] PUT /identity/v3/projects/dbe071067d79437b8969c9883cc256df/users/b6be772778914724a2fb0603b4f3373c/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:31:48.751927 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d47c30-44eb-4a07-8223-ca87750aa01c None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:48.759318 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:48.789909 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17edf27b-f2ef-4732-96e4-d71d99c01be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:48.790568 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17edf27b-f2ef-4732-96e4-d71d99c01be1 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:48.791244 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17edf27b-f2ef-4732-96e4-d71d99c01be1 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:48.791244 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17edf27b-f2ef-4732-96e4-d71d99c01be1 None admin] PATH_INFO: `/v3/users/b6be772778914724a2fb0603b4f3373c` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:48.792501 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17edf27b-f2ef-4732-96e4-d71d99c01be1 None admin] RBAC: Authorizing `identity:get_user(user_id=b6be772778914724a2fb0603b4f3373c)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:48.794000 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17edf27b-f2ef-4732-96e4-d71d99c01be1 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:48.796096 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 69/135] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:31:48 2022] GET /identity/v3/users/b6be772778914724a2fb0603b4f3373c => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:48.801369 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816cac5-6b02-4f15-b417-eaf5410e25bb None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:48.948413 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816cac5-6b02-4f15-b417-eaf5410e25bb None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:48.955642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:48.983116 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba13e2-ca09-499e-abdb-b5f1dfc19f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:48.983761 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba13e2-ca09-499e-abdb-b5f1dfc19f0c None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:48.984044 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba13e2-ca09-499e-abdb-b5f1dfc19f0c None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:48.984324 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba13e2-ca09-499e-abdb-b5f1dfc19f0c None admin] PATH_INFO: `/v3/projects/373e66d0f6cf44aea2f2ab47596d2137` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:48.985504 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba13e2-ca09-499e-abdb-b5f1dfc19f0c None admin] RBAC: Authorizing `identity:get_project(project_id=373e66d0f6cf44aea2f2ab47596d2137)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:48.986974 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba13e2-ca09-499e-abdb-b5f1dfc19f0c None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:48.988871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 67/136] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:31:48 2022] GET /identity/v3/projects/373e66d0f6cf44aea2f2ab47596d2137 => generated 312 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:48.995319 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17edf27b-f2ef-4732-96e4-d71d99c01be1 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:49.112123 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17edf27b-f2ef-4732-96e4-d71d99c01be1 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:49.154177 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11147d8-7a7f-415c-af3d-b2d632aeade6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:49.154848 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11147d8-7a7f-415c-af3d-b2d632aeade6 None admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:49.155138 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11147d8-7a7f-415c-af3d-b2d632aeade6 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:49.155419 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11147d8-7a7f-415c-af3d-b2d632aeade6 None admin] PATH_INFO: `/v3/projects/373e66d0f6cf44aea2f2ab47596d2137/users/b6be772778914724a2fb0603b4f3373c/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:49.160202 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11147d8-7a7f-415c-af3d-b2d632aeade6 None admin] RBAC: Authorizing `identity:create_grant(project_id=373e66d0f6cf44aea2f2ab47596d2137, user_id=b6be772778914724a2fb0603b4f3373c, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:49.161686 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11147d8-7a7f-415c-af3d-b2d632aeade6 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:49.274204 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 70/137] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 8 17:31:48 2022] PUT /identity/v3/projects/373e66d0f6cf44aea2f2ab47596d2137/users/b6be772778914724a2fb0603b4f3373c/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:31:50.693175 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accc2f6-de5f-4678-8dca-9213d10038de None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:50.693700 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accc2f6-de5f-4678-8dca-9213d10038de None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:50.693784 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accc2f6-de5f-4678-8dca-9213d10038de None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:50.695126 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 68/138] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:31:50.701140 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6471ac-717d-4aad-9e3b-118eaf4f3d26 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:50.701938 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6471ac-717d-4aad-9e3b-118eaf4f3d26 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:50.702438 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6471ac-717d-4aad-9e3b-118eaf4f3d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:50.730033 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-0a6471ac-717d-4aad-9e3b-118eaf4f3d26 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:50.731574 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-0a6471ac-717d-4aad-9e3b-118eaf4f3d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:50.762972 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:50.808959 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 71/139] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:31:50.829208 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18973221-2a46-4762-b176-d2a4af0fda31 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:50.829491 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18973221-2a46-4762-b176-d2a4af0fda31 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:50.829774 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18973221-2a46-4762-b176-d2a4af0fda31 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:50.831120 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 69/140] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:31:50.833629 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698450a-550b-41a6-bcac-08d722ab5b83 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:50.833919 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698450a-550b-41a6-bcac-08d722ab5b83 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:50.834195 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698450a-550b-41a6-bcac-08d722ab5b83 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:50.835518 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 72/141] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:31:50.839695 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9d3dc-48ac-4a1e-aad3-22a45cc92736 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:50.839988 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9d3dc-48ac-4a1e-aad3-22a45cc92736 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:50.840269 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9d3dc-48ac-4a1e-aad3-22a45cc92736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:50.846322 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9f10c-6bcd-443c-ada6-9793d5c481cb None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:50.846609 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9f10c-6bcd-443c-ada6-9793d5c481cb None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:50.846883 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9f10c-6bcd-443c-ada6-9793d5c481cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:50.867078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-16a9d3dc-48ac-4a1e-aad3-22a45cc92736 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:50.868273 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-16a9d3dc-48ac-4a1e-aad3-22a45cc92736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:50.885859 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-d1e9f10c-6bcd-443c-ada6-9793d5c481cb None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:50.887053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-d1e9f10c-6bcd-443c-ada6-9793d5c481cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:51.011285 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 70/142] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:31:51.013836 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9d3dc-48ac-4a1e-aad3-22a45cc92736 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:51.032770 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 73/143] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:31:51.048110 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9f10c-6bcd-443c-ada6-9793d5c481cb None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:51.155897 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:51.159716 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9d3dc-48ac-4a1e-aad3-22a45cc92736 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:51.195889 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4d94f-e5c6-490c-8599-b9148e3c6e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:51.198939 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4d94f-e5c6-490c-8599-b9148e3c6e56 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:51.199449 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4d94f-e5c6-490c-8599-b9148e3c6e56 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:51.199917 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4d94f-e5c6-490c-8599-b9148e3c6e56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:51.218841 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b4d94f-e5c6-490c-8599-b9148e3c6e56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:31:51.223826 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-03b4d94f-e5c6-490c-8599-b9148e3c6e56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:31:51.223826 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:31:51.223826 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:31:51.223826 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:31:51.223826 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:31:51.223826 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:31:51.223826 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:31:51.223826 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:31:51.223826 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:31:51.223826 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:31:51.223826 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:31:51.223826 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:31:51.223826 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:31:51.223826 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:31:51.223826 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:31:51.223826 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:31:51.224703 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:31:51.224703 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:31:51.224703 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:31:51.224703 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:31:51.224703 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:31:51.224703 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:31:51.224703 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:31:51.224703 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:31:51.224703 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:31:51.224703 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:31:51.224703 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:31:51.224703 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:31:51.224703 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:31:51.224703 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:31:51.224703 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:31:51.224703 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:31:51.225493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:31:51.225493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:31:51.225493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:31:51.225493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:31:51.225493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:31:51.225493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:31:51.225493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:31:51.225493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:31:51.225493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:31:51.225493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:31:51.225493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:31:51.225493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:31:51.227737 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 71/144] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 8 17:31:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:31:51.228906 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4d94f-e5c6-490c-8599-b9148e3c6e56 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:51.268539 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:51.281333 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9f10c-6bcd-443c-ada6-9793d5c481cb None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:51.333891 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4d94f-e5c6-490c-8599-b9148e3c6e56 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:51.350349 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3299f-745b-471e-a458-30f3d04b199c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:51.351001 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3299f-745b-471e-a458-30f3d04b199c None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:51.351287 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3299f-745b-471e-a458-30f3d04b199c None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:51.351561 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3299f-745b-471e-a458-30f3d04b199c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:51.366130 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3299f-745b-471e-a458-30f3d04b199c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:31:51.372796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-19b3299f-745b-471e-a458-30f3d04b199c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 17:31:51.372796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:31:51.372796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:31:51.372796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:31:51.372796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:31:51.372796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:31:51.372796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:31:51.372796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:31:51.372796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:31:51.372796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:31:51.372796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:31:51.372796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:31:51.372796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:31:51.372796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:31:51.372796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:31:51.372796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:31:51.373735 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:31:51.373735 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:31:51.373735 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:31:51.373735 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:31:51.373735 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:31:51.373735 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:31:51.373735 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:31:51.373735 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:31:51.373735 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:31:51.373735 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:31:51.373735 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:31:51.373735 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:31:51.373735 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:31:51.373735 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:31:51.373735 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:31:51.373735 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:31:51.374535 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:31:51.374535 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:31:51.374535 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:31:51.374535 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:31:51.374535 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:31:51.374535 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:31:51.374535 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:31:51.374535 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:31:51.374535 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:31:51.374535 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:31:51.374535 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 17:31:51.374535 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:31:51.374535 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 74/145] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 8 17:31:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:31:51.375193 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3299f-745b-471e-a458-30f3d04b199c None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:51.376326 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57a96a-98b6-49bc-a470-71d1f72b3aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:51.377222 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57a96a-98b6-49bc-a470-71d1f72b3aaf None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:51.377705 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57a96a-98b6-49bc-a470-71d1f72b3aaf None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:51.378075 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57a96a-98b6-49bc-a470-71d1f72b3aaf None admin] PATH_INFO: `/v3/domains/default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:51.379325 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57a96a-98b6-49bc-a470-71d1f72b3aaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:51.380862 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57a96a-98b6-49bc-a470-71d1f72b3aaf None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:51.382826 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 72/146] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:31:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:51.384278 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115cda9-89b9-47c0-8d3f-b0781cd0d436 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:51.385402 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115cda9-89b9-47c0-8d3f-b0781cd0d436 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:51.385940 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115cda9-89b9-47c0-8d3f-b0781cd0d436 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:51.387451 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 73/147] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:31:51.389021 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115cda9-89b9-47c0-8d3f-b0781cd0d436 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:51.423440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:51.498428 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3299f-745b-471e-a458-30f3d04b199c None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:51.503093 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115cda9-89b9-47c0-8d3f-b0781cd0d436 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:51.533689 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e9e97-9d1d-43de-bf91-82892b9dd801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:51.534227 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e9e97-9d1d-43de-bf91-82892b9dd801 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:51.534571 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e9e97-9d1d-43de-bf91-82892b9dd801 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:51.534839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e9e97-9d1d-43de-bf91-82892b9dd801 None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:51.535644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e9e97-9d1d-43de-bf91-82892b9dd801 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:51.535863 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e9e97-9d1d-43de-bf91-82892b9dd801 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:51.537281 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e9e97-9d1d-43de-bf91-82892b9dd801 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:51.541377 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c72593-5a13-458a-bbaa-490db13be773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:51.542254 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c72593-5a13-458a-bbaa-490db13be773 None admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:51.542740 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c72593-5a13-458a-bbaa-490db13be773 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:51.543210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c72593-5a13-458a-bbaa-490db13be773 None admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:51.544136 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c72593-5a13-458a-bbaa-490db13be773 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:51.545857 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c72593-5a13-458a-bbaa-490db13be773 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:51.551876 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 75/148] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:31:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:51.551876 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86b606-dfa3-4de5-80f2-c5d3d0a189ab None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:51.551876 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86b606-dfa3-4de5-80f2-c5d3d0a189ab None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:51.551876 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86b606-dfa3-4de5-80f2-c5d3d0a189ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:51.569400 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-bf86b606-dfa3-4de5-80f2-c5d3d0a189ab None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:51.575831 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-bf86b606-dfa3-4de5-80f2-c5d3d0a189ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:51.583454 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:51.641097 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 76/149] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:31:51.641097 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86b606-dfa3-4de5-80f2-c5d3d0a189ab None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:51.657569 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 74/150] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Aug 8 17:31:51 2022] POST /identity/v3/users => generated 283 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:31:51.658637 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c72593-5a13-458a-bbaa-490db13be773 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:51.758494 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:51.777053 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c72593-5a13-458a-bbaa-490db13be773 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:51.779088 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86b606-dfa3-4de5-80f2-c5d3d0a189ab None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:51.825155 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8177305-53b9-4400-9721-a1595e37f068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:51.825155 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8177305-53b9-4400-9721-a1595e37f068 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:51.825155 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8177305-53b9-4400-9721-a1595e37f068 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:51.825155 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8177305-53b9-4400-9721-a1595e37f068 None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:51.825557 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8177305-53b9-4400-9721-a1595e37f068 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:51.825557 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8177305-53b9-4400-9721-a1595e37f068 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:51.825557 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8177305-53b9-4400-9721-a1595e37f068 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:51.830515 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814dfda-2bc6-4007-9c60-a4ffd0449fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:51.831408 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814dfda-2bc6-4007-9c60-a4ffd0449fc4 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:51.831920 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814dfda-2bc6-4007-9c60-a4ffd0449fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:51.832361 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814dfda-2bc6-4007-9c60-a4ffd0449fc4 None admin] PATH_INFO: `/v3/users/f82db915cef84d91b03fd2cabdc99332` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:51.835534 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 77/151] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:31:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:51.836490 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8177305-53b9-4400-9721-a1595e37f068 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:51.836816 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b814dfda-2bc6-4007-9c60-a4ffd0449fc4 None admin] RBAC: Authorizing `identity:get_user(user_id=f82db915cef84d91b03fd2cabdc99332)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:51.839164 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b814dfda-2bc6-4007-9c60-a4ffd0449fc4 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:51.841346 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 75/152] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:31:51 2022] GET /identity/v3/users/f82db915cef84d91b03fd2cabdc99332 => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:51.842341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814dfda-2bc6-4007-9c60-a4ffd0449fc4 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:51.854616 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:51.959938 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814dfda-2bc6-4007-9c60-a4ffd0449fc4 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:51.960127 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8177305-53b9-4400-9721-a1595e37f068 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:52.002860 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d398cca-a092-4425-84cc-7d5705c8a48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:52.003620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d398cca-a092-4425-84cc-7d5705c8a48c None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:52.003967 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d398cca-a092-4425-84cc-7d5705c8a48c None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:52.004312 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d398cca-a092-4425-84cc-7d5705c8a48c None admin] PATH_INFO: `/v3/users/b6be772778914724a2fb0603b4f3373c` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:52.005969 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff51527-f6ab-432c-9389-8b828aa9ae14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:52.006819 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff51527-f6ab-432c-9389-8b828aa9ae14 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:52.007296 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff51527-f6ab-432c-9389-8b828aa9ae14 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:52.007695 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d398cca-a092-4425-84cc-7d5705c8a48c None admin] RBAC: Authorizing `identity:get_user(user_id=b6be772778914724a2fb0603b4f3373c)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:52.007943 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff51527-f6ab-432c-9389-8b828aa9ae14 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:52.009679 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d398cca-a092-4425-84cc-7d5705c8a48c None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:52.011458 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 76/153] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:31:51 2022] GET /identity/v3/users/b6be772778914724a2fb0603b4f3373c => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:52.012080 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d398cca-a092-4425-84cc-7d5705c8a48c None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:52.024651 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff51527-f6ab-432c-9389-8b828aa9ae14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:31:52.031476 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-3ff51527-f6ab-432c-9389-8b828aa9ae14 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 17:31:52.031476 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:31:52.031476 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:31:52.031476 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:31:52.031476 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:31:52.031476 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:31:52.031476 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:31:52.031476 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:31:52.031476 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:31:52.031476 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:31:52.031476 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:31:52.031476 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:31:52.031476 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:31:52.031476 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:31:52.031476 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:31:52.031476 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:31:52.032499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:31:52.032499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:31:52.032499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:31:52.032499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:31:52.032499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:31:52.032499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:31:52.032499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:31:52.032499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:31:52.032499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:31:52.032499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:31:52.032499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:31:52.032499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:31:52.032499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:31:52.032499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:31:52.032499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:31:52.032499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:31:52.033816 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:31:52.033816 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:31:52.033816 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:31:52.033816 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:31:52.033816 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:31:52.033816 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:31:52.033816 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:31:52.033816 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:31:52.033816 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:31:52.033816 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:31:52.033816 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 17:31:52.033816 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:31:52.033816 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 78/154] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:31:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:31:52.034512 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566158b-a5be-4bba-b445-6094b4219a58 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:52.034577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566158b-a5be-4bba-b445-6094b4219a58 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:52.034917 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566158b-a5be-4bba-b445-6094b4219a58 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:52.036057 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 79/155] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:31:52.036755 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566158b-a5be-4bba-b445-6094b4219a58 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:52.048640 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:52.127106 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:52.159318 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d398cca-a092-4425-84cc-7d5705c8a48c None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:52.167763 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566158b-a5be-4bba-b445-6094b4219a58 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:52.198296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561d939-aee6-43d3-9a4d-80964ff60dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:52.199308 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561d939-aee6-43d3-9a4d-80964ff60dca None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:52.199650 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561d939-aee6-43d3-9a4d-80964ff60dca None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:52.199927 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561d939-aee6-43d3-9a4d-80964ff60dca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:52.212277 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f6830-ed1d-4443-854e-57e24dbf0ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:52.213735 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f6830-ed1d-4443-854e-57e24dbf0ca2 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:52.215225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f6830-ed1d-4443-854e-57e24dbf0ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:52.215225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f6830-ed1d-4443-854e-57e24dbf0ca2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:52.281976 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7561d939-aee6-43d3-9a4d-80964ff60dca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:52.283579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7561d939-aee6-43d3-9a4d-80964ff60dca None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:52.308964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f6830-ed1d-4443-854e-57e24dbf0ca2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:52.309940 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:52.311361 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f6830-ed1d-4443-854e-57e24dbf0ca2 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:52.395876 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:52.418714 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 77/156] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:31:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:31:52.425133 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561d939-aee6-43d3-9a4d-80964ff60dca None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:52.445956 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 80/157] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:31:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:31:52.448433 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a7eb9-82c9-4073-945b-d1208cfdb07f None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:52.448932 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a7eb9-82c9-4073-945b-d1208cfdb07f None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:52.449616 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a7eb9-82c9-4073-945b-d1208cfdb07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:52.471356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-049a7eb9-82c9-4073-945b-d1208cfdb07f None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:52.472938 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-049a7eb9-82c9-4073-945b-d1208cfdb07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:52.560551 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561d939-aee6-43d3-9a4d-80964ff60dca None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:52.566224 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 81/158] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:31:52.570443 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a584b-92ac-4e0f-a8a3-99a7d20557c4 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:52.570739 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a584b-92ac-4e0f-a8a3-99a7d20557c4 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:52.571018 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a584b-92ac-4e0f-a8a3-99a7d20557c4 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:52.577225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 82/159] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:31:52.577225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a584b-92ac-4e0f-a8a3-99a7d20557c4 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:52.593408 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:52.608731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a620fd4-7a8f-4f68-923a-0a27468cd172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:52.611463 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a620fd4-7a8f-4f68-923a-0a27468cd172 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:52.611463 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a620fd4-7a8f-4f68-923a-0a27468cd172 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:52.611463 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a620fd4-7a8f-4f68-923a-0a27468cd172 None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:52.611463 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a620fd4-7a8f-4f68-923a-0a27468cd172 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:52.611463 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a620fd4-7a8f-4f68-923a-0a27468cd172 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:52.613781 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a620fd4-7a8f-4f68-923a-0a27468cd172 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:52.627369 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 78/160] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 8 17:31:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:52.628834 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a620fd4-7a8f-4f68-923a-0a27468cd172 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:52.756659 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:52.764508 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a584b-92ac-4e0f-a8a3-99a7d20557c4 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:52.821330 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a620fd4-7a8f-4f68-923a-0a27468cd172 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:52.828893 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eadf4e-65b8-441e-b61e-7fa57567b415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:52.830249 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eadf4e-65b8-441e-b61e-7fa57567b415 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:52.830734 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eadf4e-65b8-441e-b61e-7fa57567b415 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:52.831220 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eadf4e-65b8-441e-b61e-7fa57567b415 None admin] PATH_INFO: `/v3/projects/dbe071067d79437b8969c9883cc256df` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:52.832707 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eadf4e-65b8-441e-b61e-7fa57567b415 None admin] RBAC: Authorizing `identity:get_project(project_id=dbe071067d79437b8969c9883cc256df)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:52.834526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eadf4e-65b8-441e-b61e-7fa57567b415 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:52.836821 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 83/161] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:31:52 2022] GET /identity/v3/projects/dbe071067d79437b8969c9883cc256df => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:52.838980 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3faf9f-5e57-458b-a51a-fa6722c32ed1 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:52.839475 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3faf9f-5e57-458b-a51a-fa6722c32ed1 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:52.840043 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3faf9f-5e57-458b-a51a-fa6722c32ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:52.869220 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15315a83-1232-4733-8dd7-aedfeaecc732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:52.869220 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15315a83-1232-4733-8dd7-aedfeaecc732 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:52.869220 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15315a83-1232-4733-8dd7-aedfeaecc732 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:52.869220 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15315a83-1232-4733-8dd7-aedfeaecc732 None admin] PATH_INFO: `/v3/projects/dbe071067d79437b8969c9883cc256df` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:52.869607 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15315a83-1232-4733-8dd7-aedfeaecc732 None admin] RBAC: Authorizing `identity:get_project(project_id=dbe071067d79437b8969c9883cc256df)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:52.869607 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15315a83-1232-4733-8dd7-aedfeaecc732 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:52.869607 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 79/162] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:31:52 2022] GET /identity/v3/projects/dbe071067d79437b8969c9883cc256df => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:52.873991 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15315a83-1232-4733-8dd7-aedfeaecc732 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:52.874392 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-de3faf9f-5e57-458b-a51a-fa6722c32ed1 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:52.875785 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-de3faf9f-5e57-458b-a51a-fa6722c32ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:52.965326 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:52.998351 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 84/163] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:31:52.999537 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3faf9f-5e57-458b-a51a-fa6722c32ed1 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:53.052242 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15315a83-1232-4733-8dd7-aedfeaecc732 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:53.131807 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4f9e5-0564-4949-b766-c66905293989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:53.132825 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4f9e5-0564-4949-b766-c66905293989 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:53.133352 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4f9e5-0564-4949-b766-c66905293989 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:53.133844 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4f9e5-0564-4949-b766-c66905293989 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:53.155926 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4f9e5-0564-4949-b766-c66905293989 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:31:53.164933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-ecc4f9e5-0564-4949-b766-c66905293989 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 17:31:53.164933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:31:53.164933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:31:53.164933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:31:53.164933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:31:53.164933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:31:53.164933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:31:53.164933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:31:53.164933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:31:53.164933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:31:53.164933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:31:53.164933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:31:53.164933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:31:53.164933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:31:53.164933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:31:53.164933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:31:53.166076 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:31:53.166076 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:31:53.166076 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:31:53.166076 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:31:53.166076 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:31:53.166076 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:31:53.166076 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:31:53.166076 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:31:53.166076 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:31:53.166076 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:31:53.166076 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:31:53.166076 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:31:53.166076 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:31:53.166076 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:31:53.166076 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:31:53.166076 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:31:53.166936 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:31:53.166936 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:31:53.166936 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:31:53.166936 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:31:53.166936 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:31:53.166936 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:31:53.166936 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:31:53.166936 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:31:53.166936 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:31:53.166936 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:31:53.166936 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 17:31:53.166936 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:31:53.166936 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 80/164] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:31:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:31:53.166936 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4f9e5-0564-4949-b766-c66905293989 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:53.193407 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:53.200524 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3faf9f-5e57-458b-a51a-fa6722c32ed1 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:53.268967 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7fb87-a612-4481-8fcb-e25131173e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:53.270011 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7fb87-a612-4481-8fcb-e25131173e5c None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:53.271694 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7fb87-a612-4481-8fcb-e25131173e5c None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:53.272174 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7fb87-a612-4481-8fcb-e25131173e5c None admin] PATH_INFO: `/v3/users/e186c97892074e0fbccec1ab89d7e033` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:53.274626 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7fb87-a612-4481-8fcb-e25131173e5c None admin] RBAC: Authorizing `identity:get_user(user_id=e186c97892074e0fbccec1ab89d7e033)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:53.276290 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7fb87-a612-4481-8fcb-e25131173e5c None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:53.278421 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 85/165] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:31:52 2022] GET /identity/v3/users/e186c97892074e0fbccec1ab89d7e033 => generated 289 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:53.279489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7fb87-a612-4481-8fcb-e25131173e5c None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:53.376557 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4f9e5-0564-4949-b766-c66905293989 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:53.398863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:53.440417 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7fb87-a612-4481-8fcb-e25131173e5c None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:53.479354 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f6e9f-4196-4ff7-83d0-61866eedbb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:53.480118 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f6e9f-4196-4ff7-83d0-61866eedbb2c None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:53.480506 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f6e9f-4196-4ff7-83d0-61866eedbb2c None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:53.480974 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f6e9f-4196-4ff7-83d0-61866eedbb2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:53.481816 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f6e9f-4196-4ff7-83d0-61866eedbb2c None admin] RBAC: Adding query filter params (role.id=0ff11803573b472ab020a59b7f452dcd, scope.project.id=dbe071067d79437b8969c9883cc256df, user.id=b6be772778914724a2fb0603b4f3373c) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:53.482276 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f6e9f-4196-4ff7-83d0-61866eedbb2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:53.483912 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f6e9f-4196-4ff7-83d0-61866eedbb2c None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:53.490811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 86/166] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:31:53 2022] GET /identity/v3/role_assignments?user.id=b6be772778914724a2fb0603b4f3373c&scope.project.id=dbe071067d79437b8969c9883cc256df&role.id=0ff11803573b472ab020a59b7f452dcd => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:53.491868 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f6e9f-4196-4ff7-83d0-61866eedbb2c None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:53.495013 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65520529-6120-47d2-b228-26155367a82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:53.495633 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65520529-6120-47d2-b228-26155367a82b None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:53.495910 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65520529-6120-47d2-b228-26155367a82b None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:53.496179 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65520529-6120-47d2-b228-26155367a82b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:53.496974 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65520529-6120-47d2-b228-26155367a82b None admin] RBAC: Adding query filter params (role.id=5c25aa917ab34baabb795c54dd8a4d02, scope.project.id=dbe071067d79437b8969c9883cc256df, user.id=f82db915cef84d91b03fd2cabdc99332) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:53.497315 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65520529-6120-47d2-b228-26155367a82b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:53.498775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65520529-6120-47d2-b228-26155367a82b None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:53.520440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 81/167] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:31:53 2022] GET /identity/v3/role_assignments?user.id=f82db915cef84d91b03fd2cabdc99332&scope.project.id=dbe071067d79437b8969c9883cc256df&role.id=5c25aa917ab34baabb795c54dd8a4d02 => generated 608 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:53.521112 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65520529-6120-47d2-b228-26155367a82b None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:53.525507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:53.672986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f6e9f-4196-4ff7-83d0-61866eedbb2c None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:53.739789 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110540e9-78e7-4e0a-b0cc-3b0564fd821f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:53.740463 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110540e9-78e7-4e0a-b0cc-3b0564fd821f None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:53.740747 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110540e9-78e7-4e0a-b0cc-3b0564fd821f None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:53.741023 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110540e9-78e7-4e0a-b0cc-3b0564fd821f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:53.758784 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110540e9-78e7-4e0a-b0cc-3b0564fd821f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:31:53.764888 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-110540e9-78e7-4e0a-b0cc-3b0564fd821f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 17:31:53.764888 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:31:53.764888 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:31:53.764888 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:31:53.764888 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:31:53.764888 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:31:53.764888 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:31:53.764888 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:31:53.764888 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:31:53.764888 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:31:53.764888 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:31:53.764888 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:31:53.764888 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:31:53.764888 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:31:53.764888 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:31:53.764888 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:31:53.765986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:31:53.765986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:31:53.765986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:31:53.765986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:31:53.765986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:31:53.765986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:31:53.765986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:31:53.765986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:31:53.765986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:31:53.765986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:31:53.765986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:31:53.765986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:31:53.765986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:31:53.765986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:31:53.765986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:31:53.765986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:31:53.767196 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:31:53.767196 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:31:53.767196 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:31:53.767196 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:31:53.767196 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:31:53.767196 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:31:53.767196 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:31:53.767196 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:31:53.767196 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:31:53.767196 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:31:53.767196 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 17:31:53.767196 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:31:53.767196 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 87/168] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:31:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:31:53.774361 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110540e9-78e7-4e0a-b0cc-3b0564fd821f None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:53.870846 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65520529-6120-47d2-b228-26155367a82b None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:53.882391 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:53.896274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110540e9-78e7-4e0a-b0cc-3b0564fd821f None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:53.939994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ec01f-af42-4907-92c0-942690fed910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:53.940640 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ec01f-af42-4907-92c0-942690fed910 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:53.940925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ec01f-af42-4907-92c0-942690fed910 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:53.941229 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ec01f-af42-4907-92c0-942690fed910 None admin] PATH_INFO: `/v3/projects/dbe071067d79437b8969c9883cc256df` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:53.943622 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ec01f-af42-4907-92c0-942690fed910 None admin] RBAC: Authorizing `identity:get_project(project_id=dbe071067d79437b8969c9883cc256df)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:53.945713 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9e1cd-ce69-494f-a04a-4fbba137baba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:53.946326 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9e1cd-ce69-494f-a04a-4fbba137baba None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:53.946633 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9e1cd-ce69-494f-a04a-4fbba137baba None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:53.946909 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9e1cd-ce69-494f-a04a-4fbba137baba None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:53.947582 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb9e1cd-ce69-494f-a04a-4fbba137baba None admin] RBAC: Adding query filter params (name=member) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:53.947888 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb9e1cd-ce69-494f-a04a-4fbba137baba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:53.949285 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb9e1cd-ce69-494f-a04a-4fbba137baba None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:53.950709 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ec01f-af42-4907-92c0-942690fed910 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:53.952462 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 88/169] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:31:53 2022] GET /identity/v3/projects/dbe071067d79437b8969c9883cc256df => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:53.953295 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ec01f-af42-4907-92c0-942690fed910 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:53.968404 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 82/170] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 8 17:31:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:53.969261 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9e1cd-ce69-494f-a04a-4fbba137baba None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:54.041601 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:54.137737 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9e1cd-ce69-494f-a04a-4fbba137baba None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:54.155237 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ec01f-af42-4907-92c0-942690fed910 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:54.189674 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72653e2a-a78a-4841-8b1c-00476a32d396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:54.190665 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72653e2a-a78a-4841-8b1c-00476a32d396 None admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:54.191168 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72653e2a-a78a-4841-8b1c-00476a32d396 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:54.191588 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72653e2a-a78a-4841-8b1c-00476a32d396 None admin] PATH_INFO: `/v3/projects/dbe071067d79437b8969c9883cc256df/users/e186c97892074e0fbccec1ab89d7e033/roles/ff9689d3969d49a19db320a3514ddb56` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:54.193797 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72653e2a-a78a-4841-8b1c-00476a32d396 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbe071067d79437b8969c9883cc256df, user_id=e186c97892074e0fbccec1ab89d7e033, role_id=ff9689d3969d49a19db320a3514ddb56)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:54.195390 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72653e2a-a78a-4841-8b1c-00476a32d396 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:54.207273 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83ec8c-5ce5-401c-b188-d72aabf09c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:54.208187 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83ec8c-5ce5-401c-b188-d72aabf09c89 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:54.208642 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83ec8c-5ce5-401c-b188-d72aabf09c89 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:54.209129 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83ec8c-5ce5-401c-b188-d72aabf09c89 None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:54.209949 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83ec8c-5ce5-401c-b188-d72aabf09c89 None admin] RBAC: Adding query filter params (name=member) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:54.217527 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83ec8c-5ce5-401c-b188-d72aabf09c89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:54.217527 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83ec8c-5ce5-401c-b188-d72aabf09c89 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:54.222748 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 89/171] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 8 17:31:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:54.223907 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83ec8c-5ce5-401c-b188-d72aabf09c89 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:54.250020 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:54.268546 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 83/172] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 8 17:31:53 2022] PUT /identity/v3/projects/dbe071067d79437b8969c9883cc256df/users/e186c97892074e0fbccec1ab89d7e033/roles/ff9689d3969d49a19db320a3514ddb56 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:31:54.269792 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72653e2a-a78a-4841-8b1c-00476a32d396 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:54.370774 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83ec8c-5ce5-401c-b188-d72aabf09c89 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:54.412239 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b144a6-e6e9-4508-b8a1-91a196ab4b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:54.414401 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b144a6-e6e9-4508-b8a1-91a196ab4b69 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:54.414401 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b144a6-e6e9-4508-b8a1-91a196ab4b69 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:54.414561 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b144a6-e6e9-4508-b8a1-91a196ab4b69 None admin] PATH_INFO: `/v3/users/b6be772778914724a2fb0603b4f3373c` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:54.416845 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b144a6-e6e9-4508-b8a1-91a196ab4b69 None admin] RBAC: Authorizing `identity:get_user(user_id=b6be772778914724a2fb0603b4f3373c)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:54.418833 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b144a6-e6e9-4508-b8a1-91a196ab4b69 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:54.421064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 90/173] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:31:54 2022] GET /identity/v3/users/b6be772778914724a2fb0603b4f3373c => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:54.427577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b144a6-e6e9-4508-b8a1-91a196ab4b69 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:54.520671 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:54.531340 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72653e2a-a78a-4841-8b1c-00476a32d396 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:54.578608 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:54.598575 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b144a6-e6e9-4508-b8a1-91a196ab4b69 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:54.604770 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366f215-01cc-4e3a-bca0-c0b7ea557295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:54.605835 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366f215-01cc-4e3a-bca0-c0b7ea557295 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:54.606317 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366f215-01cc-4e3a-bca0-c0b7ea557295 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:54.606805 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366f215-01cc-4e3a-bca0-c0b7ea557295 None admin] PATH_INFO: `/v3/users/b6be772778914724a2fb0603b4f3373c` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:54.613935 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5366f215-01cc-4e3a-bca0-c0b7ea557295 None admin] RBAC: Authorizing `identity:get_user(user_id=b6be772778914724a2fb0603b4f3373c)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:54.615780 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5366f215-01cc-4e3a-bca0-c0b7ea557295 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:54.617871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 84/174] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:31:54 2022] GET /identity/v3/users/b6be772778914724a2fb0603b4f3373c => generated 275 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:54.624700 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366f215-01cc-4e3a-bca0-c0b7ea557295 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:54.656957 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1144cd5-da72-452f-b3a2-e0ed9d8006df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:54.657611 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1144cd5-da72-452f-b3a2-e0ed9d8006df None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:54.657896 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1144cd5-da72-452f-b3a2-e0ed9d8006df None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:54.658172 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1144cd5-da72-452f-b3a2-e0ed9d8006df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:54.760961 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1144cd5-da72-452f-b3a2-e0ed9d8006df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:54.762621 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1144cd5-da72-452f-b3a2-e0ed9d8006df None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:54.774302 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366f215-01cc-4e3a-bca0-c0b7ea557295 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:54.819452 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a307930-7f26-4ec9-b51b-5094965cba86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:54.820069 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a307930-7f26-4ec9-b51b-5094965cba86 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:54.820347 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a307930-7f26-4ec9-b51b-5094965cba86 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:54.820621 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a307930-7f26-4ec9-b51b-5094965cba86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:54.856811 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:54.919266 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:54.938219 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a307930-7f26-4ec9-b51b-5094965cba86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:54.939832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a307930-7f26-4ec9-b51b-5094965cba86 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:54.945589 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 91/175] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:31:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:31:54.947290 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07aa52-a0e4-48e4-964a-e614bd654391 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:54.947867 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07aa52-a0e4-48e4-964a-e614bd654391 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:54.948354 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07aa52-a0e4-48e4-964a-e614bd654391 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:54.949856 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 92/176] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:31:54.951092 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a873e0-e64b-43d8-a4d1-849529ffca36 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:54.951579 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a873e0-e64b-43d8-a4d1-849529ffca36 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:54.952063 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a873e0-e64b-43d8-a4d1-849529ffca36 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:54.954235 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 93/177] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:31:54.958982 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a873e0-e64b-43d8-a4d1-849529ffca36 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:55.054968 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 85/178] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:31:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:31:55.057077 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa8715-cc3c-49a9-a01d-445ed70380b5 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:55.057392 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa8715-cc3c-49a9-a01d-445ed70380b5 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:55.057670 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa8715-cc3c-49a9-a01d-445ed70380b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:55.076205 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-71aa8715-cc3c-49a9-a01d-445ed70380b5 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:55.077460 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-71aa8715-cc3c-49a9-a01d-445ed70380b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:55.086259 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a873e0-e64b-43d8-a4d1-849529ffca36 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:55.122657 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44194643-5eb3-4c8f-9fb5-07b1208dfad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:55.123298 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44194643-5eb3-4c8f-9fb5-07b1208dfad2 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:55.123576 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44194643-5eb3-4c8f-9fb5-07b1208dfad2 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:55.123870 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44194643-5eb3-4c8f-9fb5-07b1208dfad2 None admin] PATH_INFO: `/v3/projects/dbe071067d79437b8969c9883cc256df` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:55.124995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44194643-5eb3-4c8f-9fb5-07b1208dfad2 None admin] RBAC: Authorizing `identity:get_project(project_id=dbe071067d79437b8969c9883cc256df)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:55.126476 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44194643-5eb3-4c8f-9fb5-07b1208dfad2 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:55.133497 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 94/179] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:31:54 2022] GET /identity/v3/projects/dbe071067d79437b8969c9883cc256df => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:55.133497 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6961d-4bab-474f-b551-ea61a1a66713 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:55.133497 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6961d-4bab-474f-b551-ea61a1a66713 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:55.133497 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6961d-4bab-474f-b551-ea61a1a66713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:55.146705 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:55.149466 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-e0c6961d-4bab-474f-b551-ea61a1a66713 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:55.151082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-e0c6961d-4bab-474f-b551-ea61a1a66713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:55.155178 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 86/180] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:31:55.156316 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec7af2-99ec-44ca-8990-80c7f20e4fbd None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:55.156604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec7af2-99ec-44ca-8990-80c7f20e4fbd None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:55.158085 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec7af2-99ec-44ca-8990-80c7f20e4fbd None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:55.158195 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 87/181] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:31:55.162906 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec7af2-99ec-44ca-8990-80c7f20e4fbd None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:55.208314 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:55.227163 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 95/182] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:31:55.237171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6961d-4bab-474f-b551-ea61a1a66713 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:55.279406 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec7af2-99ec-44ca-8990-80c7f20e4fbd None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:55.316452 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b5ab3-10e7-46f1-840f-80aef899bf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:55.316999 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b5ab3-10e7-46f1-840f-80aef899bf8c None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:55.317308 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b5ab3-10e7-46f1-840f-80aef899bf8c None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:55.317985 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b5ab3-10e7-46f1-840f-80aef899bf8c None admin] PATH_INFO: `/v3/projects/373e66d0f6cf44aea2f2ab47596d2137` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:55.319110 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b5ab3-10e7-46f1-840f-80aef899bf8c None admin] RBAC: Authorizing `identity:get_project(project_id=373e66d0f6cf44aea2f2ab47596d2137)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:55.321280 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b5ab3-10e7-46f1-840f-80aef899bf8c None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:55.323069 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 88/183] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:31:55 2022] GET /identity/v3/projects/373e66d0f6cf44aea2f2ab47596d2137 => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:55.324178 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b5de9-cd7c-4abd-8553-c6a5743febca None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:55.324459 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b5de9-cd7c-4abd-8553-c6a5743febca None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:55.324730 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b5de9-cd7c-4abd-8553-c6a5743febca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:55.342965 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-930b5de9-cd7c-4abd-8553-c6a5743febca None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:55.344159 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-930b5de9-cd7c-4abd-8553-c6a5743febca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:55.349319 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6961d-4bab-474f-b551-ea61a1a66713 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:55.385053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329467df-51a6-487e-ba1d-a5d4ae9f726a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:55.386462 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329467df-51a6-487e-ba1d-a5d4ae9f726a None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:55.386761 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329467df-51a6-487e-ba1d-a5d4ae9f726a None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:55.387039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329467df-51a6-487e-ba1d-a5d4ae9f726a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:55.387776 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329467df-51a6-487e-ba1d-a5d4ae9f726a None admin] RBAC: Adding query filter params (role.id=adc45cdd4c9543b3b8b24141870f4b11, scope.project.id=dbe071067d79437b8969c9883cc256df, user.id=b6be772778914724a2fb0603b4f3373c) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:55.388091 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329467df-51a6-487e-ba1d-a5d4ae9f726a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:55.391977 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329467df-51a6-487e-ba1d-a5d4ae9f726a None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:55.401187 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 96/184] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:31:55 2022] GET /identity/v3/role_assignments?user.id=b6be772778914724a2fb0603b4f3373c&scope.project.id=dbe071067d79437b8969c9883cc256df&role.id=adc45cdd4c9543b3b8b24141870f4b11 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:55.402108 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329467df-51a6-487e-ba1d-a5d4ae9f726a None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:55.425218 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:55.439463 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 89/185] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:31:55.441360 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b5de9-cd7c-4abd-8553-c6a5743febca None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:55.465742 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:55.532049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329467df-51a6-487e-ba1d-a5d4ae9f726a None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:55.583039 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b5de9-cd7c-4abd-8553-c6a5743febca None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:55.583230 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93540392-e11c-4b25-a98f-d3daf8121e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:55.583892 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93540392-e11c-4b25-a98f-d3daf8121e2f None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:55.584302 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93540392-e11c-4b25-a98f-d3daf8121e2f None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:55.584674 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93540392-e11c-4b25-a98f-d3daf8121e2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:55.596992 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93540392-e11c-4b25-a98f-d3daf8121e2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:31:55.602861 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-93540392-e11c-4b25-a98f-d3daf8121e2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:31:55.602861 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:31:55.602861 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:31:55.602861 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:31:55.602861 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:31:55.602861 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:31:55.602861 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:31:55.602861 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:31:55.602861 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:31:55.602861 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:31:55.602861 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:31:55.602861 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:31:55.602861 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:31:55.602861 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:31:55.602861 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:31:55.602861 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:31:55.603951 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:31:55.603951 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:31:55.603951 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:31:55.603951 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:31:55.603951 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:31:55.603951 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:31:55.603951 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:31:55.603951 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:31:55.603951 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:31:55.603951 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:31:55.603951 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:31:55.603951 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:31:55.603951 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:31:55.603951 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:31:55.603951 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:31:55.603951 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:31:55.604828 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:31:55.604828 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:31:55.604828 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:31:55.604828 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:31:55.604828 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:31:55.604828 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:31:55.604828 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:31:55.604828 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:31:55.604828 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:31:55.604828 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:31:55.604828 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:31:55.604828 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:31:55.609198 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 97/186] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 8 17:31:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:31:55.610116 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93540392-e11c-4b25-a98f-d3daf8121e2f None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:55.636155 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c1763-1b5e-4201-95d5-3e36854444c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:55.636797 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c1763-1b5e-4201-95d5-3e36854444c1 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:55.637548 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c1763-1b5e-4201-95d5-3e36854444c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:55.637831 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c1763-1b5e-4201-95d5-3e36854444c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:55.639055 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c1763-1b5e-4201-95d5-3e36854444c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:55.640505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c1763-1b5e-4201-95d5-3e36854444c1 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:55.642691 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 90/187] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:31:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:55.643086 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c1763-1b5e-4201-95d5-3e36854444c1 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:55.719830 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:55.737062 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93540392-e11c-4b25-a98f-d3daf8121e2f None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:55.748136 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:55.763296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c1763-1b5e-4201-95d5-3e36854444c1 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:55.773573 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10910b1f-1e4c-4a54-87dc-0cd145849f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:55.774208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10910b1f-1e4c-4a54-87dc-0cd145849f49 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:55.775045 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10910b1f-1e4c-4a54-87dc-0cd145849f49 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:55.775338 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10910b1f-1e4c-4a54-87dc-0cd145849f49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:55.776092 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10910b1f-1e4c-4a54-87dc-0cd145849f49 None admin] RBAC: Adding query filter params (role.id=adc45cdd4c9543b3b8b24141870f4b11, scope.project.id=373e66d0f6cf44aea2f2ab47596d2137, user.id=b6be772778914724a2fb0603b4f3373c) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:55.776405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10910b1f-1e4c-4a54-87dc-0cd145849f49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:55.777924 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10910b1f-1e4c-4a54-87dc-0cd145849f49 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:55.789064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 98/188] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:31:55 2022] GET /identity/v3/role_assignments?user.id=b6be772778914724a2fb0603b4f3373c&scope.project.id=373e66d0f6cf44aea2f2ab47596d2137&role.id=adc45cdd4c9543b3b8b24141870f4b11 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:55.789064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10910b1f-1e4c-4a54-87dc-0cd145849f49 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:55.809511 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16751534-5399-4795-ae98-a3b4cd35958d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:55.810250 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16751534-5399-4795-ae98-a3b4cd35958d None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:55.810784 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16751534-5399-4795-ae98-a3b4cd35958d None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:55.811125 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16751534-5399-4795-ae98-a3b4cd35958d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:55.828656 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16751534-5399-4795-ae98-a3b4cd35958d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:31:55.834031 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-16751534-5399-4795-ae98-a3b4cd35958d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 17:31:55.834031 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:31:55.834031 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:31:55.834031 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:31:55.834031 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:31:55.834031 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:31:55.834031 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:31:55.834031 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:31:55.834031 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:31:55.834031 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:31:55.834031 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:31:55.834031 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:31:55.834031 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:31:55.834031 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:31:55.834031 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:31:55.834031 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:31:55.834964 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:31:55.834964 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:31:55.834964 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:31:55.834964 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:31:55.834964 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:31:55.834964 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:31:55.834964 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:31:55.834964 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:31:55.834964 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:31:55.834964 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:31:55.834964 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:31:55.834964 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:31:55.834964 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:31:55.834964 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:31:55.834964 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:31:55.834964 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:31:55.841191 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:31:55.841191 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:31:55.841191 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:31:55.841191 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:31:55.841191 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:31:55.841191 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:31:55.841191 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:31:55.841191 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:31:55.841191 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:31:55.841191 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:31:55.841191 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 17:31:55.841191 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:31:55.841191 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 91/189] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 8 17:31:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:31:55.841191 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16751534-5399-4795-ae98-a3b4cd35958d None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:55.934285 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10910b1f-1e4c-4a54-87dc-0cd145849f49 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:55.955377 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16751534-5399-4795-ae98-a3b4cd35958d None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:55.980390 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0b0f9-3ffe-4169-be2c-2198294a7f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:55.980584 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:55.981006 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0b0f9-3ffe-4169-be2c-2198294a7f59 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:55.981576 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0b0f9-3ffe-4169-be2c-2198294a7f59 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:55.981576 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0b0f9-3ffe-4169-be2c-2198294a7f59 None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:55.982258 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0b0f9-3ffe-4169-be2c-2198294a7f59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:55.982572 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0b0f9-3ffe-4169-be2c-2198294a7f59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:55.983928 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0b0f9-3ffe-4169-be2c-2198294a7f59 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:55.995231 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 99/190] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:31:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:55.999847 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0b0f9-3ffe-4169-be2c-2198294a7f59 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:56.003091 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c3cb1-ed58-432a-bd19-5e98ad19358a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:56.003091 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c3cb1-ed58-432a-bd19-5e98ad19358a None admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:56.003311 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c3cb1-ed58-432a-bd19-5e98ad19358a None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:56.003502 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c3cb1-ed58-432a-bd19-5e98ad19358a None admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:56.004140 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c3cb1-ed58-432a-bd19-5e98ad19358a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:56.005945 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c3cb1-ed58-432a-bd19-5e98ad19358a None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:56.042559 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:56.101125 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 92/191] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Aug 8 17:31:55 2022] POST /identity/v3/users => generated 297 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:31:56.101125 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c3cb1-ed58-432a-bd19-5e98ad19358a None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:56.130604 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0b0f9-3ffe-4169-be2c-2198294a7f59 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:56.174071 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de61cb9-365f-49e9-874c-f4b5083c572c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:56.174862 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de61cb9-365f-49e9-874c-f4b5083c572c None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:56.175151 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de61cb9-365f-49e9-874c-f4b5083c572c None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:56.175591 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de61cb9-365f-49e9-874c-f4b5083c572c None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:56.176332 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de61cb9-365f-49e9-874c-f4b5083c572c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:56.176643 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de61cb9-365f-49e9-874c-f4b5083c572c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:56.178256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de61cb9-365f-49e9-874c-f4b5083c572c None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:56.193096 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 100/192] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:31:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:56.195553 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de61cb9-365f-49e9-874c-f4b5083c572c None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:56.243058 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c3cb1-ed58-432a-bd19-5e98ad19358a None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:56.285974 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4799d4-5beb-47b4-b575-3a819cde172e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:56.286661 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4799d4-5beb-47b4-b575-3a819cde172e None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:56.286942 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4799d4-5beb-47b4-b575-3a819cde172e None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:56.287215 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4799d4-5beb-47b4-b575-3a819cde172e None admin] PATH_INFO: `/v3/users/52916f62fadb499cab4fabbfd6f1a33e` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:56.306321 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4799d4-5beb-47b4-b575-3a819cde172e None admin] RBAC: Authorizing `identity:get_user(user_id=52916f62fadb499cab4fabbfd6f1a33e)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:56.307950 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4799d4-5beb-47b4-b575-3a819cde172e None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:56.311785 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 93/193] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:31:56 2022] GET /identity/v3/users/52916f62fadb499cab4fabbfd6f1a33e => generated 283 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:56.318225 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4799d4-5beb-47b4-b575-3a819cde172e None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:56.343839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:56.350487 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de61cb9-365f-49e9-874c-f4b5083c572c None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:56.361263 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:56.399251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea2f43-6cb8-4477-a65e-a003f5d5166a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:56.400458 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea2f43-6cb8-4477-a65e-a003f5d5166a None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:56.400762 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea2f43-6cb8-4477-a65e-a003f5d5166a None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:56.401095 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea2f43-6cb8-4477-a65e-a003f5d5166a None admin] PATH_INFO: `/v3/users/52916f62fadb499cab4fabbfd6f1a33e` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:56.402616 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea2f43-6cb8-4477-a65e-a003f5d5166a None admin] RBAC: Authorizing `identity:get_user(user_id=52916f62fadb499cab4fabbfd6f1a33e)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:56.404448 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea2f43-6cb8-4477-a65e-a003f5d5166a None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:56.406006 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 101/194] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:31:56 2022] GET /identity/v3/users/52916f62fadb499cab4fabbfd6f1a33e => generated 283 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:31:56.412571 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea2f43-6cb8-4477-a65e-a003f5d5166a None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:56.474932 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4799d4-5beb-47b4-b575-3a819cde172e None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:56.514727 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd711545-5b90-4d74-8105-20b0d507f60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:56.515462 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd711545-5b90-4d74-8105-20b0d507f60e None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:56.515747 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd711545-5b90-4d74-8105-20b0d507f60e None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:56.516022 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd711545-5b90-4d74-8105-20b0d507f60e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:56.546567 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea2f43-6cb8-4477-a65e-a003f5d5166a None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:56.592023 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da321a-5580-4b34-91e4-17cafcc3da2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:56.592968 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da321a-5580-4b34-91e4-17cafcc3da2d None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:56.593664 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da321a-5580-4b34-91e4-17cafcc3da2d None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:56.594128 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da321a-5580-4b34-91e4-17cafcc3da2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:56.596735 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd711545-5b90-4d74-8105-20b0d507f60e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:56.598366 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd711545-5b90-4d74-8105-20b0d507f60e None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:56.636854 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:56.639129 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:56.688474 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da321a-5580-4b34-91e4-17cafcc3da2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:56.690360 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da321a-5580-4b34-91e4-17cafcc3da2d None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:56.725086 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 94/195] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:31:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 08 17:31:56.730227 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd711545-5b90-4d74-8105-20b0d507f60e None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:56.851292 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 102/196] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:31:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:31:56.853825 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3c2bf-d49b-4c45-9e56-662dbe1386bb None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:56.854114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3c2bf-d49b-4c45-9e56-662dbe1386bb None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:56.854382 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3c2bf-d49b-4c45-9e56-662dbe1386bb None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:56.855660 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 103/197] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:31:56.856665 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd711545-5b90-4d74-8105-20b0d507f60e None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:56.860529 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3c2bf-d49b-4c45-9e56-662dbe1386bb None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:56.899192 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f8516-dd04-4af5-b4e1-597443069901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:56.900252 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f8516-dd04-4af5-b4e1-597443069901 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:56.900677 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f8516-dd04-4af5-b4e1-597443069901 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:56.901152 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f8516-dd04-4af5-b4e1-597443069901 None admin] PATH_INFO: `/v3/projects/91b9959e38d042f2a5aa8e5757e79251` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:56.902545 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f8516-dd04-4af5-b4e1-597443069901 None admin] RBAC: Authorizing `identity:get_project(project_id=91b9959e38d042f2a5aa8e5757e79251)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:56.904249 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f8516-dd04-4af5-b4e1-597443069901 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:56.906154 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 95/198] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:31:56 2022] GET /identity/v3/projects/91b9959e38d042f2a5aa8e5757e79251 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:56.907420 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fc635-d6e1-48ed-9f99-7ae220780d31 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:56.907868 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fc635-d6e1-48ed-9f99-7ae220780d31 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:56.908305 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fc635-d6e1-48ed-9f99-7ae220780d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:56.918478 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:56.931679 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-0a9fc635-d6e1-48ed-9f99-7ae220780d31 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:56.933217 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-0a9fc635-d6e1-48ed-9f99-7ae220780d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:56.938821 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:56.980733 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3c2bf-d49b-4c45-9e56-662dbe1386bb None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:57.007442 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 96/199] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:31:57.009417 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9fc635-d6e1-48ed-9f99-7ae220780d31 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:57.035139 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e36290-4395-4da8-ae36-7e0b4c60a4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:57.035784 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e36290-4395-4da8-ae36-7e0b4c60a4df None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:57.036068 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e36290-4395-4da8-ae36-7e0b4c60a4df None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:57.036345 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e36290-4395-4da8-ae36-7e0b4c60a4df None admin] PATH_INFO: `/v3/projects/91b9959e38d042f2a5aa8e5757e79251` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:57.037593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e36290-4395-4da8-ae36-7e0b4c60a4df None admin] RBAC: Authorizing `identity:get_project(project_id=91b9959e38d042f2a5aa8e5757e79251)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:57.039174 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e36290-4395-4da8-ae36-7e0b4c60a4df None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:57.049850 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 104/200] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:31:56 2022] GET /identity/v3/projects/91b9959e38d042f2a5aa8e5757e79251 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:57.051042 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e36290-4395-4da8-ae36-7e0b4c60a4df None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:57.126129 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9fc635-d6e1-48ed-9f99-7ae220780d31 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:57.158151 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:57.163221 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e36290-4395-4da8-ae36-7e0b4c60a4df None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:57.163724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed04b9c-bc5b-4658-b6a6-88d0d21719cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:57.164576 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed04b9c-bc5b-4658-b6a6-88d0d21719cd None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:57.165245 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed04b9c-bc5b-4658-b6a6-88d0d21719cd None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:57.169960 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed04b9c-bc5b-4658-b6a6-88d0d21719cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:57.169960 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed04b9c-bc5b-4658-b6a6-88d0d21719cd None admin] RBAC: Adding query filter params (role.id=5c25aa917ab34baabb795c54dd8a4d02, scope.project.id=91b9959e38d042f2a5aa8e5757e79251, user.id=52916f62fadb499cab4fabbfd6f1a33e) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:57.169960 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed04b9c-bc5b-4658-b6a6-88d0d21719cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:57.169960 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed04b9c-bc5b-4658-b6a6-88d0d21719cd None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:57.175043 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 97/201] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:31:57 2022] GET /identity/v3/role_assignments?user.id=52916f62fadb499cab4fabbfd6f1a33e&scope.project.id=91b9959e38d042f2a5aa8e5757e79251&role.id=5c25aa917ab34baabb795c54dd8a4d02 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:57.176073 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed04b9c-bc5b-4658-b6a6-88d0d21719cd None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:57.229671 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:57.243057 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b815d-5b8c-4d4c-b2a8-a93d712c98b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:57.244748 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b815d-5b8c-4d4c-b2a8-a93d712c98b0 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:57.245147 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b815d-5b8c-4d4c-b2a8-a93d712c98b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:57.245691 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b815d-5b8c-4d4c-b2a8-a93d712c98b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:57.246672 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b815d-5b8c-4d4c-b2a8-a93d712c98b0 None admin] RBAC: Adding query filter params (role.id=0ff11803573b472ab020a59b7f452dcd, scope.project.id=91b9959e38d042f2a5aa8e5757e79251, user.id=52916f62fadb499cab4fabbfd6f1a33e) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:57.247160 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b815d-5b8c-4d4c-b2a8-a93d712c98b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:57.251054 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b815d-5b8c-4d4c-b2a8-a93d712c98b0 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:57.264597 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 105/202] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:31:57 2022] GET /identity/v3/role_assignments?user.id=52916f62fadb499cab4fabbfd6f1a33e&scope.project.id=91b9959e38d042f2a5aa8e5757e79251&role.id=0ff11803573b472ab020a59b7f452dcd => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:31:57.339926 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed04b9c-bc5b-4658-b6a6-88d0d21719cd None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:57.384471 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57aeb90-484a-4394-aef7-8ee5e55d6c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:57.385197 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57aeb90-484a-4394-aef7-8ee5e55d6c21 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:57.385500 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57aeb90-484a-4394-aef7-8ee5e55d6c21 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:57.385780 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57aeb90-484a-4394-aef7-8ee5e55d6c21 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:57.398198 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57aeb90-484a-4394-aef7-8ee5e55d6c21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:31:57.403993 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-b57aeb90-484a-4394-aef7-8ee5e55d6c21 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 17:31:57.403993 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:31:57.403993 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:31:57.403993 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:31:57.403993 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:31:57.403993 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:31:57.403993 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:31:57.403993 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:31:57.403993 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:31:57.403993 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:31:57.403993 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:31:57.403993 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:31:57.403993 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:31:57.403993 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:31:57.403993 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:31:57.403993 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:31:57.405252 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:31:57.405252 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:31:57.405252 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:31:57.405252 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:31:57.405252 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:31:57.405252 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:31:57.405252 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:31:57.405252 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:31:57.405252 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:31:57.405252 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:31:57.405252 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:31:57.405252 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:31:57.405252 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:31:57.405252 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:31:57.405252 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:31:57.405252 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:31:57.406053 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:31:57.406053 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:31:57.406053 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:31:57.406053 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:31:57.406053 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:31:57.406053 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:31:57.406053 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:31:57.406053 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:31:57.406053 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:31:57.406053 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:31:57.406053 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 17:31:57.406053 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:31:57.406053 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 98/203] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:31:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:31:57.413547 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b815d-5b8c-4d4c-b2a8-a93d712c98b0 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:57.527079 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b815d-5b8c-4d4c-b2a8-a93d712c98b0 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:57.571148 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37765af2-6842-4316-8c92-3a1994e83d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:57.572765 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37765af2-6842-4316-8c92-3a1994e83d58 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:57.573316 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37765af2-6842-4316-8c92-3a1994e83d58 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:57.573788 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37765af2-6842-4316-8c92-3a1994e83d58 None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:57.574650 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37765af2-6842-4316-8c92-3a1994e83d58 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:57.575151 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37765af2-6842-4316-8c92-3a1994e83d58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:57.576753 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37765af2-6842-4316-8c92-3a1994e83d58 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:57.585956 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 106/204] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 8 17:31:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:57.592535 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57aeb90-484a-4394-aef7-8ee5e55d6c21 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:57.686890 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:57.742471 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57aeb90-484a-4394-aef7-8ee5e55d6c21 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:57.787035 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd298e-6751-40c2-942b-b946b01124b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:57.787672 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd298e-6751-40c2-942b-b946b01124b9 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:57.787951 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd298e-6751-40c2-942b-b946b01124b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:57.788224 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd298e-6751-40c2-942b-b946b01124b9 None admin] PATH_INFO: `/v3/users/e186c97892074e0fbccec1ab89d7e033` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:57.789401 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd298e-6751-40c2-942b-b946b01124b9 None admin] RBAC: Authorizing `identity:get_user(user_id=e186c97892074e0fbccec1ab89d7e033)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:57.791406 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd298e-6751-40c2-942b-b946b01124b9 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:57.793007 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 99/205] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:31:57 2022] GET /identity/v3/users/e186c97892074e0fbccec1ab89d7e033 => generated 289 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:57.798743 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37765af2-6842-4316-8c92-3a1994e83d58 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:57.893694 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:57.948000 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37765af2-6842-4316-8c92-3a1994e83d58 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:57.999028 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c102c-6e27-44fa-b92c-7dcfa3f3b943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:57.999646 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c102c-6e27-44fa-b92c-7dcfa3f3b943 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:57.999929 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c102c-6e27-44fa-b92c-7dcfa3f3b943 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:58.000202 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c102c-6e27-44fa-b92c-7dcfa3f3b943 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:58.086018 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c102c-6e27-44fa-b92c-7dcfa3f3b943 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:58.087705 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c102c-6e27-44fa-b92c-7dcfa3f3b943 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:58.166582 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:58.221812 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 107/206] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:31:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:31:58.227168 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd298e-6751-40c2-942b-b946b01124b9 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:58.387859 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd298e-6751-40c2-942b-b946b01124b9 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:58.420228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:58.435074 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235200bb-c2b1-45c9-89fe-d811841264cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:58.435710 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235200bb-c2b1-45c9-89fe-d811841264cb None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:58.435988 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235200bb-c2b1-45c9-89fe-d811841264cb None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:58.441009 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235200bb-c2b1-45c9-89fe-d811841264cb None admin] PATH_INFO: `/v3/projects/dbe071067d79437b8969c9883cc256df` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:58.441009 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235200bb-c2b1-45c9-89fe-d811841264cb None admin] RBAC: Authorizing `identity:get_project(project_id=dbe071067d79437b8969c9883cc256df)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:58.441009 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235200bb-c2b1-45c9-89fe-d811841264cb None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:58.441009 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 100/207] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:31:58 2022] GET /identity/v3/projects/dbe071067d79437b8969c9883cc256df => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:58.446546 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c102c-6e27-44fa-b92c-7dcfa3f3b943 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:58.601123 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c102c-6e27-44fa-b92c-7dcfa3f3b943 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:58.641869 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd451c6-e479-4ee7-9378-c3c5df029f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:58.642875 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd451c6-e479-4ee7-9378-c3c5df029f0f None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:58.643351 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd451c6-e479-4ee7-9378-c3c5df029f0f None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:58.643819 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd451c6-e479-4ee7-9378-c3c5df029f0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:58.644727 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd451c6-e479-4ee7-9378-c3c5df029f0f None admin] RBAC: Adding query filter params (role.id=ff9689d3969d49a19db320a3514ddb56, scope.project.id=dbe071067d79437b8969c9883cc256df, user.id=e186c97892074e0fbccec1ab89d7e033) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:58.645256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd451c6-e479-4ee7-9378-c3c5df029f0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:58.646895 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd451c6-e479-4ee7-9378-c3c5df029f0f None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:58.654222 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 108/208] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:31:58 2022] GET /identity/v3/role_assignments?user.id=e186c97892074e0fbccec1ab89d7e033&scope.project.id=dbe071067d79437b8969c9883cc256df&role.id=ff9689d3969d49a19db320a3514ddb56 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:31:58.699282 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8da34a-423d-420f-9703-8376019781fd None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:58.699620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8da34a-423d-420f-9703-8376019781fd None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:58.699833 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8da34a-423d-420f-9703-8376019781fd None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:58.701472 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 101/209] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:31:58.707556 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336a85d-74d7-4e18-959f-0f02628c7b5b None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:58.707837 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336a85d-74d7-4e18-959f-0f02628c7b5b None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:58.708110 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336a85d-74d7-4e18-959f-0f02628c7b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:58.730655 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-c336a85d-74d7-4e18-959f-0f02628c7b5b None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:58.731063 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-c336a85d-74d7-4e18-959f-0f02628c7b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:58.750270 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:58.808073 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 109/210] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 17:31:58.831915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8da34a-423d-420f-9703-8376019781fd None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:58.945352 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c42272-b9a9-4251-9b73-247d7bfefb50 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:58.945708 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c42272-b9a9-4251-9b73-247d7bfefb50 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:58.945901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c42272-b9a9-4251-9b73-247d7bfefb50 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:58.948490 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 110/211] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 17:31:58.954372 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d6bde-638c-4e0f-81f2-e120668845d2 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:58.954653 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d6bde-638c-4e0f-81f2-e120668845d2 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:58.954754 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8da34a-423d-420f-9703-8376019781fd None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:58.954937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d6bde-638c-4e0f-81f2-e120668845d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:58.976520 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-1d4d6bde-638c-4e0f-81f2-e120668845d2 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:58.978274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-1d4d6bde-638c-4e0f-81f2-e120668845d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:58.997233 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c317f44-932a-409b-b596-64669effc783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:58.997889 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c317f44-932a-409b-b596-64669effc783 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:58.998165 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c317f44-932a-409b-b596-64669effc783 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:58.998620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c317f44-932a-409b-b596-64669effc783 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:59.014757 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c317f44-932a-409b-b596-64669effc783 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:31:59.020883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-4c317f44-932a-409b-b596-64669effc783 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 17:31:59.020883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:31:59.020883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:31:59.020883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:31:59.020883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:31:59.020883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:31:59.020883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:31:59.020883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:31:59.020883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:31:59.020883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:31:59.020883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:31:59.020883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:31:59.020883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:31:59.020883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:31:59.020883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:31:59.020883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:31:59.021849 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:31:59.021849 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:31:59.021849 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:31:59.021849 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:31:59.021849 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:31:59.021849 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:31:59.021849 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:31:59.021849 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:31:59.021849 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:31:59.021849 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:31:59.021849 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:31:59.021849 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:31:59.021849 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:31:59.021849 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:31:59.021849 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:31:59.021849 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:31:59.022682 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:31:59.022682 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:31:59.022682 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:31:59.022682 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:31:59.022682 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:31:59.022682 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:31:59.022682 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:31:59.022682 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:31:59.022682 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:31:59.022682 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:31:59.022682 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 17:31:59.022682 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:31:59.022682 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 102/212] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:31:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:31:59.031409 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c317f44-932a-409b-b596-64669effc783 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:59.071907 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 111/213] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:31:59.096922 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:59.097267 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d6bde-638c-4e0f-81f2-e120668845d2 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:59.159078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c317f44-932a-409b-b596-64669effc783 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:59.197736 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:59.207349 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51072f-04d2-42ae-a40c-ed2c227ffadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:59.207963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51072f-04d2-42ae-a40c-ed2c227ffadc None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:59.208240 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51072f-04d2-42ae-a40c-ed2c227ffadc None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:59.208507 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51072f-04d2-42ae-a40c-ed2c227ffadc None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:59.209385 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51072f-04d2-42ae-a40c-ed2c227ffadc None admin] RBAC: Adding query filter params (name=member) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:31:59.209695 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51072f-04d2-42ae-a40c-ed2c227ffadc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:59.211183 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51072f-04d2-42ae-a40c-ed2c227ffadc None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:59.216760 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d6bde-638c-4e0f-81f2-e120668845d2 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:59.222539 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 103/214] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 8 17:31:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:31:59.227619 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51072f-04d2-42ae-a40c-ed2c227ffadc None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:59.267001 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d3e75-f55c-4b62-90df-5ff50405a29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:59.267888 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d3e75-f55c-4b62-90df-5ff50405a29f None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:59.268171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d3e75-f55c-4b62-90df-5ff50405a29f None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:59.268491 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d3e75-f55c-4b62-90df-5ff50405a29f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:59.270217 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d3e75-f55c-4b62-90df-5ff50405a29f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:59.271677 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d3e75-f55c-4b62-90df-5ff50405a29f None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:59.279557 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 112/215] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:31:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:31:59.281556 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d3e75-f55c-4b62-90df-5ff50405a29f None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:59.363278 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51072f-04d2-42ae-a40c-ed2c227ffadc None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:59.381746 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:59.393546 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d3e75-f55c-4b62-90df-5ff50405a29f None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:59.408964 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700afdf-140f-4357-9e7b-f779d1a63497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:59.409952 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700afdf-140f-4357-9e7b-f779d1a63497 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:59.410246 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700afdf-140f-4357-9e7b-f779d1a63497 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:59.410523 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700afdf-140f-4357-9e7b-f779d1a63497 None admin] PATH_INFO: `/v3/users/e21d639051b7423aa1994ab744f67f2d` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:59.429299 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700afdf-140f-4357-9e7b-f779d1a63497 None admin] RBAC: Authorizing `identity:get_user(user_id=e21d639051b7423aa1994ab744f67f2d)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:59.432259 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700afdf-140f-4357-9e7b-f779d1a63497 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:59.434290 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 104/216] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:31:59 2022] GET /identity/v3/users/e21d639051b7423aa1994ab744f67f2d => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:31:59.439924 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700afdf-140f-4357-9e7b-f779d1a63497 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:59.445302 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f937f-bad4-4f51-896a-12e12e82ac9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:59.446382 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f937f-bad4-4f51-896a-12e12e82ac9d None admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:59.446894 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f937f-bad4-4f51-896a-12e12e82ac9d None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:59.447407 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f937f-bad4-4f51-896a-12e12e82ac9d None admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:59.448329 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f937f-bad4-4f51-896a-12e12e82ac9d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:59.450021 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f937f-bad4-4f51-896a-12e12e82ac9d None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:59.550749 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700afdf-140f-4357-9e7b-f779d1a63497 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:59.560577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 113/217] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Aug 8 17:31:59 2022] POST /identity/v3/users => generated 297 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:31:59.598448 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada389a1-7387-4437-8ad3-a4f3eb7b25fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:31:59.599483 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada389a1-7387-4437-8ad3-a4f3eb7b25fc None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:59.599982 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada389a1-7387-4437-8ad3-a4f3eb7b25fc None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:59.600449 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada389a1-7387-4437-8ad3-a4f3eb7b25fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:59.652251 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:59.682352 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd876327-23b3-4f05-92d3-00c706a2e29c None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:59.683226 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd876327-23b3-4f05-92d3-00c706a2e29c None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:59.683823 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd876327-23b3-4f05-92d3-00c706a2e29c None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:59.684512 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada389a1-7387-4437-8ad3-a4f3eb7b25fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:31:59.686291 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 114/218] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:31:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 17:31:59.687057 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada389a1-7387-4437-8ad3-a4f3eb7b25fc None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:31:59.692570 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1131e2-1bf0-4a61-8acf-3b2e5ca2a073 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:31:59.692881 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1131e2-1bf0-4a61-8acf-3b2e5ca2a073 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:31:59.693219 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1131e2-1bf0-4a61-8acf-3b2e5ca2a073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:31:59.711800 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:59.719043 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-cd1131e2-1bf0-4a61-8acf-3b2e5ca2a073 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:31:59.720603 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-cd1131e2-1bf0-4a61-8acf-3b2e5ca2a073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:31:59.807516 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 115/219] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:31:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 17:31:59.821219 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 105/220] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:31:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:31:59.827111 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1131e2-1bf0-4a61-8acf-3b2e5ca2a073 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:59.833572 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada389a1-7387-4437-8ad3-a4f3eb7b25fc None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:31:59.928004 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:31:59.957513 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1131e2-1bf0-4a61-8acf-3b2e5ca2a073 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:31:59.964462 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada389a1-7387-4437-8ad3-a4f3eb7b25fc None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:00.003613 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740cc6cd-4ad1-44ac-b091-fd0f6932b300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:00.004254 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740cc6cd-4ad1-44ac-b091-fd0f6932b300 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:00.004479 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131d0cf-ee2a-47a0-93f1-eed18247a5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:00.004629 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740cc6cd-4ad1-44ac-b091-fd0f6932b300 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:00.004790 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740cc6cd-4ad1-44ac-b091-fd0f6932b300 None admin] PATH_INFO: `/v3/projects/91b9959e38d042f2a5aa8e5757e79251` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:00.005150 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131d0cf-ee2a-47a0-93f1-eed18247a5ff None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:00.005433 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131d0cf-ee2a-47a0-93f1-eed18247a5ff None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:00.005707 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131d0cf-ee2a-47a0-93f1-eed18247a5ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:00.005997 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740cc6cd-4ad1-44ac-b091-fd0f6932b300 None admin] RBAC: Authorizing `identity:get_project(project_id=91b9959e38d042f2a5aa8e5757e79251)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:00.007456 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740cc6cd-4ad1-44ac-b091-fd0f6932b300 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:00.009283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 116/221] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:31:59 2022] GET /identity/v3/projects/91b9959e38d042f2a5aa8e5757e79251 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:32:00.010448 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1a7fe-7457-4e33-b8b2-8ef8cea357fa None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:00.010730 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1a7fe-7457-4e33-b8b2-8ef8cea357fa None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:00.011005 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1a7fe-7457-4e33-b8b2-8ef8cea357fa None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:00.013069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 117/222] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:00.017299 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1a7fe-7457-4e33-b8b2-8ef8cea357fa None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:00.020654 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c131d0cf-ee2a-47a0-93f1-eed18247a5ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:00.022105 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:00.026664 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-c131d0cf-ee2a-47a0-93f1-eed18247a5ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 17:32:00.026664 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:00.026664 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:00.026664 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:00.026664 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:00.026664 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:00.026664 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:00.026664 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:00.026664 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:00.026664 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:00.026664 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:00.026664 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:00.026664 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:00.026664 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:00.026664 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:00.026664 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:00.027587 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:00.027587 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:00.027587 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:00.027587 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:00.027587 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:00.027587 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:00.027587 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:00.027587 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:00.027587 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:00.027587 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:00.027587 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:00.027587 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:00.027587 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:00.027587 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:00.027587 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:00.027587 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:00.028762 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:00.028762 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:00.028762 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:00.028762 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:00.028762 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:00.028762 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:00.028762 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:00.028762 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:00.028762 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:00.028762 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:00.028762 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 17:32:00.028762 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:00.028762 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 106/223] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 8 17:31:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:00.033646 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa403455-55a3-44a2-b653-0b0130c0cf53 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:00.033646 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa403455-55a3-44a2-b653-0b0130c0cf53 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:00.033770 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa403455-55a3-44a2-b653-0b0130c0cf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:00.056645 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-aa403455-55a3-44a2-b653-0b0130c0cf53 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:00.057889 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-aa403455-55a3-44a2-b653-0b0130c0cf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:00.130907 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 107/224] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:00.131890 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa403455-55a3-44a2-b653-0b0130c0cf53 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:00.138254 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1a7fe-7457-4e33-b8b2-8ef8cea357fa None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:00.173240 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aebb17-ef8c-41e5-8a79-888c5248aa28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:00.173858 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aebb17-ef8c-41e5-8a79-888c5248aa28 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:00.174150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aebb17-ef8c-41e5-8a79-888c5248aa28 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:00.174426 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aebb17-ef8c-41e5-8a79-888c5248aa28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:00.175156 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aebb17-ef8c-41e5-8a79-888c5248aa28 None admin] RBAC: Adding query filter params (role.id=adc45cdd4c9543b3b8b24141870f4b11, scope.project.id=91b9959e38d042f2a5aa8e5757e79251, user.id=e21d639051b7423aa1994ab744f67f2d) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:00.175461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aebb17-ef8c-41e5-8a79-888c5248aa28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:00.176902 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aebb17-ef8c-41e5-8a79-888c5248aa28 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:00.183635 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 118/225] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:32:00 2022] GET /identity/v3/role_assignments?user.id=e21d639051b7423aa1994ab744f67f2d&scope.project.id=91b9959e38d042f2a5aa8e5757e79251&role.id=adc45cdd4c9543b3b8b24141870f4b11 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:00.184707 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aebb17-ef8c-41e5-8a79-888c5248aa28 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:00.199772 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:00.257491 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:00.273410 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa403455-55a3-44a2-b653-0b0130c0cf53 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:00.293965 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aebb17-ef8c-41e5-8a79-888c5248aa28 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:00.324239 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03ae66-8c56-4e15-a135-671861ede899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:00.324859 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03ae66-8c56-4e15-a135-671861ede899 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:00.325217 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03ae66-8c56-4e15-a135-671861ede899 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:00.325497 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03ae66-8c56-4e15-a135-671861ede899 None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:00.326180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f03ae66-8c56-4e15-a135-671861ede899 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:00.326535 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f03ae66-8c56-4e15-a135-671861ede899 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:00.327965 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f03ae66-8c56-4e15-a135-671861ede899 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:00.337182 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 108/226] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:32:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:00.343021 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03ae66-8c56-4e15-a135-671861ede899 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:00.361091 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3dada-79a1-4f98-b3bc-f7121543bf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:00.362117 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3dada-79a1-4f98-b3bc-f7121543bf7a None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:00.362885 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3dada-79a1-4f98-b3bc-f7121543bf7a None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:00.363399 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3dada-79a1-4f98-b3bc-f7121543bf7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:00.397731 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3dada-79a1-4f98-b3bc-f7121543bf7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:00.403629 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-7fb3dada-79a1-4f98-b3bc-f7121543bf7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:32:00.403629 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:00.403629 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:00.403629 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:00.403629 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:00.403629 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:00.403629 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:00.403629 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:00.403629 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:00.403629 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:00.403629 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:00.403629 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:00.403629 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:00.403629 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:00.403629 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:00.403629 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:00.404610 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:00.404610 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:00.404610 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:00.404610 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:00.404610 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:00.404610 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:00.404610 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:00.404610 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:00.404610 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:00.404610 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:00.404610 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:00.404610 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:00.404610 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:00.404610 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:00.404610 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:00.404610 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:00.405460 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:00.405460 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:00.405460 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:00.405460 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:00.405460 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:00.405460 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:00.405460 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:00.405460 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:00.405460 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:00.405460 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:00.405460 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:32:00.405460 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:00.416554 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 119/227] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 8 17:32:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:00.418633 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3dada-79a1-4f98-b3bc-f7121543bf7a None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:00.467298 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03ae66-8c56-4e15-a135-671861ede899 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:00.493973 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:00.516153 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5ab1c-1c5e-49ba-b090-aee7d9f91b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:00.516821 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5ab1c-1c5e-49ba-b090-aee7d9f91b4d None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:00.517131 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5ab1c-1c5e-49ba-b090-aee7d9f91b4d None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:00.517403 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5ab1c-1c5e-49ba-b090-aee7d9f91b4d None admin] PATH_INFO: `/v3/users/52916f62fadb499cab4fabbfd6f1a33e` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:00.518565 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce5ab1c-1c5e-49ba-b090-aee7d9f91b4d None admin] RBAC: Authorizing `identity:get_user(user_id=52916f62fadb499cab4fabbfd6f1a33e)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:00.520012 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce5ab1c-1c5e-49ba-b090-aee7d9f91b4d None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:00.521633 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 109/228] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:32:00 2022] GET /identity/v3/users/52916f62fadb499cab4fabbfd6f1a33e => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:32:00.531780 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5ab1c-1c5e-49ba-b090-aee7d9f91b4d None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:00.635834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3dada-79a1-4f98-b3bc-f7121543bf7a None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:00.685423 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:00.699084 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4644df-9d14-46ea-9fc6-678683b75ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:00.699709 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4644df-9d14-46ea-9fc6-678683b75ff9 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:00.706526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4644df-9d14-46ea-9fc6-678683b75ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:00.706526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4644df-9d14-46ea-9fc6-678683b75ff9 None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:00.706526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4644df-9d14-46ea-9fc6-678683b75ff9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:00.706526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4644df-9d14-46ea-9fc6-678683b75ff9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:00.706526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4644df-9d14-46ea-9fc6-678683b75ff9 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:00.719331 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5ab1c-1c5e-49ba-b090-aee7d9f91b4d None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:00.722586 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 120/229] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:32:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:00.728169 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4644df-9d14-46ea-9fc6-678683b75ff9 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:00.818467 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e977c73-5a58-46d8-909a-c7ea27e3ed86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:00.819464 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e977c73-5a58-46d8-909a-c7ea27e3ed86 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:00.820046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e977c73-5a58-46d8-909a-c7ea27e3ed86 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:00.820523 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e977c73-5a58-46d8-909a-c7ea27e3ed86 None admin] PATH_INFO: `/v3/projects/91b9959e38d042f2a5aa8e5757e79251` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:00.825755 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e977c73-5a58-46d8-909a-c7ea27e3ed86 None admin] RBAC: Authorizing `identity:get_project(project_id=91b9959e38d042f2a5aa8e5757e79251)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:00.827457 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e977c73-5a58-46d8-909a-c7ea27e3ed86 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:00.829389 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 110/230] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:32:00 2022] GET /identity/v3/projects/91b9959e38d042f2a5aa8e5757e79251 => generated 302 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:00.838217 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e977c73-5a58-46d8-909a-c7ea27e3ed86 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:00.845719 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4644df-9d14-46ea-9fc6-678683b75ff9 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:00.884664 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59cbb2-b521-48e8-8ecb-4c1477c5e5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:00.885384 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59cbb2-b521-48e8-8ecb-4c1477c5e5c5 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:00.885664 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59cbb2-b521-48e8-8ecb-4c1477c5e5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:00.886097 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59cbb2-b521-48e8-8ecb-4c1477c5e5c5 None admin] PATH_INFO: `/v3/users/52916f62fadb499cab4fabbfd6f1a33e` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:00.887297 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59cbb2-b521-48e8-8ecb-4c1477c5e5c5 None admin] RBAC: Authorizing `identity:get_user(user_id=52916f62fadb499cab4fabbfd6f1a33e)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:00.888756 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59cbb2-b521-48e8-8ecb-4c1477c5e5c5 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:00.890789 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 121/231] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:32:00 2022] GET /identity/v3/users/52916f62fadb499cab4fabbfd6f1a33e => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:00.898844 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59cbb2-b521-48e8-8ecb-4c1477c5e5c5 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:00.961424 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:01.010657 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:01.045149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e977c73-5a58-46d8-909a-c7ea27e3ed86 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:01.096602 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59cbb2-b521-48e8-8ecb-4c1477c5e5c5 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:01.106802 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f45cf-fa89-413c-b971-985c25f6d58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:01.107479 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f45cf-fa89-413c-b971-985c25f6d58b None admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:01.107761 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f45cf-fa89-413c-b971-985c25f6d58b None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:01.108040 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f45cf-fa89-413c-b971-985c25f6d58b None admin] PATH_INFO: `/v3/projects/91b9959e38d042f2a5aa8e5757e79251/users/52916f62fadb499cab4fabbfd6f1a33e/roles/0ff11803573b472ab020a59b7f452dcd` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:01.110346 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f45cf-fa89-413c-b971-985c25f6d58b None admin] RBAC: Authorizing `identity:create_grant(project_id=91b9959e38d042f2a5aa8e5757e79251, user_id=52916f62fadb499cab4fabbfd6f1a33e, role_id=0ff11803573b472ab020a59b7f452dcd)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:01.111800 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f45cf-fa89-413c-b971-985c25f6d58b None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:01.146589 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18d7f0-7a8b-414f-84d9-3825a0dfe59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:01.147354 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18d7f0-7a8b-414f-84d9-3825a0dfe59b None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:01.147771 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18d7f0-7a8b-414f-84d9-3825a0dfe59b None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:01.148036 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18d7f0-7a8b-414f-84d9-3825a0dfe59b None admin] PATH_INFO: `/v3/projects/91b9959e38d042f2a5aa8e5757e79251` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:01.149449 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18d7f0-7a8b-414f-84d9-3825a0dfe59b None admin] RBAC: Authorizing `identity:get_project(project_id=91b9959e38d042f2a5aa8e5757e79251)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:01.150999 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18d7f0-7a8b-414f-84d9-3825a0dfe59b None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:01.153262 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 122/232] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:32:00 2022] GET /identity/v3/projects/91b9959e38d042f2a5aa8e5757e79251 => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:01.159056 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18d7f0-7a8b-414f-84d9-3825a0dfe59b None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:01.188867 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 111/233] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 8 17:32:00 2022] PUT /identity/v3/projects/91b9959e38d042f2a5aa8e5757e79251/users/52916f62fadb499cab4fabbfd6f1a33e/roles/0ff11803573b472ab020a59b7f452dcd => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:32:01.298624 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18d7f0-7a8b-414f-84d9-3825a0dfe59b None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:01.328834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:01.339040 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500a8e0-b199-4815-9efa-ff4158230e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:01.339721 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500a8e0-b199-4815-9efa-ff4158230e55 None admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:01.340005 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500a8e0-b199-4815-9efa-ff4158230e55 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:01.340281 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500a8e0-b199-4815-9efa-ff4158230e55 None admin] PATH_INFO: `/v3/projects/91b9959e38d042f2a5aa8e5757e79251/users/52916f62fadb499cab4fabbfd6f1a33e/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:01.342532 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500a8e0-b199-4815-9efa-ff4158230e55 None admin] RBAC: Authorizing `identity:create_grant(project_id=91b9959e38d042f2a5aa8e5757e79251, user_id=52916f62fadb499cab4fabbfd6f1a33e, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:01.344056 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500a8e0-b199-4815-9efa-ff4158230e55 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:01.445745 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 123/234] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 8 17:32:01 2022] PUT /identity/v3/projects/91b9959e38d042f2a5aa8e5757e79251/users/52916f62fadb499cab4fabbfd6f1a33e/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:32:02.094241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8937ed9-5527-41c5-be25-46d512799fbc None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:02.094933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8937ed9-5527-41c5-be25-46d512799fbc None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:02.094933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8937ed9-5527-41c5-be25-46d512799fbc None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:02.096427 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 112/235] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:02.101928 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b77952-f3ba-4f8c-a29f-2bfcfe28158e None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:02.103025 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b77952-f3ba-4f8c-a29f-2bfcfe28158e None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:02.103181 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b77952-f3ba-4f8c-a29f-2bfcfe28158e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:02.121641 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-d9b77952-f3ba-4f8c-a29f-2bfcfe28158e None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:02.122857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-d9b77952-f3ba-4f8c-a29f-2bfcfe28158e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:02.141006 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7a654-ab09-4b87-bd8d-187b136044f9 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:02.142094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7a654-ab09-4b87-bd8d-187b136044f9 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:02.142877 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7a654-ab09-4b87-bd8d-187b136044f9 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:02.144871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 113/236] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:02.152013 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cef25c-3a0b-4401-a555-1ff00d1be08a None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:02.153139 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cef25c-3a0b-4401-a555-1ff00d1be08a None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:02.153624 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cef25c-3a0b-4401-a555-1ff00d1be08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:02.176589 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-f5cef25c-3a0b-4401-a555-1ff00d1be08a None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:02.178316 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-f5cef25c-3a0b-4401-a555-1ff00d1be08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:02.251914 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 124/237] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:02.259592 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 114/238] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 17:32:02.283500 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b77952-f3ba-4f8c-a29f-2bfcfe28158e None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:02.294784 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cef25c-3a0b-4401-a555-1ff00d1be08a None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:02.397496 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:02.444131 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b77952-f3ba-4f8c-a29f-2bfcfe28158e None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:02.445144 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cef25c-3a0b-4401-a555-1ff00d1be08a None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:02.462586 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:02.480479 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded03612-f293-4af1-8256-6ea1b164b03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:02.481153 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded03612-f293-4af1-8256-6ea1b164b03f None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:02.481461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded03612-f293-4af1-8256-6ea1b164b03f None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:02.481705 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded03612-f293-4af1-8256-6ea1b164b03f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:02.482829 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded03612-f293-4af1-8256-6ea1b164b03f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:02.483531 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b73ea-1584-4313-88f2-6dacd80d3a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:02.484275 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded03612-f293-4af1-8256-6ea1b164b03f None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:02.484857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b73ea-1584-4313-88f2-6dacd80d3a27 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:02.485389 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b73ea-1584-4313-88f2-6dacd80d3a27 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:02.485865 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b73ea-1584-4313-88f2-6dacd80d3a27 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:02.485979 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 115/239] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:02.491957 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded03612-f293-4af1-8256-6ea1b164b03f None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:02.499722 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b73ea-1584-4313-88f2-6dacd80d3a27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:02.504834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-6a2b73ea-1584-4313-88f2-6dacd80d3a27 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 17:32:02.504834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:02.504834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:02.504834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:02.504834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:02.504834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:02.504834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:02.504834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:02.504834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:02.504834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:02.504834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:02.504834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:02.504834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:02.504834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:02.504834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:02.504834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:02.505916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:02.505916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:02.505916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:02.505916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:02.505916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:02.505916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:02.505916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:02.505916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:02.505916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:02.505916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:02.505916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:02.505916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:02.505916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:02.505916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:02.505916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:02.505916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:02.506733 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:02.506733 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:02.506733 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:02.506733 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:02.506733 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:02.506733 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:02.506733 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:02.506733 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:02.506733 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:02.506733 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:02.506733 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 17:32:02.506733 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:02.509566 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 125/240] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:32:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:02.515485 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b73ea-1584-4313-88f2-6dacd80d3a27 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:02.597363 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded03612-f293-4af1-8256-6ea1b164b03f None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:02.621872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:02.638738 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b2582-5d94-49cc-8340-f3d1451f64e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:02.639361 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b2582-5d94-49cc-8340-f3d1451f64e8 None admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:02.639635 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b2582-5d94-49cc-8340-f3d1451f64e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:02.639907 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b2582-5d94-49cc-8340-f3d1451f64e8 None admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:02.640562 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b2582-5d94-49cc-8340-f3d1451f64e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:02.646056 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b2582-5d94-49cc-8340-f3d1451f64e8 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:02.672175 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b73ea-1584-4313-88f2-6dacd80d3a27 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:02.709142 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41388310-1881-4a35-b516-88b87c4c5339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:02.709757 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41388310-1881-4a35-b516-88b87c4c5339 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:02.710041 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41388310-1881-4a35-b516-88b87c4c5339 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:02.710311 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41388310-1881-4a35-b516-88b87c4c5339 None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:02.710975 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41388310-1881-4a35-b516-88b87c4c5339 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:02.711277 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41388310-1881-4a35-b516-88b87c4c5339 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:02.713378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41388310-1881-4a35-b516-88b87c4c5339 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:02.722078 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 126/241] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 8 17:32:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:32:02.723607 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95b233-3db6-47c6-8bdd-9d971f21d1ca None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:02.723607 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95b233-3db6-47c6-8bdd-9d971f21d1ca None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:02.723860 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95b233-3db6-47c6-8bdd-9d971f21d1ca None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:02.725041 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 127/242] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:02.730304 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95b233-3db6-47c6-8bdd-9d971f21d1ca None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:02.777373 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:02.793070 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 116/243] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Aug 8 17:32:02 2022] POST /identity/v3/users => generated 293 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:32:02.793070 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2125a-a432-4c63-87d2-ea14f7d0fea7 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:02.793070 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2125a-a432-4c63-87d2-ea14f7d0fea7 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:02.793070 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2125a-a432-4c63-87d2-ea14f7d0fea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:02.822602 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-22f2125a-a432-4c63-87d2-ea14f7d0fea7 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:02.823878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-22f2125a-a432-4c63-87d2-ea14f7d0fea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:02.864019 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95b233-3db6-47c6-8bdd-9d971f21d1ca None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:02.906208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c222d0-a70d-49ec-9026-785845d613c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:02.907362 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c222d0-a70d-49ec-9026-785845d613c6 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:02.907845 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c222d0-a70d-49ec-9026-785845d613c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:02.908319 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c222d0-a70d-49ec-9026-785845d613c6 None admin] PATH_INFO: `/v3/users/790fc3f7deed423aa6c4ff8200b84f16` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:02.926110 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c222d0-a70d-49ec-9026-785845d613c6 None admin] RBAC: Authorizing `identity:get_user(user_id=790fc3f7deed423aa6c4ff8200b84f16)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:02.927974 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c222d0-a70d-49ec-9026-785845d613c6 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:02.930529 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 128/244] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:32:02 2022] GET /identity/v3/users/790fc3f7deed423aa6c4ff8200b84f16 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:32:02.938813 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c222d0-a70d-49ec-9026-785845d613c6 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:03.006093 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 117/245] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:03.035981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2125a-a432-4c63-87d2-ea14f7d0fea7 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:03.081591 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:03.126170 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c222d0-a70d-49ec-9026-785845d613c6 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:03.132441 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d722d-9016-4ee6-87e7-cec3ba96811a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:03.133444 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d722d-9016-4ee6-87e7-cec3ba96811a None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:03.133874 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d722d-9016-4ee6-87e7-cec3ba96811a None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:03.134342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d722d-9016-4ee6-87e7-cec3ba96811a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:03.168980 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2125a-a432-4c63-87d2-ea14f7d0fea7 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:03.171769 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:03.208672 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917cb6c9-80a6-4a53-8f25-02aef00074b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:03.209698 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cb6c9-80a6-4a53-8f25-02aef00074b6 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:03.209891 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cb6c9-80a6-4a53-8f25-02aef00074b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:03.210260 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cb6c9-80a6-4a53-8f25-02aef00074b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:03.212833 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d722d-9016-4ee6-87e7-cec3ba96811a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:03.214569 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d722d-9016-4ee6-87e7-cec3ba96811a None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:03.221958 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917cb6c9-80a6-4a53-8f25-02aef00074b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:03.227144 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-917cb6c9-80a6-4a53-8f25-02aef00074b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 17:32:03.227144 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:03.227144 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:03.227144 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:03.227144 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:03.227144 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:03.227144 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:03.227144 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:03.227144 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:03.227144 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:03.227144 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:03.227144 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:03.227144 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:03.227144 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:03.227144 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:03.227144 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:03.228334 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:03.228334 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:03.228334 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:03.228334 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:03.228334 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:03.228334 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:03.228334 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:03.228334 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:03.228334 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:03.228334 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:03.228334 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:03.228334 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:03.228334 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:03.228334 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:03.228334 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:03.228334 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:03.229374 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:03.229374 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:03.229374 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:03.229374 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:03.229374 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:03.229374 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:03.229374 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:03.229374 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:03.229374 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:03.229374 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:03.229374 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 17:32:03.229374 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:03.234968 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 118/246] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:32:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:32:03.237565 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917cb6c9-80a6-4a53-8f25-02aef00074b6 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:03.321243 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:03.328094 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 129/247] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:32:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:03.333785 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d722d-9016-4ee6-87e7-cec3ba96811a None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:03.350309 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917cb6c9-80a6-4a53-8f25-02aef00074b6 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:03.390626 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679bbe49-83c1-4774-a264-f42206a5f1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:03.391581 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bbe49-83c1-4774-a264-f42206a5f1dd None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:03.392058 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bbe49-83c1-4774-a264-f42206a5f1dd None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:03.392530 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bbe49-83c1-4774-a264-f42206a5f1dd None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:03.393544 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679bbe49-83c1-4774-a264-f42206a5f1dd None admin] RBAC: Adding query filter params (name=member) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:03.394075 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679bbe49-83c1-4774-a264-f42206a5f1dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:03.395667 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679bbe49-83c1-4774-a264-f42206a5f1dd None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:03.411474 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 119/248] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 8 17:32:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:32:03.413105 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679bbe49-83c1-4774-a264-f42206a5f1dd None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:03.450397 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d722d-9016-4ee6-87e7-cec3ba96811a None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:03.469518 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:03.491689 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b78fba-9dd6-4c91-9950-a1aa77ea112a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:03.492335 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b78fba-9dd6-4c91-9950-a1aa77ea112a None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:03.497964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b78fba-9dd6-4c91-9950-a1aa77ea112a None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:03.497964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b78fba-9dd6-4c91-9950-a1aa77ea112a None admin] PATH_INFO: `/v3/projects/91b9959e38d042f2a5aa8e5757e79251` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:03.497964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b78fba-9dd6-4c91-9950-a1aa77ea112a None admin] RBAC: Authorizing `identity:get_project(project_id=91b9959e38d042f2a5aa8e5757e79251)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:03.497964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b78fba-9dd6-4c91-9950-a1aa77ea112a None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:03.498692 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 130/249] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:32:03 2022] GET /identity/v3/projects/91b9959e38d042f2a5aa8e5757e79251 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:03.504424 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b78fba-9dd6-4c91-9950-a1aa77ea112a None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:03.529337 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679bbe49-83c1-4774-a264-f42206a5f1dd None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:03.567850 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb1d46-55a4-4dfa-a00e-1536248f0935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:03.568957 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb1d46-55a4-4dfa-a00e-1536248f0935 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:03.569490 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb1d46-55a4-4dfa-a00e-1536248f0935 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:03.569966 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb1d46-55a4-4dfa-a00e-1536248f0935 None admin] PATH_INFO: `/v3/users/e21d639051b7423aa1994ab744f67f2d` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:03.571856 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb1d46-55a4-4dfa-a00e-1536248f0935 None admin] RBAC: Authorizing `identity:get_user(user_id=e21d639051b7423aa1994ab744f67f2d)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:03.573686 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb1d46-55a4-4dfa-a00e-1536248f0935 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:03.575616 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 120/250] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:32:03 2022] GET /identity/v3/users/e21d639051b7423aa1994ab744f67f2d => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:03.580848 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:03.582600 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb1d46-55a4-4dfa-a00e-1536248f0935 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:03.619910 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b78fba-9dd6-4c91-9950-a1aa77ea112a None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:03.667737 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d3759-14dc-4b65-862e-c29f3703b14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:03.668424 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d3759-14dc-4b65-862e-c29f3703b14d None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:03.668704 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d3759-14dc-4b65-862e-c29f3703b14d None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:03.668976 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d3759-14dc-4b65-862e-c29f3703b14d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:03.669786 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d3759-14dc-4b65-862e-c29f3703b14d None admin] RBAC: Adding query filter params (role.id=ff9689d3969d49a19db320a3514ddb56, scope.project.id=91b9959e38d042f2a5aa8e5757e79251, user.id=790fc3f7deed423aa6c4ff8200b84f16) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:03.670098 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d3759-14dc-4b65-862e-c29f3703b14d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:03.671817 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d3759-14dc-4b65-862e-c29f3703b14d None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:03.679055 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 131/251] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:32:03 2022] GET /identity/v3/role_assignments?user.id=790fc3f7deed423aa6c4ff8200b84f16&scope.project.id=91b9959e38d042f2a5aa8e5757e79251&role.id=ff9689d3969d49a19db320a3514ddb56 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:32:03.697440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:03.705594 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb1d46-55a4-4dfa-a00e-1536248f0935 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:03.744798 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32272b71-8f9f-451b-a2b9-1e1a84da246b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:03.745565 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32272b71-8f9f-451b-a2b9-1e1a84da246b None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:03.745852 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32272b71-8f9f-451b-a2b9-1e1a84da246b None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:03.746127 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32272b71-8f9f-451b-a2b9-1e1a84da246b None admin] PATH_INFO: `/v3/projects/91b9959e38d042f2a5aa8e5757e79251` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:03.747421 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32272b71-8f9f-451b-a2b9-1e1a84da246b None admin] RBAC: Authorizing `identity:get_project(project_id=91b9959e38d042f2a5aa8e5757e79251)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:03.748918 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32272b71-8f9f-451b-a2b9-1e1a84da246b None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:03.750663 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 121/252] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:32:03 2022] GET /identity/v3/projects/91b9959e38d042f2a5aa8e5757e79251 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:32:03.757005 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d3759-14dc-4b65-862e-c29f3703b14d None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:03.784211 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847b6dd-752d-4200-935a-ad4de0a1845b None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:03.784562 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847b6dd-752d-4200-935a-ad4de0a1845b None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:03.784757 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847b6dd-752d-4200-935a-ad4de0a1845b None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:03.786446 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 122/253] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 17:32:03.792087 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a38230-3a0c-4709-abbd-dc3ccec2d70d None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:03.792481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a38230-3a0c-4709-abbd-dc3ccec2d70d None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:03.792759 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a38230-3a0c-4709-abbd-dc3ccec2d70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:03.813796 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-07a38230-3a0c-4709-abbd-dc3ccec2d70d None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:03.815186 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-07a38230-3a0c-4709-abbd-dc3ccec2d70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:03.902642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 123/254] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 17:32:03.938131 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a38230-3a0c-4709-abbd-dc3ccec2d70d None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:03.951615 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d3759-14dc-4b65-862e-c29f3703b14d None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:04.020678 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:04.036768 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483525c-f145-4c83-a365-1dc619a6280b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:04.037872 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483525c-f145-4c83-a365-1dc619a6280b None admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:04.038287 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483525c-f145-4c83-a365-1dc619a6280b None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:04.040710 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483525c-f145-4c83-a365-1dc619a6280b None admin] PATH_INFO: `/v3/projects/91b9959e38d042f2a5aa8e5757e79251/users/e21d639051b7423aa1994ab744f67f2d/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:04.042614 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483525c-f145-4c83-a365-1dc619a6280b None admin] RBAC: Authorizing `identity:create_grant(project_id=91b9959e38d042f2a5aa8e5757e79251, user_id=e21d639051b7423aa1994ab744f67f2d, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:04.044150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483525c-f145-4c83-a365-1dc619a6280b None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:04.110584 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:04.120455 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a38230-3a0c-4709-abbd-dc3ccec2d70d None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:04.135818 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 132/255] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 8 17:32:03 2022] PUT /identity/v3/projects/91b9959e38d042f2a5aa8e5757e79251/users/e21d639051b7423aa1994ab744f67f2d/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:32:04.143067 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77d2ca-b260-45d8-bb24-4f2e11a8722a None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:04.143411 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77d2ca-b260-45d8-bb24-4f2e11a8722a None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:04.143691 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77d2ca-b260-45d8-bb24-4f2e11a8722a None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:04.145437 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 133/256] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:04 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:04.157277 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c69f9-5110-4735-ad53-496f0ff93796 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:04.157604 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c69f9-5110-4735-ad53-496f0ff93796 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:04.157835 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c69f9-5110-4735-ad53-496f0ff93796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:04.178400 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ba0fe-d72f-43db-b766-142a876b6de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:04.179085 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ba0fe-d72f-43db-b766-142a876b6de3 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:04.179372 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ba0fe-d72f-43db-b766-142a876b6de3 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:04.179651 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ba0fe-d72f-43db-b766-142a876b6de3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:04.198158 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-866c69f9-5110-4735-ad53-496f0ff93796 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:04.199383 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-866c69f9-5110-4735-ad53-496f0ff93796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:04.207878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ba0fe-d72f-43db-b766-142a876b6de3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:04.213528 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-dc5ba0fe-d72f-43db-b766-142a876b6de3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 17:32:04.213528 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:04.213528 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:04.213528 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:04.213528 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:04.213528 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:04.213528 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:04.213528 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:04.213528 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:04.213528 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:04.213528 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:04.213528 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:04.213528 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:04.213528 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:04.213528 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:04.213528 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:04.214480 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:04.214480 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:04.214480 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:04.214480 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:04.214480 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:04.214480 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:04.214480 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:04.214480 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:04.214480 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:04.214480 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:04.214480 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:04.214480 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:04.214480 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:04.214480 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:04.214480 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:04.214480 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:04.215296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:04.215296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:04.215296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:04.215296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:04.215296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:04.215296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:04.215296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:04.215296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:04.215296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:04.215296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:04.215296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 17:32:04.215296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:04.216761 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 124/257] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 8 17:32:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:32:04.222075 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ba0fe-d72f-43db-b766-142a876b6de3 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:04.382178 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 134/258] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:04.387330 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ba0fe-d72f-43db-b766-142a876b6de3 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:04.426648 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c69f9-5110-4735-ad53-496f0ff93796 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:04.437458 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc08167-ab55-4774-9a07-d8dea5e22151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:04.438074 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc08167-ab55-4774-9a07-d8dea5e22151 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:04.438356 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc08167-ab55-4774-9a07-d8dea5e22151 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:04.438628 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc08167-ab55-4774-9a07-d8dea5e22151 None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:04.439297 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc08167-ab55-4774-9a07-d8dea5e22151 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:04.439596 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc08167-ab55-4774-9a07-d8dea5e22151 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:04.440993 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc08167-ab55-4774-9a07-d8dea5e22151 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:04.454344 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 125/259] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:32:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:04.459842 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc08167-ab55-4774-9a07-d8dea5e22151 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:04.479815 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:04.564764 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c69f9-5110-4735-ad53-496f0ff93796 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:04.572561 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc08167-ab55-4774-9a07-d8dea5e22151 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:04.588093 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:04.609707 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bb3a1-ea23-4c72-aef1-3c0910c8438e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:04.610928 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bb3a1-ea23-4c72-aef1-3c0910c8438e None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:04.611529 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bb3a1-ea23-4c72-aef1-3c0910c8438e None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:04.612249 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce78d9d-6753-4449-843f-1417c359b79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:04.612379 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bb3a1-ea23-4c72-aef1-3c0910c8438e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:04.613973 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce78d9d-6753-4449-843f-1417c359b79f None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:04.614455 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce78d9d-6753-4449-843f-1417c359b79f None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:04.614911 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce78d9d-6753-4449-843f-1417c359b79f None admin] PATH_INFO: `/v3/users/52916f62fadb499cab4fabbfd6f1a33e` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:04.618680 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce78d9d-6753-4449-843f-1417c359b79f None admin] RBAC: Authorizing `identity:get_user(user_id=52916f62fadb499cab4fabbfd6f1a33e)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:04.622501 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce78d9d-6753-4449-843f-1417c359b79f None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:04.627859 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 126/260] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:32:04 2022] GET /identity/v3/users/52916f62fadb499cab4fabbfd6f1a33e => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:04.634076 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce78d9d-6753-4449-843f-1417c359b79f None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:04.647506 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1bb3a1-ea23-4c72-aef1-3c0910c8438e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:04.655327 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-3d1bb3a1-ea23-4c72-aef1-3c0910c8438e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:32:04.655327 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:04.655327 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:04.655327 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:04.655327 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:04.655327 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:04.655327 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:04.655327 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:04.655327 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:04.655327 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:04.655327 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:04.655327 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:04.655327 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:04.655327 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:04.655327 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:04.655327 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:04.656257 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:04.656257 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:04.656257 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:04.656257 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:04.656257 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:04.656257 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:04.656257 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:04.656257 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:04.656257 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:04.656257 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:04.656257 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:04.656257 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:04.656257 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:04.656257 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:04.656257 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:04.656257 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:04.657102 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:04.657102 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:04.657102 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:04.657102 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:04.657102 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:04.657102 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:04.657102 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:04.657102 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:04.657102 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:04.657102 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:04.657102 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:32:04.657102 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:04.665015 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 135/261] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 8 17:32:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:32:04.676294 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bb3a1-ea23-4c72-aef1-3c0910c8438e None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:04.817389 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:04.821731 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bb3a1-ea23-4c72-aef1-3c0910c8438e None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:04.853355 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce78d9d-6753-4449-843f-1417c359b79f None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:04.859975 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6a870-f4c7-4834-af0a-bf83d8eca6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:04.860594 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6a870-f4c7-4834-af0a-bf83d8eca6b1 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:04.860876 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6a870-f4c7-4834-af0a-bf83d8eca6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:04.861178 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6a870-f4c7-4834-af0a-bf83d8eca6b1 None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:04.862893 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6a870-f4c7-4834-af0a-bf83d8eca6b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:04.863200 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6a870-f4c7-4834-af0a-bf83d8eca6b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:04.864577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6a870-f4c7-4834-af0a-bf83d8eca6b1 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:04.886355 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 136/262] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:32:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:04.892836 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6a870-f4c7-4834-af0a-bf83d8eca6b1 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:04.938756 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c418105-8406-4fde-a100-00a6fdfc4020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:04.940640 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c418105-8406-4fde-a100-00a6fdfc4020 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:04.948570 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c418105-8406-4fde-a100-00a6fdfc4020 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:04.949012 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c418105-8406-4fde-a100-00a6fdfc4020 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:04.999094 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:05.051345 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c418105-8406-4fde-a100-00a6fdfc4020 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:05.053217 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c418105-8406-4fde-a100-00a6fdfc4020 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:05.161497 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:05.187325 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6a870-f4c7-4834-af0a-bf83d8eca6b1 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:05.202858 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 127/263] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:32:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:32:05.212326 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c418105-8406-4fde-a100-00a6fdfc4020 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:05.268502 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6bc51-7c12-4bed-9a29-1e8a24bc610a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:05.269182 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6bc51-7c12-4bed-9a29-1e8a24bc610a None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:05.269464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6bc51-7c12-4bed-9a29-1e8a24bc610a None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:05.269739 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6bc51-7c12-4bed-9a29-1e8a24bc610a None admin] PATH_INFO: `/v3/users/52916f62fadb499cab4fabbfd6f1a33e` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:05.272981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6bc51-7c12-4bed-9a29-1e8a24bc610a None admin] RBAC: Authorizing `identity:get_user(user_id=52916f62fadb499cab4fabbfd6f1a33e)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:05.275844 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6bc51-7c12-4bed-9a29-1e8a24bc610a None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:05.277525 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 137/264] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:32:04 2022] GET /identity/v3/users/52916f62fadb499cab4fabbfd6f1a33e => generated 283 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:05.283193 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6bc51-7c12-4bed-9a29-1e8a24bc610a None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:05.410399 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c418105-8406-4fde-a100-00a6fdfc4020 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:05.480892 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36646058-666a-4327-b36b-280e50b980a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:05.481563 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36646058-666a-4327-b36b-280e50b980a7 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:05.481844 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36646058-666a-4327-b36b-280e50b980a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:05.482116 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36646058-666a-4327-b36b-280e50b980a7 None admin] PATH_INFO: `/v3/projects/91b9959e38d042f2a5aa8e5757e79251` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:05.483330 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36646058-666a-4327-b36b-280e50b980a7 None admin] RBAC: Authorizing `identity:get_project(project_id=91b9959e38d042f2a5aa8e5757e79251)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:05.484761 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36646058-666a-4327-b36b-280e50b980a7 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:05.486420 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 128/265] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:32:05 2022] GET /identity/v3/projects/91b9959e38d042f2a5aa8e5757e79251 => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:32:05.495127 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6bc51-7c12-4bed-9a29-1e8a24bc610a None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:05.497329 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36646058-666a-4327-b36b-280e50b980a7 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:05.511632 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:05.546363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e38c7-22d2-4200-8c79-8e9445036547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:05.547089 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e38c7-22d2-4200-8c79-8e9445036547 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:05.557055 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e38c7-22d2-4200-8c79-8e9445036547 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:05.557055 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e38c7-22d2-4200-8c79-8e9445036547 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:05.577057 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:05.650629 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36646058-666a-4327-b36b-280e50b980a7 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:05.684764 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e38c7-22d2-4200-8c79-8e9445036547 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:05.686199 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e38c7-22d2-4200-8c79-8e9445036547 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:05.714609 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f8176-f5dd-419c-b035-b2f891addfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:05.715496 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f8176-f5dd-419c-b035-b2f891addfbe None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:05.715950 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f8176-f5dd-419c-b035-b2f891addfbe None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:05.716397 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f8176-f5dd-419c-b035-b2f891addfbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:05.717413 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f8176-f5dd-419c-b035-b2f891addfbe None admin] RBAC: Adding query filter params (role.id=0ff11803573b472ab020a59b7f452dcd, scope.project.id=91b9959e38d042f2a5aa8e5757e79251, user.id=52916f62fadb499cab4fabbfd6f1a33e) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:05.717915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f8176-f5dd-419c-b035-b2f891addfbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:05.719537 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f8176-f5dd-419c-b035-b2f891addfbe None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:05.731308 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 129/266] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:32:05 2022] GET /identity/v3/role_assignments?user.id=52916f62fadb499cab4fabbfd6f1a33e&scope.project.id=91b9959e38d042f2a5aa8e5757e79251&role.id=0ff11803573b472ab020a59b7f452dcd => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:05.889581 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 138/267] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:32:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:32:05.895604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f8176-f5dd-419c-b035-b2f891addfbe None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:06.048059 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f8176-f5dd-419c-b035-b2f891addfbe None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:06.081410 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:06.099840 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5d5a9-c00d-4025-ac45-38dfd22d7ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:06.100497 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5d5a9-c00d-4025-ac45-38dfd22d7ff4 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:06.100776 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5d5a9-c00d-4025-ac45-38dfd22d7ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:06.101056 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5d5a9-c00d-4025-ac45-38dfd22d7ff4 None admin] PATH_INFO: `/v3/projects/91b9959e38d042f2a5aa8e5757e79251` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:06.102372 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5d5a9-c00d-4025-ac45-38dfd22d7ff4 None admin] RBAC: Authorizing `identity:get_project(project_id=91b9959e38d042f2a5aa8e5757e79251)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:06.103820 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5d5a9-c00d-4025-ac45-38dfd22d7ff4 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:06.105699 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 130/268] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:32:05 2022] GET /identity/v3/projects/91b9959e38d042f2a5aa8e5757e79251 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:06.111901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e38c7-22d2-4200-8c79-8e9445036547 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:06.132173 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:06.279124 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e5322-6847-4390-89ea-e23c9de11007 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:06.279630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e5322-6847-4390-89ea-e23c9de11007 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:06.279630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e5322-6847-4390-89ea-e23c9de11007 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:06.281381 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 131/269] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:06.290535 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92156e8e-7a87-48b9-81c3-802a37e33559 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:06.292444 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92156e8e-7a87-48b9-81c3-802a37e33559 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:06.293625 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92156e8e-7a87-48b9-81c3-802a37e33559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:06.324922 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-92156e8e-7a87-48b9-81c3-802a37e33559 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:06.327855 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-92156e8e-7a87-48b9-81c3-802a37e33559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:06.335322 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e38c7-22d2-4200-8c79-8e9445036547 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:06.405903 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98bcbd-5234-4833-9f1a-4ac573accf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:06.406883 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98bcbd-5234-4833-9f1a-4ac573accf87 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:06.407367 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98bcbd-5234-4833-9f1a-4ac573accf87 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:06.408493 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98bcbd-5234-4833-9f1a-4ac573accf87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:06.409596 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98bcbd-5234-4833-9f1a-4ac573accf87 None admin] RBAC: Adding query filter params (role.id=5c25aa917ab34baabb795c54dd8a4d02, scope.project.id=91b9959e38d042f2a5aa8e5757e79251, user.id=52916f62fadb499cab4fabbfd6f1a33e) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:06.410211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98bcbd-5234-4833-9f1a-4ac573accf87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:06.412020 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98bcbd-5234-4833-9f1a-4ac573accf87 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:06.426986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 139/270] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:32:06 2022] GET /identity/v3/role_assignments?user.id=52916f62fadb499cab4fabbfd6f1a33e&scope.project.id=91b9959e38d042f2a5aa8e5757e79251&role.id=5c25aa917ab34baabb795c54dd8a4d02 => generated 608 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:06.457785 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 132/271] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 17:32:06.481839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98bcbd-5234-4833-9f1a-4ac573accf87 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:06.582802 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:06.621675 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98bcbd-5234-4833-9f1a-4ac573accf87 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:06.651764 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce90291-a506-4aee-982b-95d7d3d236f7 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:06.652091 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce90291-a506-4aee-982b-95d7d3d236f7 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:06.652315 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce90291-a506-4aee-982b-95d7d3d236f7 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:06.653714 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 133/272] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 17:32:06.658979 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a9fd0-412f-4ceb-806c-d3a7c0743342 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:06.659249 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a9fd0-412f-4ceb-806c-d3a7c0743342 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:06.659520 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a9fd0-412f-4ceb-806c-d3a7c0743342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:06.678620 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45cb399-e871-4951-8e79-8bc84d32f434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:06.678620 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cb399-e871-4951-8e79-8bc84d32f434 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:06.679029 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cb399-e871-4951-8e79-8bc84d32f434 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:06.679295 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cb399-e871-4951-8e79-8bc84d32f434 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:06.683662 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-a31a9fd0-412f-4ceb-806c-d3a7c0743342 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:06.684946 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-a31a9fd0-412f-4ceb-806c-d3a7c0743342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:06.691607 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45cb399-e871-4951-8e79-8bc84d32f434 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:06.698405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-c45cb399-e871-4951-8e79-8bc84d32f434 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 17:32:06.698405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:06.698405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:06.698405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:06.698405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:06.698405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:06.698405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:06.698405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:06.698405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:06.698405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:06.698405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:06.698405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:06.698405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:06.698405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:06.698405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:06.698405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:06.699339 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:06.699339 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:06.699339 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:06.699339 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:06.699339 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:06.699339 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:06.699339 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:06.699339 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:06.699339 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:06.699339 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:06.699339 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:06.699339 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:06.699339 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:06.699339 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:06.699339 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:06.699339 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:06.700136 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:06.700136 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:06.700136 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:06.700136 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:06.700136 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:06.700136 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:06.700136 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:06.700136 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:06.700136 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:06.700136 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:06.700136 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 17:32:06.700136 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:06.700744 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 140/273] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:32:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:06.701878 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f32adb-be29-4a95-8b5d-49775d02ab43 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:06.702164 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f32adb-be29-4a95-8b5d-49775d02ab43 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:06.702438 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f32adb-be29-4a95-8b5d-49775d02ab43 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:06.708450 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 141/274] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:06.712914 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f32adb-be29-4a95-8b5d-49775d02ab43 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:06.767472 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 134/275] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:06.769830 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c79ac-6a65-4dbb-beb1-143b48e60b17 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:06.770324 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c79ac-6a65-4dbb-beb1-143b48e60b17 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:06.770796 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c79ac-6a65-4dbb-beb1-143b48e60b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:06.791403 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-4c9c79ac-6a65-4dbb-beb1-143b48e60b17 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:06.792946 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-4c9c79ac-6a65-4dbb-beb1-143b48e60b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:06.834839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f32adb-be29-4a95-8b5d-49775d02ab43 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:06.837693 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:06.870692 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:06.876388 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ed597-02f4-4fbb-9121-886f7de54796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:06.877010 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ed597-02f4-4fbb-9121-886f7de54796 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:06.877345 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ed597-02f4-4fbb-9121-886f7de54796 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:06.877620 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ed597-02f4-4fbb-9121-886f7de54796 None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:06.878284 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ed597-02f4-4fbb-9121-886f7de54796 None admin] RBAC: Adding query filter params (name=member) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:06.878588 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ed597-02f4-4fbb-9121-886f7de54796 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:06.879963 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ed597-02f4-4fbb-9121-886f7de54796 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:06.881294 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 135/276] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:06.882045 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c79ac-6a65-4dbb-beb1-143b48e60b17 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:06.893415 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 142/277] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 8 17:32:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:06.899374 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ed597-02f4-4fbb-9121-886f7de54796 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:06.997545 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c79ac-6a65-4dbb-beb1-143b48e60b17 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:07.007812 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ed597-02f4-4fbb-9121-886f7de54796 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:07.033055 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefd4af-c303-441e-b1de-89a42ab4a32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:07.033702 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefd4af-c303-441e-b1de-89a42ab4a32e None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:07.034095 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefd4af-c303-441e-b1de-89a42ab4a32e None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:07.034369 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefd4af-c303-441e-b1de-89a42ab4a32e None admin] PATH_INFO: `/v3/domains/default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:07.035589 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeefd4af-c303-441e-b1de-89a42ab4a32e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:07.037190 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeefd4af-c303-441e-b1de-89a42ab4a32e None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:07.039063 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 136/278] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:07.039903 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefd4af-c303-441e-b1de-89a42ab4a32e None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:07.042736 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb9aa8-18cb-459f-bda2-2471c5cd707c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:07.043649 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb9aa8-18cb-459f-bda2-2471c5cd707c None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:07.043941 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb9aa8-18cb-459f-bda2-2471c5cd707c None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:07.044220 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb9aa8-18cb-459f-bda2-2471c5cd707c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:07.054476 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb9aa8-18cb-459f-bda2-2471c5cd707c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:07.060491 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-edcb9aa8-18cb-459f-bda2-2471c5cd707c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 17:32:07.060491 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:07.060491 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:07.060491 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:07.060491 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:07.060491 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:07.060491 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:07.060491 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:07.060491 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:07.060491 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:07.060491 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:07.060491 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:07.060491 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:07.060491 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:07.060491 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:07.060491 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:07.061461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:07.061461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:07.061461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:07.061461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:07.061461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:07.061461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:07.061461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:07.061461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:07.061461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:07.061461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:07.061461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:07.061461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:07.061461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:07.061461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:07.061461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:07.061461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:07.062283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:07.062283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:07.062283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:07.062283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:07.062283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:07.062283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:07.062283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:07.062283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:07.062283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:07.062283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:07.062283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 17:32:07.062283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:07.062283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 143/279] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:32:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:07.066575 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb9aa8-18cb-459f-bda2-2471c5cd707c None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:07.086459 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:07.121977 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:07.144636 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefd4af-c303-441e-b1de-89a42ab4a32e None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:07.165225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb9aa8-18cb-459f-bda2-2471c5cd707c None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:07.179449 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03de0d-e488-450e-9860-b3176ce1f271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:07.180735 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03de0d-e488-450e-9860-b3176ce1f271 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:07.181013 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03de0d-e488-450e-9860-b3176ce1f271 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:07.181317 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03de0d-e488-450e-9860-b3176ce1f271 None admin] PATH_INFO: `/v3/users/0668293df09f402999a1e300a3a4a7ab` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:07.194604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03de0d-e488-450e-9860-b3176ce1f271 None admin] RBAC: Authorizing `identity:get_user(user_id=0668293df09f402999a1e300a3a4a7ab)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:07.196118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03de0d-e488-450e-9860-b3176ce1f271 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:07.197767 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 137/280] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:32:07 2022] GET /identity/v3/users/0668293df09f402999a1e300a3a4a7ab => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:07.198915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631bfd3-b58e-4bf9-87cf-53390cdb60a4 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:07.199087 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971830b-c290-4749-b1ea-05521bf7006b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:07.199226 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631bfd3-b58e-4bf9-87cf-53390cdb60a4 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:07.199452 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631bfd3-b58e-4bf9-87cf-53390cdb60a4 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:07.199690 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971830b-c290-4749-b1ea-05521bf7006b None admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:07.199972 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971830b-c290-4749-b1ea-05521bf7006b None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:07.200243 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971830b-c290-4749-b1ea-05521bf7006b None admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:07.200818 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 138/281] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:07.201374 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631bfd3-b58e-4bf9-87cf-53390cdb60a4 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:07.204737 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971830b-c290-4749-b1ea-05521bf7006b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:07.206249 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971830b-c290-4749-b1ea-05521bf7006b None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:07.290611 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 144/282] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Aug 8 17:32:07 2022] POST /identity/v3/users => generated 293 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:32:07.291436 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971830b-c290-4749-b1ea-05521bf7006b None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:07.302046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:07.308443 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631bfd3-b58e-4bf9-87cf-53390cdb60a4 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:07.352768 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f4832-6b46-4366-9a49-fda276ca5e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:07.353329 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f4832-6b46-4366-9a49-fda276ca5e6d None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:07.353612 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f4832-6b46-4366-9a49-fda276ca5e6d None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:07.353885 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f4832-6b46-4366-9a49-fda276ca5e6d None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:07.354741 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f4832-6b46-4366-9a49-fda276ca5e6d None admin] RBAC: Adding query filter params (name=reader) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:07.354846 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f4832-6b46-4366-9a49-fda276ca5e6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:07.356264 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f4832-6b46-4366-9a49-fda276ca5e6d None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:07.366379 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 139/283] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 8 17:32:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:07.367486 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3625464-8363-4979-b071-5f9fcb1f8eb9 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:07.367842 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3625464-8363-4979-b071-5f9fcb1f8eb9 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:07.368312 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3625464-8363-4979-b071-5f9fcb1f8eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:07.388156 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-d3625464-8363-4979-b071-5f9fcb1f8eb9 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:07.389401 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-d3625464-8363-4979-b071-5f9fcb1f8eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:07.422053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971830b-c290-4749-b1ea-05521bf7006b None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:07.435104 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:07.462181 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2c55a-4f6d-4e33-a78b-fa75b0300201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:07.462806 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2c55a-4f6d-4e33-a78b-fa75b0300201 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:07.463096 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2c55a-4f6d-4e33-a78b-fa75b0300201 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:07.463368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2c55a-4f6d-4e33-a78b-fa75b0300201 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:07.464099 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2c55a-4f6d-4e33-a78b-fa75b0300201 None admin] RBAC: Adding query filter params (role.id=adc45cdd4c9543b3b8b24141870f4b11, user.id=0668293df09f402999a1e300a3a4a7ab, scope.system=all) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:07.464411 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2c55a-4f6d-4e33-a78b-fa75b0300201 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:07.465994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2c55a-4f6d-4e33-a78b-fa75b0300201 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:07.474555 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 145/284] 10.222.0.70 () {56 vars in 1308 bytes} [Mon Aug 8 17:32:07 2022] GET /identity/v3/role_assignments?user.id=0668293df09f402999a1e300a3a4a7ab&scope.system=all&role.id=adc45cdd4c9543b3b8b24141870f4b11 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:07.474925 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 140/285] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:07.475551 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2c55a-4f6d-4e33-a78b-fa75b0300201 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:07.500759 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3625464-8363-4979-b071-5f9fcb1f8eb9 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:07.627026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2c55a-4f6d-4e33-a78b-fa75b0300201 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:07.627803 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:07.646957 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3625464-8363-4979-b071-5f9fcb1f8eb9 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:07.682159 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10ba39-e347-4222-be5d-359091c0dddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:07.682803 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10ba39-e347-4222-be5d-359091c0dddc None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:07.683087 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10ba39-e347-4222-be5d-359091c0dddc None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:07.683361 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10ba39-e347-4222-be5d-359091c0dddc None admin] PATH_INFO: `/v3/users/790fc3f7deed423aa6c4ff8200b84f16` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:07.684590 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10ba39-e347-4222-be5d-359091c0dddc None admin] RBAC: Authorizing `identity:get_user(user_id=790fc3f7deed423aa6c4ff8200b84f16)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:07.686228 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10ba39-e347-4222-be5d-359091c0dddc None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:07.687970 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 146/286] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:32:07 2022] GET /identity/v3/users/790fc3f7deed423aa6c4ff8200b84f16 => generated 297 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:07.688858 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa119791-525a-4b19-9741-11e4ea80bbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:07.689481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa119791-525a-4b19-9741-11e4ea80bbee None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:07.689763 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa119791-525a-4b19-9741-11e4ea80bbee None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:07.691120 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa119791-525a-4b19-9741-11e4ea80bbee None admin] PATH_INFO: `/v3/roles/member` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:07.693366 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10ba39-e347-4222-be5d-359091c0dddc None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:07.709667 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa119791-525a-4b19-9741-11e4ea80bbee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:07.716079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-fa119791-525a-4b19-9741-11e4ea80bbee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 17:32:07.716079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:07.716079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:07.716079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:07.716079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:07.716079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:07.716079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:07.716079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:07.716079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:07.716079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:07.716079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:07.716079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:07.716079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:07.716079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:07.716079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:07.716079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:07.717733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:07.717733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:07.717733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:07.717733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:07.717733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:07.717733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:07.717733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:07.717733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:07.717733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:07.717733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:07.717733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:07.717733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:07.717733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:07.717733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:07.717733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:07.717733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:07.718567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:07.718567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:07.718567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:07.718567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:07.718567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:07.718567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:07.718567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:07.718567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:07.718567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:07.718567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:07.718567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 17:32:07.718567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:07.721316 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 141/287] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:32:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:07.727848 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa119791-525a-4b19-9741-11e4ea80bbee None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:07.796992 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:07.879399 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa119791-525a-4b19-9741-11e4ea80bbee None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:07.924460 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15ebce-254b-41c5-9a96-997fe3601bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:07.926359 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15ebce-254b-41c5-9a96-997fe3601bb0 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:07.926843 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15ebce-254b-41c5-9a96-997fe3601bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:07.928002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15ebce-254b-41c5-9a96-997fe3601bb0 None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:07.930951 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d15ebce-254b-41c5-9a96-997fe3601bb0 None admin] RBAC: Adding query filter params (name=member) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:07.932413 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d15ebce-254b-41c5-9a96-997fe3601bb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:07.934689 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d15ebce-254b-41c5-9a96-997fe3601bb0 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:07.938542 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10ba39-e347-4222-be5d-359091c0dddc None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:07.955256 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 142/288] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 8 17:32:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:07.959295 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15ebce-254b-41c5-9a96-997fe3601bb0 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:07.988245 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:08.002760 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c8720-8b13-4cab-9a77-71085a933358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:08.003707 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c8720-8b13-4cab-9a77-71085a933358 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:08.004144 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c8720-8b13-4cab-9a77-71085a933358 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:08.005787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c8720-8b13-4cab-9a77-71085a933358 None admin] PATH_INFO: `/v3/projects/91b9959e38d042f2a5aa8e5757e79251` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:08.008475 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c8720-8b13-4cab-9a77-71085a933358 None admin] RBAC: Authorizing `identity:get_project(project_id=91b9959e38d042f2a5aa8e5757e79251)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:08.011431 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c8720-8b13-4cab-9a77-71085a933358 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:08.013428 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 147/289] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:32:07 2022] GET /identity/v3/projects/91b9959e38d042f2a5aa8e5757e79251 => generated 302 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:32:08.019316 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c8720-8b13-4cab-9a77-71085a933358 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:08.129172 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15ebce-254b-41c5-9a96-997fe3601bb0 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:08.165637 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8177d-6e3e-4a7f-8d0d-d497e2f7511f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:08.165971 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8177d-6e3e-4a7f-8d0d-d497e2f7511f None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:08.166181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8177d-6e3e-4a7f-8d0d-d497e2f7511f None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:08.166458 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8177d-6e3e-4a7f-8d0d-d497e2f7511f None admin] PATH_INFO: `/v3/users/e21d639051b7423aa1994ab744f67f2d` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:08.167658 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8177d-6e3e-4a7f-8d0d-d497e2f7511f None admin] RBAC: Authorizing `identity:get_user(user_id=e21d639051b7423aa1994ab744f67f2d)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:08.169158 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8177d-6e3e-4a7f-8d0d-d497e2f7511f None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:08.171118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 143/290] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:32:07 2022] GET /identity/v3/users/e21d639051b7423aa1994ab744f67f2d => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:08.180542 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8177d-6e3e-4a7f-8d0d-d497e2f7511f None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:08.218973 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c8720-8b13-4cab-9a77-71085a933358 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:08.242012 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:08.266909 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:08.285319 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d961c-4bd2-45c1-916e-4463b2982e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:08.286124 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d961c-4bd2-45c1-916e-4463b2982e3c None admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:08.286473 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d961c-4bd2-45c1-916e-4463b2982e3c None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:08.286812 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d961c-4bd2-45c1-916e-4463b2982e3c None admin] PATH_INFO: `/v3/projects/91b9959e38d042f2a5aa8e5757e79251/users/790fc3f7deed423aa6c4ff8200b84f16/roles/ff9689d3969d49a19db320a3514ddb56` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:08.287314 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8177d-6e3e-4a7f-8d0d-d497e2f7511f None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:08.289049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d961c-4bd2-45c1-916e-4463b2982e3c None admin] RBAC: Authorizing `identity:create_grant(project_id=91b9959e38d042f2a5aa8e5757e79251, user_id=790fc3f7deed423aa6c4ff8200b84f16, role_id=ff9689d3969d49a19db320a3514ddb56)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:08.291441 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d961c-4bd2-45c1-916e-4463b2982e3c None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:08.328820 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7c3a1-73b2-4e72-b0b2-3767d99ba569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:08.329508 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7c3a1-73b2-4e72-b0b2-3767d99ba569 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:08.329785 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7c3a1-73b2-4e72-b0b2-3767d99ba569 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:08.330060 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7c3a1-73b2-4e72-b0b2-3767d99ba569 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:08.371148 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 148/291] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 8 17:32:08 2022] PUT /identity/v3/projects/91b9959e38d042f2a5aa8e5757e79251/users/790fc3f7deed423aa6c4ff8200b84f16/roles/ff9689d3969d49a19db320a3514ddb56 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:32:08.416925 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7c3a1-73b2-4e72-b0b2-3767d99ba569 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:08.418329 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7c3a1-73b2-4e72-b0b2-3767d99ba569 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:08.507873 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:08.529440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 144/292] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:32:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:32:08.538407 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d961c-4bd2-45c1-916e-4463b2982e3c None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:08.677411 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d961c-4bd2-45c1-916e-4463b2982e3c None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:08.726181 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52bd823-bb38-4cd9-a371-25e837e2c70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:08.727463 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bd823-bb38-4cd9-a371-25e837e2c70a None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:08.727747 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bd823-bb38-4cd9-a371-25e837e2c70a None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:08.728024 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bd823-bb38-4cd9-a371-25e837e2c70a None admin] PATH_INFO: `/v3/projects/91b9959e38d042f2a5aa8e5757e79251` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:08.729218 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52bd823-bb38-4cd9-a371-25e837e2c70a None admin] RBAC: Authorizing `identity:get_project(project_id=91b9959e38d042f2a5aa8e5757e79251)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:08.730668 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52bd823-bb38-4cd9-a371-25e837e2c70a None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:08.732653 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 149/293] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:32:08 2022] GET /identity/v3/projects/91b9959e38d042f2a5aa8e5757e79251 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:08.738816 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7c3a1-73b2-4e72-b0b2-3767d99ba569 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:08.863658 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7c3a1-73b2-4e72-b0b2-3767d99ba569 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:08.900957 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b5a7e-3aa0-4a0f-b010-ef927da2cedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:08.901601 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b5a7e-3aa0-4a0f-b010-ef927da2cedd None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:08.901882 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b5a7e-3aa0-4a0f-b010-ef927da2cedd None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:08.902157 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b5a7e-3aa0-4a0f-b010-ef927da2cedd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:08.902882 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b5a7e-3aa0-4a0f-b010-ef927da2cedd None admin] RBAC: Adding query filter params (role.id=adc45cdd4c9543b3b8b24141870f4b11, scope.project.id=91b9959e38d042f2a5aa8e5757e79251, user.id=e21d639051b7423aa1994ab744f67f2d) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:08.903191 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b5a7e-3aa0-4a0f-b010-ef927da2cedd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:08.904632 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b5a7e-3aa0-4a0f-b010-ef927da2cedd None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:08.911158 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 145/294] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:32:08 2022] GET /identity/v3/role_assignments?user.id=e21d639051b7423aa1994ab744f67f2d&scope.project.id=91b9959e38d042f2a5aa8e5757e79251&role.id=adc45cdd4c9543b3b8b24141870f4b11 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:09.733764 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c3595-2d5b-4495-934f-a297033b2c9a None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:09.734323 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c3595-2d5b-4495-934f-a297033b2c9a None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:09.734323 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c3595-2d5b-4495-934f-a297033b2c9a None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:09.735897 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 150/295] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:09.741717 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4f7dd-49f0-44eb-8fb4-240d6620bef2 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:09.742671 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4f7dd-49f0-44eb-8fb4-240d6620bef2 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:09.743048 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4f7dd-49f0-44eb-8fb4-240d6620bef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:09.762323 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-23b4f7dd-49f0-44eb-8fb4-240d6620bef2 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:09.763518 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-23b4f7dd-49f0-44eb-8fb4-240d6620bef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:09.770105 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb51f10-5bac-4e65-a7eb-873e5df41917 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:09.770389 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb51f10-5bac-4e65-a7eb-873e5df41917 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:09.770665 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb51f10-5bac-4e65-a7eb-873e5df41917 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:09.771995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 151/296] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:09.777680 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afc476-6ca8-4ada-bf7d-3a8912c31b70 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:09.777963 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afc476-6ca8-4ada-bf7d-3a8912c31b70 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:09.778235 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afc476-6ca8-4ada-bf7d-3a8912c31b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:09.797423 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-47afc476-6ca8-4ada-bf7d-3a8912c31b70 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:09.798628 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-47afc476-6ca8-4ada-bf7d-3a8912c31b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:09.808783 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:09.832083 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:09.838066 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 146/297] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:09.839143 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd152c8a-091a-41e2-bfb5-850cef0024ce None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:09.839426 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd152c8a-091a-41e2-bfb5-850cef0024ce None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:09.839695 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd152c8a-091a-41e2-bfb5-850cef0024ce None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:09.840930 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 147/298] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:09.846813 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c9ce3-5c8f-40c4-8df6-9850257d8ae4 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:09.847113 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c9ce3-5c8f-40c4-8df6-9850257d8ae4 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:09.847387 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c9ce3-5c8f-40c4-8df6-9850257d8ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:09.866322 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-d19c9ce3-5c8f-40c4-8df6-9850257d8ae4 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:09.867752 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-d19c9ce3-5c8f-40c4-8df6-9850257d8ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:09.881636 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 152/299] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 17:32:09.886001 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afc476-6ca8-4ada-bf7d-3a8912c31b70 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:09.953207 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 148/300] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 17:32:09.953207 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c9ce3-5c8f-40c4-8df6-9850257d8ae4 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:09.998701 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afc476-6ca8-4ada-bf7d-3a8912c31b70 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:10.037887 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da08be-fe51-4e1a-9546-c2809db0d2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:10.038530 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da08be-fe51-4e1a-9546-c2809db0d2cc None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:10.038812 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da08be-fe51-4e1a-9546-c2809db0d2cc None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:10.039689 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da08be-fe51-4e1a-9546-c2809db0d2cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:10.040772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da08be-fe51-4e1a-9546-c2809db0d2cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:10.042386 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da08be-fe51-4e1a-9546-c2809db0d2cc None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:10.049243 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 153/301] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:10.049243 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da08be-fe51-4e1a-9546-c2809db0d2cc None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:10.071669 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c9ce3-5c8f-40c4-8df6-9850257d8ae4 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:10.074058 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:10.084933 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:10.106802 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2dcc87-6e0c-4359-9af7-ddcad826e49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:10.107662 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2dcc87-6e0c-4359-9af7-ddcad826e49e None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:10.107942 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2dcc87-6e0c-4359-9af7-ddcad826e49e None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:10.108215 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2dcc87-6e0c-4359-9af7-ddcad826e49e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:10.118783 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2dcc87-6e0c-4359-9af7-ddcad826e49e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:10.125851 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-0f2dcc87-6e0c-4359-9af7-ddcad826e49e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 17:32:10.125851 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:10.125851 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:10.125851 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:10.125851 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:10.125851 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:10.125851 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:10.125851 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:10.125851 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:10.125851 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:10.125851 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:10.125851 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:10.125851 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:10.125851 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:10.125851 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:10.125851 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:10.126785 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:10.126785 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:10.126785 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:10.126785 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:10.126785 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:10.126785 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:10.126785 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:10.126785 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:10.126785 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:10.126785 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:10.126785 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:10.126785 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:10.126785 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:10.126785 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:10.126785 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:10.126785 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:10.133578 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:10.133578 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:10.133578 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:10.133578 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:10.133578 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:10.133578 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:10.133578 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:10.133578 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:10.133578 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:10.133578 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:10.133578 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 17:32:10.133578 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:10.133578 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 149/302] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:32:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:10.133578 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2dcc87-6e0c-4359-9af7-ddcad826e49e None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:10.153697 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da08be-fe51-4e1a-9546-c2809db0d2cc None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:10.198609 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a98a3-75bf-48a4-9b76-36e1c486c545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:10.199240 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a98a3-75bf-48a4-9b76-36e1c486c545 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:10.199771 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a98a3-75bf-48a4-9b76-36e1c486c545 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:10.200057 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a98a3-75bf-48a4-9b76-36e1c486c545 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:10.214772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a98a3-75bf-48a4-9b76-36e1c486c545 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:10.221214 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-ed7a98a3-75bf-48a4-9b76-36e1c486c545 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 17:32:10.221214 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:10.221214 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:10.221214 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:10.221214 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:10.221214 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:10.221214 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:10.221214 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:10.221214 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:10.221214 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:10.221214 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:10.221214 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:10.221214 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:10.221214 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:10.221214 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:10.221214 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:10.222170 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:10.222170 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:10.222170 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:10.222170 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:10.222170 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:10.222170 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:10.222170 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:10.222170 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:10.222170 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:10.222170 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:10.222170 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:10.222170 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:10.222170 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:10.222170 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:10.222170 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:10.222170 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:10.222964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:10.222964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:10.222964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:10.222964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:10.222964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:10.222964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:10.222964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:10.222964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:10.222964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:10.222964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:10.222964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 17:32:10.222964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:10.222964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 154/303] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:32:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:10.224143 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a98a3-75bf-48a4-9b76-36e1c486c545 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:10.236652 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2dcc87-6e0c-4359-9af7-ddcad826e49e None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:10.279576 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ba5a0-1850-4d11-b0ab-1a698d38b0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:10.280389 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ba5a0-1850-4d11-b0ab-1a698d38b0df None admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:10.280673 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ba5a0-1850-4d11-b0ab-1a698d38b0df None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:10.280950 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ba5a0-1850-4d11-b0ab-1a698d38b0df None admin] PATH_INFO: `/v3/groups` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:10.281604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ba5a0-1850-4d11-b0ab-1a698d38b0df None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:10.283485 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ba5a0-1850-4d11-b0ab-1a698d38b0df None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:10.324404 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:10.330074 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a98a3-75bf-48a4-9b76-36e1c486c545 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:10.358787 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 150/304] 10.222.0.70 () {60 vars in 1134 bytes} [Mon Aug 8 17:32:10 2022] POST /identity/v3/groups => generated 229 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:32:10.359620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ba5a0-1850-4d11-b0ab-1a698d38b0df None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:10.378770 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712b322-f0f6-4fb0-92be-d1e112e5031f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:10.380479 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712b322-f0f6-4fb0-92be-d1e112e5031f None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:10.380957 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712b322-f0f6-4fb0-92be-d1e112e5031f None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:10.384957 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712b322-f0f6-4fb0-92be-d1e112e5031f None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:10.384957 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712b322-f0f6-4fb0-92be-d1e112e5031f None admin] RBAC: Adding query filter params (name=reader) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:10.384957 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712b322-f0f6-4fb0-92be-d1e112e5031f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:10.384957 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712b322-f0f6-4fb0-92be-d1e112e5031f None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:10.394379 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:10.404150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 155/305] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 8 17:32:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:10.410076 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712b322-f0f6-4fb0-92be-d1e112e5031f None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:10.486330 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ba5a0-1850-4d11-b0ab-1a698d38b0df None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:10.527480 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9d35a-a4e2-4d6b-bf2c-fb7cda5899f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:10.528121 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9d35a-a4e2-4d6b-bf2c-fb7cda5899f6 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:10.529359 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9d35a-a4e2-4d6b-bf2c-fb7cda5899f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:10.529687 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9d35a-a4e2-4d6b-bf2c-fb7cda5899f6 None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:10.530393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9d35a-a4e2-4d6b-bf2c-fb7cda5899f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:10.530701 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9d35a-a4e2-4d6b-bf2c-fb7cda5899f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:10.532274 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9d35a-a4e2-4d6b-bf2c-fb7cda5899f6 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:10.534633 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712b322-f0f6-4fb0-92be-d1e112e5031f None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:10.542382 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 151/306] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 8 17:32:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:10.547982 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9d35a-a4e2-4d6b-bf2c-fb7cda5899f6 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:10.575752 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b7175-79a6-4885-82b5-dace30b6781e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:10.576391 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b7175-79a6-4885-82b5-dace30b6781e None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:10.576677 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b7175-79a6-4885-82b5-dace30b6781e None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:10.576952 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b7175-79a6-4885-82b5-dace30b6781e None admin] PATH_INFO: `/v3/users/edc167f5482248feba1982e55cc47f6a` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:10.594837 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b7175-79a6-4885-82b5-dace30b6781e None admin] RBAC: Authorizing `identity:get_user(user_id=edc167f5482248feba1982e55cc47f6a)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:10.596325 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b7175-79a6-4885-82b5-dace30b6781e None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:10.601060 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 156/307] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:32:10 2022] GET /identity/v3/users/edc167f5482248feba1982e55cc47f6a => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:32:10.604643 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b7175-79a6-4885-82b5-dace30b6781e None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:10.629423 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:10.665465 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:10.685005 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9d35a-a4e2-4d6b-bf2c-fb7cda5899f6 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:10.712812 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b7175-79a6-4885-82b5-dace30b6781e None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:10.728914 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42f3ea-7fcf-44a0-9993-a81576a864ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:10.729859 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42f3ea-7fcf-44a0-9993-a81576a864ae None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:10.730149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42f3ea-7fcf-44a0-9993-a81576a864ae None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:10.730431 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42f3ea-7fcf-44a0-9993-a81576a864ae None admin] PATH_INFO: `/v3/users/0668293df09f402999a1e300a3a4a7ab` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:10.732042 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42f3ea-7fcf-44a0-9993-a81576a864ae None admin] RBAC: Authorizing `identity:get_user(user_id=0668293df09f402999a1e300a3a4a7ab)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:10.733552 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42f3ea-7fcf-44a0-9993-a81576a864ae None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:10.736120 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 152/308] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:32:10 2022] GET /identity/v3/users/0668293df09f402999a1e300a3a4a7ab => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:32:10.741599 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42f3ea-7fcf-44a0-9993-a81576a864ae None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:10.754511 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbfe491-065e-425f-8634-05b27894584f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:10.755124 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfe491-065e-425f-8634-05b27894584f None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:10.755406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfe491-065e-425f-8634-05b27894584f None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:10.755678 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfe491-065e-425f-8634-05b27894584f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:10.756402 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbfe491-065e-425f-8634-05b27894584f None admin] RBAC: Adding query filter params (role.id=ff9689d3969d49a19db320a3514ddb56, user.id=edc167f5482248feba1982e55cc47f6a, scope.system=all) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:10.756706 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbfe491-065e-425f-8634-05b27894584f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:10.758960 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbfe491-065e-425f-8634-05b27894584f None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:10.764295 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 157/309] 10.222.0.70 () {56 vars in 1308 bytes} [Mon Aug 8 17:32:10 2022] GET /identity/v3/role_assignments?user.id=edc167f5482248feba1982e55cc47f6a&scope.system=all&role.id=ff9689d3969d49a19db320a3514ddb56 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:10.858987 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42f3ea-7fcf-44a0-9993-a81576a864ae None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:10.898999 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5611293-e1a1-4e76-97dd-00a1a494a282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:10.899678 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5611293-e1a1-4e76-97dd-00a1a494a282 None admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:10.899958 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5611293-e1a1-4e76-97dd-00a1a494a282 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:10.900233 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5611293-e1a1-4e76-97dd-00a1a494a282 None admin] PATH_INFO: `/v3/system/users/0668293df09f402999a1e300a3a4a7ab/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:10.901830 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5611293-e1a1-4e76-97dd-00a1a494a282 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0668293df09f402999a1e300a3a4a7ab, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:10.903259 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5611293-e1a1-4e76-97dd-00a1a494a282 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:10.946821 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26962972-94f0-4c54-984d-b198acef7791 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:10.947117 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26962972-94f0-4c54-984d-b198acef7791 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:10.947392 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26962972-94f0-4c54-984d-b198acef7791 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:10.948870 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 158/310] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 17:32:10.954233 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f8bc2-5a1c-41ea-9527-9ceb8f156708 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:10.954519 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f8bc2-5a1c-41ea-9527-9ceb8f156708 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:10.954823 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f8bc2-5a1c-41ea-9527-9ceb8f156708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:10.974081 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-ac9f8bc2-5a1c-41ea-9527-9ceb8f156708 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:10.975294 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-ac9f8bc2-5a1c-41ea-9527-9ceb8f156708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:11.005068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 153/311] 10.222.0.70 () {58 vars in 1334 bytes} [Mon Aug 8 17:32:10 2022] PUT /identity/v3/system/users/0668293df09f402999a1e300a3a4a7ab/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:32:11.064197 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 159/312] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 17:32:11.085558 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5611293-e1a1-4e76-97dd-00a1a494a282 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:11.108740 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:11.205172 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5611293-e1a1-4e76-97dd-00a1a494a282 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:11.245796 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350e8d49-0518-4faf-bbfb-21e059997ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:11.246433 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e8d49-0518-4faf-bbfb-21e059997ef7 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:11.246714 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e8d49-0518-4faf-bbfb-21e059997ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:11.246985 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e8d49-0518-4faf-bbfb-21e059997ef7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:11.257415 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350e8d49-0518-4faf-bbfb-21e059997ef7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:11.262493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-350e8d49-0518-4faf-bbfb-21e059997ef7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 17:32:11.262493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:11.262493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:11.262493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:11.262493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:11.262493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:11.262493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:11.262493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:11.262493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:11.262493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:11.262493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:11.262493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:11.262493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:11.262493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:11.262493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:11.262493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:11.263382 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:11.263382 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:11.263382 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:11.263382 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:11.263382 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:11.263382 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:11.263382 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:11.263382 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:11.263382 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:11.263382 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:11.263382 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:11.263382 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:11.263382 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:11.263382 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:11.263382 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:11.263382 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:11.264207 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:11.264207 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:11.264207 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:11.264207 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:11.264207 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:11.264207 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:11.264207 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:11.264207 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:11.264207 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:11.264207 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:11.264207 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 17:32:11.264207 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:11.264207 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 154/313] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:32:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:11.269855 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f8bc2-5a1c-41ea-9527-9ceb8f156708 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:11.282583 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:11.373902 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f8bc2-5a1c-41ea-9527-9ceb8f156708 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:11.411735 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afa9c1-d579-49e7-a4e8-77ba5cb07179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:11.412190 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afa9c1-d579-49e7-a4e8-77ba5cb07179 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:11.412474 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afa9c1-d579-49e7-a4e8-77ba5cb07179 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:11.412752 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afa9c1-d579-49e7-a4e8-77ba5cb07179 None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:11.413471 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50afa9c1-d579-49e7-a4e8-77ba5cb07179 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:11.413847 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50afa9c1-d579-49e7-a4e8-77ba5cb07179 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:11.415222 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50afa9c1-d579-49e7-a4e8-77ba5cb07179 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:11.428707 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 160/314] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 8 17:32:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:11.434800 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350e8d49-0518-4faf-bbfb-21e059997ef7 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:11.520434 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:11.543667 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350e8d49-0518-4faf-bbfb-21e059997ef7 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:11.580712 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded40382-4fd3-4e09-82e6-05b274244ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:11.581389 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded40382-4fd3-4e09-82e6-05b274244ee6 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:11.581668 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded40382-4fd3-4e09-82e6-05b274244ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:11.581938 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded40382-4fd3-4e09-82e6-05b274244ee6 None admin] PATH_INFO: `/v3/users/790fc3f7deed423aa6c4ff8200b84f16` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:11.583183 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded40382-4fd3-4e09-82e6-05b274244ee6 None admin] RBAC: Authorizing `identity:get_user(user_id=790fc3f7deed423aa6c4ff8200b84f16)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:11.584673 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded40382-4fd3-4e09-82e6-05b274244ee6 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:11.591972 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 155/315] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:32:11 2022] GET /identity/v3/users/790fc3f7deed423aa6c4ff8200b84f16 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:11.593495 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afa9c1-d579-49e7-a4e8-77ba5cb07179 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:11.665220 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:11.697903 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afa9c1-d579-49e7-a4e8-77ba5cb07179 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:11.731916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d9ccf-2518-4c23-a138-22670163ce4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:11.732530 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d9ccf-2518-4c23-a138-22670163ce4a None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:11.732812 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d9ccf-2518-4c23-a138-22670163ce4a None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:11.733108 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d9ccf-2518-4c23-a138-22670163ce4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:11.802341 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d9ccf-2518-4c23-a138-22670163ce4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:11.803742 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d9ccf-2518-4c23-a138-22670163ce4a None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:11.873963 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:11.905795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 161/316] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:32:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:32:11.911214 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded40382-4fd3-4e09-82e6-05b274244ee6 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:12.025583 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded40382-4fd3-4e09-82e6-05b274244ee6 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:12.062147 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c93d9-e001-40ad-a397-18af96660cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:12.063113 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c93d9-e001-40ad-a397-18af96660cb6 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:12.063597 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c93d9-e001-40ad-a397-18af96660cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:12.064173 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c93d9-e001-40ad-a397-18af96660cb6 None admin] PATH_INFO: `/v3/projects/91b9959e38d042f2a5aa8e5757e79251` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:12.065541 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c93d9-e001-40ad-a397-18af96660cb6 None admin] RBAC: Authorizing `identity:get_project(project_id=91b9959e38d042f2a5aa8e5757e79251)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:12.067189 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c93d9-e001-40ad-a397-18af96660cb6 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:12.069051 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 156/317] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:32:11 2022] GET /identity/v3/projects/91b9959e38d042f2a5aa8e5757e79251 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:12.077739 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d9ccf-2518-4c23-a138-22670163ce4a None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:12.179037 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d9ccf-2518-4c23-a138-22670163ce4a None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:12.214701 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bf20b-c2d2-425f-89a1-c5d7fb2e6cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:12.215316 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bf20b-c2d2-425f-89a1-c5d7fb2e6cf3 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:12.215597 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bf20b-c2d2-425f-89a1-c5d7fb2e6cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:12.215870 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bf20b-c2d2-425f-89a1-c5d7fb2e6cf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:12.216596 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9bf20b-c2d2-425f-89a1-c5d7fb2e6cf3 None admin] RBAC: Adding query filter params (role.id=ff9689d3969d49a19db320a3514ddb56, scope.project.id=91b9959e38d042f2a5aa8e5757e79251, user.id=790fc3f7deed423aa6c4ff8200b84f16) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:12.216904 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9bf20b-c2d2-425f-89a1-c5d7fb2e6cf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:12.218379 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9bf20b-c2d2-425f-89a1-c5d7fb2e6cf3 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:12.224987 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 162/318] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:32:12 2022] GET /identity/v3/role_assignments?user.id=790fc3f7deed423aa6c4ff8200b84f16&scope.project.id=91b9959e38d042f2a5aa8e5757e79251&role.id=ff9689d3969d49a19db320a3514ddb56 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:12.553327 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fd133-b853-4d13-9091-b7ff583ec21f None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:12.553724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fd133-b853-4d13-9091-b7ff583ec21f None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:12.553903 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fd133-b853-4d13-9091-b7ff583ec21f None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:12.556028 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 157/319] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:12.561100 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d2ee7-414a-460d-9ac3-b23420df1348 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:12.561371 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d2ee7-414a-460d-9ac3-b23420df1348 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:12.561643 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d2ee7-414a-460d-9ac3-b23420df1348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:12.579897 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-d26d2ee7-414a-460d-9ac3-b23420df1348 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:12.581123 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-d26d2ee7-414a-460d-9ac3-b23420df1348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:12.611833 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:12.649777 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 163/320] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:12.671747 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fd133-b853-4d13-9091-b7ff583ec21f None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:12.687774 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:12.775400 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fd133-b853-4d13-9091-b7ff583ec21f None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:12.809878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2701c-613c-40bd-9a31-61f77f72aeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:12.810501 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2701c-613c-40bd-9a31-61f77f72aeb8 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:12.810779 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2701c-613c-40bd-9a31-61f77f72aeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:12.811049 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2701c-613c-40bd-9a31-61f77f72aeb8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:12.812143 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2701c-613c-40bd-9a31-61f77f72aeb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:12.813623 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2701c-613c-40bd-9a31-61f77f72aeb8 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:12.815340 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 158/321] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:12.821417 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d2ee7-414a-460d-9ac3-b23420df1348 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:12.868504 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450c928-c839-4396-9625-6ea7ad1a0d32 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:12.868872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450c928-c839-4396-9625-6ea7ad1a0d32 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:12.869086 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450c928-c839-4396-9625-6ea7ad1a0d32 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:12.870432 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 159/322] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:12.875319 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea1d34-6dfd-4235-9f17-436fb84292ad None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:12.875612 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea1d34-6dfd-4235-9f17-436fb84292ad None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:12.875890 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea1d34-6dfd-4235-9f17-436fb84292ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:12.895162 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-10ea1d34-6dfd-4235-9f17-436fb84292ad None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:12.896362 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-10ea1d34-6dfd-4235-9f17-436fb84292ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:12.927919 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d2ee7-414a-460d-9ac3-b23420df1348 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:12.963929 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ccf741-7d4b-4211-ad0c-116d3235d90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:12.964558 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccf741-7d4b-4211-ad0c-116d3235d90c None admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:12.964831 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccf741-7d4b-4211-ad0c-116d3235d90c None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:12.965129 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccf741-7d4b-4211-ad0c-116d3235d90c None admin] PATH_INFO: `/v3/groups` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:12.965762 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ccf741-7d4b-4211-ad0c-116d3235d90c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:12.966727 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 160/323] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 17:32:12.967185 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ccf741-7d4b-4211-ad0c-116d3235d90c None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:12.988913 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea1d34-6dfd-4235-9f17-436fb84292ad None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:13.005073 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:13.048386 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 164/324] 10.222.0.70 () {60 vars in 1134 bytes} [Mon Aug 8 17:32:12 2022] POST /identity/v3/groups => generated 226 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:32:13.105327 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea1d34-6dfd-4235-9f17-436fb84292ad None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:13.143670 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa5726-bace-4311-b834-77190950cd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:13.144307 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa5726-bace-4311-b834-77190950cd93 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:13.144586 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa5726-bace-4311-b834-77190950cd93 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:13.144859 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa5726-bace-4311-b834-77190950cd93 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:13.156161 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f00002-91ed-4870-a39f-8ecb806fc97a None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:13.156447 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f00002-91ed-4870-a39f-8ecb806fc97a None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:13.156724 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f00002-91ed-4870-a39f-8ecb806fc97a None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:13.157320 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa5726-bace-4311-b834-77190950cd93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:13.158119 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 165/325] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 17:32:13.162445 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-d7fa5726-bace-4311-b834-77190950cd93 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 17:32:13.162445 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:13.162445 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:13.162445 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:13.162445 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:13.162445 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:13.162445 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:13.162445 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:13.162445 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:13.162445 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:13.162445 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:13.162445 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:13.162445 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:13.162445 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:13.162445 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:13.162445 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:13.164139 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:13.164139 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:13.164139 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:13.164139 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:13.164139 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:13.164139 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:13.164139 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:13.164139 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:13.164139 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:13.164139 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:13.164139 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:13.164139 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:13.164139 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:13.164139 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:13.164139 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:13.164139 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:13.164990 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:13.164990 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:13.164990 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:13.164990 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:13.164990 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:13.164990 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:13.164990 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:13.164990 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:13.164990 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:13.164990 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:13.164990 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 17:32:13.164990 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:13.165727 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c2573-9cf1-4fff-b0fb-1c4cb821b078 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:13.165727 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c2573-9cf1-4fff-b0fb-1c4cb821b078 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:13.165860 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 161/326] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:32:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:32:13.165938 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c2573-9cf1-4fff-b0fb-1c4cb821b078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:13.170042 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa5726-bace-4311-b834-77190950cd93 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:13.186215 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-e35c2573-9cf1-4fff-b0fb-1c4cb821b078 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:13.187690 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-e35c2573-9cf1-4fff-b0fb-1c4cb821b078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:13.211297 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:13.254873 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:13.265874 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 166/327] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 17:32:13.287632 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa5726-bace-4311-b834-77190950cd93 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:13.289342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c2573-9cf1-4fff-b0fb-1c4cb821b078 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:13.335658 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720b2a4-4842-4352-bb85-1e23642e436d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:13.337223 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720b2a4-4842-4352-bb85-1e23642e436d None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:13.337516 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720b2a4-4842-4352-bb85-1e23642e436d None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:13.337795 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720b2a4-4842-4352-bb85-1e23642e436d None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:13.338473 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720b2a4-4842-4352-bb85-1e23642e436d None admin] RBAC: Adding query filter params (name=reader) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:13.338774 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720b2a4-4842-4352-bb85-1e23642e436d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:13.340173 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720b2a4-4842-4352-bb85-1e23642e436d None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:13.352125 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 162/328] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 8 17:32:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:32:13.357562 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720b2a4-4842-4352-bb85-1e23642e436d None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:13.422596 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c2573-9cf1-4fff-b0fb-1c4cb821b078 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:13.461321 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae7791-1337-48f3-98a7-71443d216c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:13.461523 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae7791-1337-48f3-98a7-71443d216c05 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:13.461923 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae7791-1337-48f3-98a7-71443d216c05 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:13.462026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae7791-1337-48f3-98a7-71443d216c05 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:13.482255 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ae7791-1337-48f3-98a7-71443d216c05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:13.489105 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-74ae7791-1337-48f3-98a7-71443d216c05 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 17:32:13.489105 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:13.489105 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:13.489105 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:13.489105 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:13.489105 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:13.489105 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:13.489105 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:13.489105 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:13.489105 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:13.489105 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:13.489105 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:13.489105 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:13.489105 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:13.489105 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:13.489105 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:13.490053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:13.490053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:13.490053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:13.490053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:13.490053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:13.490053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:13.490053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:13.490053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:13.490053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:13.490053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:13.490053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:13.490053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:13.490053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:13.490053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:13.490053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:13.490053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:13.490875 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:13.490875 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:13.490875 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:13.490875 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:13.490875 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:13.490875 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:13.490875 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:13.490875 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:13.490875 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:13.490875 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:13.490875 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 17:32:13.490875 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:13.490875 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 167/329] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:32:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:13.494494 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae7791-1337-48f3-98a7-71443d216c05 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:13.507924 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720b2a4-4842-4352-bb85-1e23642e436d None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:13.519629 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:13.554623 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbaea53-f965-4270-a006-5cb454a7f178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:13.555253 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbaea53-f965-4270-a006-5cb454a7f178 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:13.555537 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbaea53-f965-4270-a006-5cb454a7f178 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:13.555813 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbaea53-f965-4270-a006-5cb454a7f178 None admin] PATH_INFO: `/v3/users/edc167f5482248feba1982e55cc47f6a` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:13.557185 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbaea53-f965-4270-a006-5cb454a7f178 None admin] RBAC: Authorizing `identity:get_user(user_id=edc167f5482248feba1982e55cc47f6a)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:13.558708 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbaea53-f965-4270-a006-5cb454a7f178 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:13.565063 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 163/330] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:32:13 2022] GET /identity/v3/users/edc167f5482248feba1982e55cc47f6a => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:13.566285 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbaea53-f965-4270-a006-5cb454a7f178 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:13.569239 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:13.637609 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae7791-1337-48f3-98a7-71443d216c05 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:13.690761 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6cd45a-37fc-49fd-a6a4-a5f7ee48a5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:13.692321 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6cd45a-37fc-49fd-a6a4-a5f7ee48a5a9 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:13.693087 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6cd45a-37fc-49fd-a6a4-a5f7ee48a5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:13.693564 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6cd45a-37fc-49fd-a6a4-a5f7ee48a5a9 None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:13.694683 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6cd45a-37fc-49fd-a6a4-a5f7ee48a5a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:13.696219 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6cd45a-37fc-49fd-a6a4-a5f7ee48a5a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:13.697960 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6cd45a-37fc-49fd-a6a4-a5f7ee48a5a9 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:13.709532 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 168/331] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 8 17:32:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:32:13.718280 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6cd45a-37fc-49fd-a6a4-a5f7ee48a5a9 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:13.720664 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbaea53-f965-4270-a006-5cb454a7f178 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:13.771017 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab67c00-8482-4b5d-bcd8-37dc08fbb583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:13.771794 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab67c00-8482-4b5d-bcd8-37dc08fbb583 None admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:13.772072 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab67c00-8482-4b5d-bcd8-37dc08fbb583 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:13.772461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab67c00-8482-4b5d-bcd8-37dc08fbb583 None admin] PATH_INFO: `/v3/system/users/edc167f5482248feba1982e55cc47f6a/roles/ff9689d3969d49a19db320a3514ddb56` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:13.774615 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab67c00-8482-4b5d-bcd8-37dc08fbb583 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=edc167f5482248feba1982e55cc47f6a, role_id=ff9689d3969d49a19db320a3514ddb56)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:13.776904 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab67c00-8482-4b5d-bcd8-37dc08fbb583 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:13.832862 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:13.856332 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6cd45a-37fc-49fd-a6a4-a5f7ee48a5a9 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:13.863374 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 164/332] 10.222.0.70 () {58 vars in 1334 bytes} [Mon Aug 8 17:32:13 2022] PUT /identity/v3/system/users/edc167f5482248feba1982e55cc47f6a/roles/ff9689d3969d49a19db320a3514ddb56 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:32:13.901443 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477e315-b686-4271-9dc9-c79f98c23a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:13.902089 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477e315-b686-4271-9dc9-c79f98c23a9b None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:13.902373 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477e315-b686-4271-9dc9-c79f98c23a9b None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:13.902644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477e315-b686-4271-9dc9-c79f98c23a9b None admin] PATH_INFO: `/v3/users/0668293df09f402999a1e300a3a4a7ab` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:13.910038 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477e315-b686-4271-9dc9-c79f98c23a9b None admin] RBAC: Authorizing `identity:get_user(user_id=0668293df09f402999a1e300a3a4a7ab)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:13.911532 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477e315-b686-4271-9dc9-c79f98c23a9b None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:13.913283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 169/333] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:32:13 2022] GET /identity/v3/users/0668293df09f402999a1e300a3a4a7ab => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:13.919736 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab67c00-8482-4b5d-bcd8-37dc08fbb583 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:14.008520 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:14.055139 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab67c00-8482-4b5d-bcd8-37dc08fbb583 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:14.109854 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4b0b8-dcc4-4e50-bac3-57b2e2462a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:14.110480 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4b0b8-dcc4-4e50-bac3-57b2e2462a15 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:14.110762 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4b0b8-dcc4-4e50-bac3-57b2e2462a15 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:14.111035 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4b0b8-dcc4-4e50-bac3-57b2e2462a15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:14.112026 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4b0b8-dcc4-4e50-bac3-57b2e2462a15 None admin] RBAC: Adding query filter params (role.id=adc45cdd4c9543b3b8b24141870f4b11, user.id=0668293df09f402999a1e300a3a4a7ab, scope.system=all) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:14.112335 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4b0b8-dcc4-4e50-bac3-57b2e2462a15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:14.113823 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4b0b8-dcc4-4e50-bac3-57b2e2462a15 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:14.134875 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 165/334] 10.222.0.70 () {56 vars in 1308 bytes} [Mon Aug 8 17:32:13 2022] GET /identity/v3/role_assignments?user.id=0668293df09f402999a1e300a3a4a7ab&scope.system=all&role.id=adc45cdd4c9543b3b8b24141870f4b11 => generated 510 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:16.163069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4a860-6416-4fcf-b672-1da7f3e25391 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:16.164240 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4a860-6416-4fcf-b672-1da7f3e25391 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:16.164240 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4a860-6416-4fcf-b672-1da7f3e25391 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:16.165780 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 170/335] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:16.182938 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be5a2c-55a0-4f45-8b8a-5820bac9da95 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:16.183432 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be5a2c-55a0-4f45-8b8a-5820bac9da95 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:16.183508 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be5a2c-55a0-4f45-8b8a-5820bac9da95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:16.218088 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-48be5a2c-55a0-4f45-8b8a-5820bac9da95 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:16.219325 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-48be5a2c-55a0-4f45-8b8a-5820bac9da95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:16.338475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 166/336] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:16.341016 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b611e15-7515-400b-bd22-7fdf2c96ac26 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:16.341326 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b611e15-7515-400b-bd22-7fdf2c96ac26 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:16.341599 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b611e15-7515-400b-bd22-7fdf2c96ac26 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:16.343004 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 171/337] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:16.363274 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb190c8-a47c-4566-a9f0-c993e08f8bfb None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:16.363557 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb190c8-a47c-4566-a9f0-c993e08f8bfb None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:16.363816 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb190c8-a47c-4566-a9f0-c993e08f8bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:16.382634 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b611e15-7515-400b-bd22-7fdf2c96ac26 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:16.407575 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-9cb190c8-a47c-4566-a9f0-c993e08f8bfb None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:16.408805 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-9cb190c8-a47c-4566-a9f0-c993e08f8bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:16.510886 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:16.548485 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 167/338] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:16.595862 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb190c8-a47c-4566-a9f0-c993e08f8bfb None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:16.617007 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b611e15-7515-400b-bd22-7fdf2c96ac26 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:16.677057 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec126b5-94b7-4dd8-94dd-6498d1a5297b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:16.677057 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec126b5-94b7-4dd8-94dd-6498d1a5297b None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:16.677057 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec126b5-94b7-4dd8-94dd-6498d1a5297b None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:16.677057 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec126b5-94b7-4dd8-94dd-6498d1a5297b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:16.691798 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec126b5-94b7-4dd8-94dd-6498d1a5297b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:16.699390 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-1ec126b5-94b7-4dd8-94dd-6498d1a5297b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 17:32:16.699390 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:16.699390 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:16.699390 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:16.699390 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:16.699390 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:16.699390 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:16.699390 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:16.699390 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:16.699390 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:16.699390 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:16.699390 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:16.699390 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:16.699390 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:16.699390 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:16.699390 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:16.700363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:16.700363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:16.700363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:16.700363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:16.700363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:16.700363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:16.700363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:16.700363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:16.700363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:16.700363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:16.700363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:16.700363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:16.700363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:16.700363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:16.700363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:16.700363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:16.701228 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:16.701228 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:16.701228 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:16.701228 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:16.701228 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:16.701228 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:16.701228 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:16.701228 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:16.701228 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:16.701228 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:16.701228 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 17:32:16.701228 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:16.701228 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 172/339] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:32:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:16.711736 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec126b5-94b7-4dd8-94dd-6498d1a5297b None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:16.737409 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:16.778590 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb190c8-a47c-4566-a9f0-c993e08f8bfb None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:16.847496 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81502bd-767d-43db-b731-1abb3f77d224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:16.848371 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81502bd-767d-43db-b731-1abb3f77d224 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:16.848933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81502bd-767d-43db-b731-1abb3f77d224 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:16.849389 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81502bd-767d-43db-b731-1abb3f77d224 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:16.854165 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec126b5-94b7-4dd8-94dd-6498d1a5297b None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:16.866737 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81502bd-767d-43db-b731-1abb3f77d224 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:16.876920 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-b81502bd-767d-43db-b731-1abb3f77d224 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 17:32:16.876920 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:16.876920 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:16.876920 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:16.876920 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:16.876920 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:16.876920 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:16.876920 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:16.876920 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:16.876920 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:16.876920 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:16.876920 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:16.876920 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:16.876920 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:16.876920 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:16.876920 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:16.877923 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:16.877923 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:16.877923 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:16.877923 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:16.877923 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:16.877923 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:16.877923 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:16.877923 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:16.877923 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:16.877923 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:16.877923 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:16.877923 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:16.877923 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:16.877923 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:16.877923 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:16.877923 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:16.878753 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:16.878753 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:16.878753 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:16.878753 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:16.878753 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:16.878753 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:16.878753 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:16.878753 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:16.878753 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:16.878753 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:16.878753 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 17:32:16.878753 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:16.881371 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 168/340] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 8 17:32:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:16.883665 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b589c-72dc-45b6-a11b-985fa6088ede None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:16.884187 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b589c-72dc-45b6-a11b-985fa6088ede None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:16.884652 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b589c-72dc-45b6-a11b-985fa6088ede None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:16.890802 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 169/341] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:16.891795 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b589c-72dc-45b6-a11b-985fa6088ede None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:16.911315 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6641c7-6ca1-4c0c-b15e-23a959c74c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:16.911839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6641c7-6ca1-4c0c-b15e-23a959c74c26 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:16.912130 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6641c7-6ca1-4c0c-b15e-23a959c74c26 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:16.912406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6641c7-6ca1-4c0c-b15e-23a959c74c26 None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:16.913147 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6641c7-6ca1-4c0c-b15e-23a959c74c26 None admin] RBAC: Adding query filter params (name=member) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:16.913953 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6641c7-6ca1-4c0c-b15e-23a959c74c26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:16.915410 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6641c7-6ca1-4c0c-b15e-23a959c74c26 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:16.933308 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 173/342] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 8 17:32:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:16.934907 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2957d-d944-4987-be4a-f36fb8cfe5c3 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:16.935385 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2957d-d944-4987-be4a-f36fb8cfe5c3 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:16.935876 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2957d-d944-4987-be4a-f36fb8cfe5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:16.965466 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:16.980601 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-31f2957d-d944-4987-be4a-f36fb8cfe5c3 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:16.983408 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-31f2957d-d944-4987-be4a-f36fb8cfe5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:17.105989 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:17.108182 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b589c-72dc-45b6-a11b-985fa6088ede None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:17.121054 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 174/343] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:17.121413 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2957d-d944-4987-be4a-f36fb8cfe5c3 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:17.186825 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4083394-0792-474e-a478-5601b6484a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:17.188931 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4083394-0792-474e-a478-5601b6484a85 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:17.189308 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4083394-0792-474e-a478-5601b6484a85 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:17.189522 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4083394-0792-474e-a478-5601b6484a85 None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:17.191927 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4083394-0792-474e-a478-5601b6484a85 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:17.192190 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4083394-0792-474e-a478-5601b6484a85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:17.193656 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4083394-0792-474e-a478-5601b6484a85 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:17.204886 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 170/344] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:32:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:17.206983 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4083394-0792-474e-a478-5601b6484a85 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:17.411022 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4083394-0792-474e-a478-5601b6484a85 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:17.418843 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2957d-d944-4987-be4a-f36fb8cfe5c3 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:17.425746 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:17.483171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141f2cb-6fea-4a1f-8787-0108de56fe11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:17.484568 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141f2cb-6fea-4a1f-8787-0108de56fe11 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:17.484568 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141f2cb-6fea-4a1f-8787-0108de56fe11 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:17.484568 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141f2cb-6fea-4a1f-8787-0108de56fe11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:17.503880 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56ba51-1548-4e30-afef-2c80b3e58305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:17.504528 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56ba51-1548-4e30-afef-2c80b3e58305 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:17.504806 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56ba51-1548-4e30-afef-2c80b3e58305 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:17.505655 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56ba51-1548-4e30-afef-2c80b3e58305 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:17.520019 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56ba51-1548-4e30-afef-2c80b3e58305 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:17.526234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-fc56ba51-1548-4e30-afef-2c80b3e58305 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 17:32:17.526234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:17.526234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:17.526234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:17.526234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:17.526234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:17.526234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:17.526234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:17.526234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:17.526234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:17.526234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:17.526234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:17.526234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:17.526234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:17.526234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:17.526234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:17.527243 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:17.527243 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:17.527243 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:17.527243 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:17.527243 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:17.527243 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:17.527243 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:17.527243 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:17.527243 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:17.527243 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:17.527243 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:17.527243 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:17.527243 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:17.527243 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:17.527243 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:17.527243 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:17.528084 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:17.528084 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:17.528084 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:17.528084 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:17.528084 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:17.528084 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:17.528084 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:17.528084 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:17.528084 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:17.528084 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:17.528084 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 17:32:17.528084 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:17.528084 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 171/345] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:32:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:17.529281 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56ba51-1548-4e30-afef-2c80b3e58305 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:17.564281 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:17.568614 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141f2cb-6fea-4a1f-8787-0108de56fe11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:17.570828 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141f2cb-6fea-4a1f-8787-0108de56fe11 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:17.667783 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56ba51-1548-4e30-afef-2c80b3e58305 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:17.704025 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 175/346] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:32:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:32:17.704025 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c448bc-6f7e-4196-b6cf-68092cd7004f None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:17.704025 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c448bc-6f7e-4196-b6cf-68092cd7004f None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:17.704025 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c448bc-6f7e-4196-b6cf-68092cd7004f None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:17.705352 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 176/347] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:17.706898 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c448bc-6f7e-4196-b6cf-68092cd7004f None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:17.725058 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23905d-d1bd-43b7-9179-1b97738d8e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:17.725058 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23905d-d1bd-43b7-9179-1b97738d8e70 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:17.725058 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23905d-d1bd-43b7-9179-1b97738d8e70 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:17.725058 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23905d-d1bd-43b7-9179-1b97738d8e70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:17.792511 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:17.847591 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23905d-d1bd-43b7-9179-1b97738d8e70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:17.849808 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23905d-d1bd-43b7-9179-1b97738d8e70 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:17.849920 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:17.860202 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c448bc-6f7e-4196-b6cf-68092cd7004f None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:17.909829 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f1ae1-2f88-4a8c-b99d-bb0492f16591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:17.910549 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f1ae1-2f88-4a8c-b99d-bb0492f16591 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:17.912552 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f1ae1-2f88-4a8c-b99d-bb0492f16591 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:17.912552 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f1ae1-2f88-4a8c-b99d-bb0492f16591 None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:17.912552 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f1ae1-2f88-4a8c-b99d-bb0492f16591 None admin] RBAC: Adding query filter params (name=member) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:17.912552 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f1ae1-2f88-4a8c-b99d-bb0492f16591 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:17.914375 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f1ae1-2f88-4a8c-b99d-bb0492f16591 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:17.925327 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 177/348] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 8 17:32:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:17.930764 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f1ae1-2f88-4a8c-b99d-bb0492f16591 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:18.003148 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 172/349] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:32:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:32:18.011224 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1a997-87ef-44fc-b0c9-95eff9e0d651 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:18.011224 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1a997-87ef-44fc-b0c9-95eff9e0d651 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:18.011224 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1a997-87ef-44fc-b0c9-95eff9e0d651 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:18.013992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 173/350] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:18.015128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c104d-d6fb-421b-8945-a6d0fd9fcd40 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:18.015417 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c104d-d6fb-421b-8945-a6d0fd9fcd40 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:18.015692 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c104d-d6fb-421b-8945-a6d0fd9fcd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:18.042657 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-826c104d-d6fb-421b-8945-a6d0fd9fcd40 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:18.043232 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-826c104d-d6fb-421b-8945-a6d0fd9fcd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:18.088700 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f1ae1-2f88-4a8c-b99d-bb0492f16591 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:18.137069 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:18.137396 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd448f91-4d59-499d-8d35-e17b5b7d22c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:18.138044 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd448f91-4d59-499d-8d35-e17b5b7d22c4 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:18.140887 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd448f91-4d59-499d-8d35-e17b5b7d22c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:18.141226 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd448f91-4d59-499d-8d35-e17b5b7d22c4 None admin] PATH_INFO: `/v3/projects/dbe071067d79437b8969c9883cc256df` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:18.142573 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd448f91-4d59-499d-8d35-e17b5b7d22c4 None admin] RBAC: Authorizing `identity:get_project(project_id=dbe071067d79437b8969c9883cc256df)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:18.144033 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd448f91-4d59-499d-8d35-e17b5b7d22c4 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:18.146377 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 178/351] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:32:17 2022] GET /identity/v3/projects/dbe071067d79437b8969c9883cc256df => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:18.146513 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 174/352] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:18.146890 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c104d-d6fb-421b-8945-a6d0fd9fcd40 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:18.152709 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb99b3-3157-4097-aa7e-c136413fc02a None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:18.152709 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb99b3-3157-4097-aa7e-c136413fc02a None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:18.152709 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb99b3-3157-4097-aa7e-c136413fc02a None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:18.152709 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 179/353] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:18.161484 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb99b3-3157-4097-aa7e-c136413fc02a None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:18.215250 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:18.304531 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c104d-d6fb-421b-8945-a6d0fd9fcd40 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:18.328383 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb99b3-3157-4097-aa7e-c136413fc02a None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:18.361512 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687b62c-c8bb-4bc1-848d-df82d948bc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:18.362138 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687b62c-c8bb-4bc1-848d-df82d948bc04 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:18.362416 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687b62c-c8bb-4bc1-848d-df82d948bc04 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:18.362682 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687b62c-c8bb-4bc1-848d-df82d948bc04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:18.394132 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b43bd0-33dd-47be-b3b4-01ad9c4c867f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:18.394782 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b43bd0-33dd-47be-b3b4-01ad9c4c867f None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:18.395066 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b43bd0-33dd-47be-b3b4-01ad9c4c867f None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:18.395390 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b43bd0-33dd-47be-b3b4-01ad9c4c867f None admin] PATH_INFO: `/v3/projects/dbe071067d79437b8969c9883cc256df` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:18.396595 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b43bd0-33dd-47be-b3b4-01ad9c4c867f None admin] RBAC: Authorizing `identity:get_project(project_id=dbe071067d79437b8969c9883cc256df)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:18.398202 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b43bd0-33dd-47be-b3b4-01ad9c4c867f None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:18.401223 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 180/354] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:32:18 2022] GET /identity/v3/projects/dbe071067d79437b8969c9883cc256df => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:18.403720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f09c8-30bd-441d-bacd-6a2f60300e55 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:18.403720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f09c8-30bd-441d-bacd-6a2f60300e55 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:18.403720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f09c8-30bd-441d-bacd-6a2f60300e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:18.428402 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-ff0f09c8-30bd-441d-bacd-6a2f60300e55 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:18.429219 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-ff0f09c8-30bd-441d-bacd-6a2f60300e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:18.467304 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:18.479981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6687b62c-c8bb-4bc1-848d-df82d948bc04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:18.487074 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6687b62c-c8bb-4bc1-848d-df82d948bc04 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:18.545478 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 181/355] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:18.546588 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f09c8-30bd-441d-bacd-6a2f60300e55 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:18.584607 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:18.626489 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 175/356] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:32:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:32:18.627917 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664a93c-0a23-4dd5-ba48-c81142aebe0b None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:18.632896 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664a93c-0a23-4dd5-ba48-c81142aebe0b None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:18.633565 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664a93c-0a23-4dd5-ba48-c81142aebe0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:18.658126 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-c664a93c-0a23-4dd5-ba48-c81142aebe0b None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:18.659340 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-c664a93c-0a23-4dd5-ba48-c81142aebe0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:18.711658 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f09c8-30bd-441d-bacd-6a2f60300e55 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:18.765602 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 176/357] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:18.766501 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664a93c-0a23-4dd5-ba48-c81142aebe0b None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:18.771969 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf046f-bee3-4b6d-aa37-f7da06a6c1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:18.773408 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf046f-bee3-4b6d-aa37-f7da06a6c1ce None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:18.773781 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf046f-bee3-4b6d-aa37-f7da06a6c1ce None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:18.774059 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf046f-bee3-4b6d-aa37-f7da06a6c1ce None admin] PATH_INFO: `/v3/groups/43d0f79c969c4a9689c32145518b100d` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:18.787928 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cf046f-bee3-4b6d-aa37-f7da06a6c1ce None admin] RBAC: Authorizing `identity:get_group(group_id=43d0f79c969c4a9689c32145518b100d)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:18.789616 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cf046f-bee3-4b6d-aa37-f7da06a6c1ce None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:18.791572 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 182/358] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Aug 8 17:32:18 2022] GET /identity/v3/groups/43d0f79c969c4a9689c32145518b100d => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:18.792285 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf046f-bee3-4b6d-aa37-f7da06a6c1ce None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:18.805658 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:18.921302 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664a93c-0a23-4dd5-ba48-c81142aebe0b None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:18.940451 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:18.954238 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf046f-bee3-4b6d-aa37-f7da06a6c1ce None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:18.980769 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759530f-981c-4aaf-b014-9fb0f5cbbabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:18.981435 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759530f-981c-4aaf-b014-9fb0f5cbbabe None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:18.981709 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759530f-981c-4aaf-b014-9fb0f5cbbabe None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:18.981975 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759530f-981c-4aaf-b014-9fb0f5cbbabe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:18.994390 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759530f-981c-4aaf-b014-9fb0f5cbbabe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:18.999265 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-b759530f-981c-4aaf-b014-9fb0f5cbbabe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 17:32:18.999265 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:18.999265 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:18.999265 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:18.999265 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:18.999265 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:18.999265 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:18.999265 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:18.999265 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:18.999265 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:18.999265 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:18.999265 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:18.999265 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:18.999265 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:18.999265 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:18.999265 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:19.000241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:19.000241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:19.000241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:19.000241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:19.000241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:19.000241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:19.000241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:19.000241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:19.000241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:19.000241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:19.000241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:19.000241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:19.000241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:19.000241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:19.000241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:19.000241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:19.001156 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:19.001156 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:19.001156 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:19.001156 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:19.001156 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:19.001156 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:19.001156 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:19.001156 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:19.001156 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:19.001156 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:19.001156 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 17:32:19.001156 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:19.001886 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24fa8f-5b0e-4288-863c-7c88222087a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:19.001886 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24fa8f-5b0e-4288-863c-7c88222087a1 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:19.001886 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24fa8f-5b0e-4288-863c-7c88222087a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:19.001886 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24fa8f-5b0e-4288-863c-7c88222087a1 None admin] PATH_INFO: `/v3/groups/43d0f79c969c4a9689c32145518b100d` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:19.003363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24fa8f-5b0e-4288-863c-7c88222087a1 None admin] RBAC: Authorizing `identity:get_group(group_id=43d0f79c969c4a9689c32145518b100d)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:19.004916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24fa8f-5b0e-4288-863c-7c88222087a1 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:19.005308 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 177/359] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:32:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:19.006040 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759530f-981c-4aaf-b014-9fb0f5cbbabe None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:19.009175 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 183/360] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Aug 8 17:32:18 2022] GET /identity/v3/groups/43d0f79c969c4a9689c32145518b100d => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:19.009175 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24fa8f-5b0e-4288-863c-7c88222087a1 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:19.113393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:19.122115 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24fa8f-5b0e-4288-863c-7c88222087a1 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:19.131673 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759530f-981c-4aaf-b014-9fb0f5cbbabe None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:19.160511 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14664894-e21c-413a-a778-42c7758b1aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:19.161472 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14664894-e21c-413a-a778-42c7758b1aed None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:19.161759 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14664894-e21c-413a-a778-42c7758b1aed None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:19.162035 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14664894-e21c-413a-a778-42c7758b1aed None admin] PATH_INFO: `/v3/projects/91b9959e38d042f2a5aa8e5757e79251` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:19.163779 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14664894-e21c-413a-a778-42c7758b1aed None admin] RBAC: Authorizing `identity:get_project(project_id=91b9959e38d042f2a5aa8e5757e79251)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:19.165489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14664894-e21c-413a-a778-42c7758b1aed None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:19.167426 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 184/361] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:32:19 2022] GET /identity/v3/projects/91b9959e38d042f2a5aa8e5757e79251 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:19.169329 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f7dba-3a85-4090-8c97-0add3698b0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:19.169963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f7dba-3a85-4090-8c97-0add3698b0b8 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:19.170248 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f7dba-3a85-4090-8c97-0add3698b0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:19.170519 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f7dba-3a85-4090-8c97-0add3698b0b8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:19.172702 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14664894-e21c-413a-a778-42c7758b1aed None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:19.181777 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f7dba-3a85-4090-8c97-0add3698b0b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:19.186494 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-059f7dba-3a85-4090-8c97-0add3698b0b8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 17:32:19.186494 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:19.186494 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:19.186494 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:19.186494 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:19.186494 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:19.186494 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:19.186494 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:19.186494 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:19.186494 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:19.186494 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:19.186494 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:19.186494 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:19.186494 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:19.186494 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:19.186494 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:19.187427 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:19.187427 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:19.187427 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:19.187427 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:19.187427 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:19.187427 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:19.187427 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:19.187427 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:19.187427 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:19.187427 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:19.187427 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:19.187427 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:19.187427 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:19.187427 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:19.187427 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:19.187427 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:19.190389 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:19.190389 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:19.190389 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:19.190389 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:19.190389 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:19.190389 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:19.190389 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:19.190389 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:19.190389 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:19.190389 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:19.190389 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 17:32:19.190389 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:19.190389 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 178/362] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 8 17:32:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:19.190389 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f7dba-3a85-4090-8c97-0add3698b0b8 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:19.208464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:19.291267 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14664894-e21c-413a-a778-42c7758b1aed None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:19.299035 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f7dba-3a85-4090-8c97-0add3698b0b8 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:19.328078 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a403c6e4-71fb-419e-ac83-50546cc49fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:19.328722 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403c6e4-71fb-419e-ac83-50546cc49fdb None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:19.329005 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403c6e4-71fb-419e-ac83-50546cc49fdb None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:19.329363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403c6e4-71fb-419e-ac83-50546cc49fdb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:19.334503 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302448cf-7a39-44b3-b902-356af8bd0b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:19.335661 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302448cf-7a39-44b3-b902-356af8bd0b06 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:19.335937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302448cf-7a39-44b3-b902-356af8bd0b06 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:19.336208 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302448cf-7a39-44b3-b902-356af8bd0b06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:19.336992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302448cf-7a39-44b3-b902-356af8bd0b06 None admin] RBAC: Adding query filter params (group.id=43d0f79c969c4a9689c32145518b100d, role.id=adc45cdd4c9543b3b8b24141870f4b11, scope.project.id=dbe071067d79437b8969c9883cc256df) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:19.337299 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302448cf-7a39-44b3-b902-356af8bd0b06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:19.338748 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302448cf-7a39-44b3-b902-356af8bd0b06 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:19.341775 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a403c6e4-71fb-419e-ac83-50546cc49fdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:19.344699 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 179/363] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Aug 8 17:32:19 2022] GET /identity/v3/role_assignments?group.id=43d0f79c969c4a9689c32145518b100d&scope.project.id=dbe071067d79437b8969c9883cc256df&role.id=adc45cdd4c9543b3b8b24141870f4b11 => generated 260 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:19.345697 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302448cf-7a39-44b3-b902-356af8bd0b06 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:19.346994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-a403c6e4-71fb-419e-ac83-50546cc49fdb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:32:19.346994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:19.346994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:19.346994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:19.346994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:19.346994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:19.346994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:19.346994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:19.346994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:19.346994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:19.346994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:19.346994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:19.346994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:19.346994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:19.346994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:19.346994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:19.347939 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:19.347939 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:19.347939 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:19.347939 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:19.347939 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:19.347939 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:19.347939 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:19.347939 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:19.347939 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:19.347939 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:19.347939 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:19.347939 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:19.347939 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:19.347939 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:19.347939 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:19.347939 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:19.348804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:19.348804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:19.348804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:19.348804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:19.348804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:19.348804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:19.348804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:19.348804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:19.348804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:19.348804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:19.348804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:32:19.348804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:19.348804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 185/364] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 8 17:32:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:19.349565 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a403c6e4-71fb-419e-ac83-50546cc49fdb None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:19.377780 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:19.478303 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:19.500755 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a403c6e4-71fb-419e-ac83-50546cc49fdb None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:19.540825 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302448cf-7a39-44b3-b902-356af8bd0b06 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:19.541006 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c64f74-465f-4e22-9923-fc0a8063c212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:19.541006 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c64f74-465f-4e22-9923-fc0a8063c212 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:19.541006 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c64f74-465f-4e22-9923-fc0a8063c212 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:19.541006 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c64f74-465f-4e22-9923-fc0a8063c212 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:19.541660 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c64f74-465f-4e22-9923-fc0a8063c212 None admin] RBAC: Adding query filter params (group.id=43d0f79c969c4a9689c32145518b100d, role.id=0ff11803573b472ab020a59b7f452dcd, scope.project.id=dbe071067d79437b8969c9883cc256df) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:19.541972 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c64f74-465f-4e22-9923-fc0a8063c212 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:19.543524 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c64f74-465f-4e22-9923-fc0a8063c212 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:19.561064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 186/365] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Aug 8 17:32:19 2022] GET /identity/v3/role_assignments?group.id=43d0f79c969c4a9689c32145518b100d&scope.project.id=dbe071067d79437b8969c9883cc256df&role.id=0ff11803573b472ab020a59b7f452dcd => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:19.561064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c64f74-465f-4e22-9923-fc0a8063c212 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:19.578799 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266caa5-8d24-486a-8247-913ac9c070bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:19.579488 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266caa5-8d24-486a-8247-913ac9c070bb None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:19.579768 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266caa5-8d24-486a-8247-913ac9c070bb None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:19.580033 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266caa5-8d24-486a-8247-913ac9c070bb None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:19.585434 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266caa5-8d24-486a-8247-913ac9c070bb None admin] RBAC: Adding query filter params (name=reader) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:19.585434 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266caa5-8d24-486a-8247-913ac9c070bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:19.585434 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266caa5-8d24-486a-8247-913ac9c070bb None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:19.592977 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 180/366] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 8 17:32:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:19.593882 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266caa5-8d24-486a-8247-913ac9c070bb None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:19.706309 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:19.721496 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c64f74-465f-4e22-9923-fc0a8063c212 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:19.761070 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266caa5-8d24-486a-8247-913ac9c070bb None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:19.806884 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993973c-c954-4d57-9365-81daca856db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:19.807512 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993973c-c954-4d57-9365-81daca856db7 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:19.807794 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993973c-c954-4d57-9365-81daca856db7 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:19.808073 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993973c-c954-4d57-9365-81daca856db7 None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:19.808747 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8993973c-c954-4d57-9365-81daca856db7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:19.809070 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8993973c-c954-4d57-9365-81daca856db7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:19.810485 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8993973c-c954-4d57-9365-81daca856db7 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:19.811388 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abfff8-de2e-4625-8386-2ee696dff64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:19.812261 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abfff8-de2e-4625-8386-2ee696dff64e None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:19.812786 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abfff8-de2e-4625-8386-2ee696dff64e None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:19.813311 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abfff8-de2e-4625-8386-2ee696dff64e None admin] PATH_INFO: `/v3/groups/43d0f79c969c4a9689c32145518b100d` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:19.814757 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05abfff8-de2e-4625-8386-2ee696dff64e None admin] RBAC: Authorizing `identity:get_group(group_id=43d0f79c969c4a9689c32145518b100d)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:19.817856 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05abfff8-de2e-4625-8386-2ee696dff64e None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:19.821264 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 181/367] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:32:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:19.821966 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993973c-c954-4d57-9365-81daca856db7 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:19.823229 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 187/368] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Aug 8 17:32:19 2022] GET /identity/v3/groups/43d0f79c969c4a9689c32145518b100d => generated 226 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:19.823871 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abfff8-de2e-4625-8386-2ee696dff64e None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:19.865145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:19.972917 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993973c-c954-4d57-9365-81daca856db7 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:20.012698 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abfff8-de2e-4625-8386-2ee696dff64e None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:20.014527 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafeceea-a32f-4762-8ea8-13e0c5ef4831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:20.015154 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafeceea-a32f-4762-8ea8-13e0c5ef4831 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:20.015435 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafeceea-a32f-4762-8ea8-13e0c5ef4831 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:20.015738 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafeceea-a32f-4762-8ea8-13e0c5ef4831 None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:20.016376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafeceea-a32f-4762-8ea8-13e0c5ef4831 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:20.016765 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafeceea-a32f-4762-8ea8-13e0c5ef4831 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:20.018737 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafeceea-a32f-4762-8ea8-13e0c5ef4831 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:20.022114 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:20.029698 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 182/369] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:32:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:20.036173 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafeceea-a32f-4762-8ea8-13e0c5ef4831 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:20.075585 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ade50-89d1-4dad-ba97-a2e9f6a1ee9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:20.077385 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ade50-89d1-4dad-ba97-a2e9f6a1ee9f None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:20.077385 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ade50-89d1-4dad-ba97-a2e9f6a1ee9f None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:20.077385 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ade50-89d1-4dad-ba97-a2e9f6a1ee9f None admin] PATH_INFO: `/v3/users/edc167f5482248feba1982e55cc47f6a` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:20.080870 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ade50-89d1-4dad-ba97-a2e9f6a1ee9f None admin] RBAC: Authorizing `identity:get_user(user_id=edc167f5482248feba1982e55cc47f6a)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:20.082116 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ade50-89d1-4dad-ba97-a2e9f6a1ee9f None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:20.084796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 188/370] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:32:19 2022] GET /identity/v3/users/edc167f5482248feba1982e55cc47f6a => generated 293 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:20.084796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ade50-89d1-4dad-ba97-a2e9f6a1ee9f None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:20.215665 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafeceea-a32f-4762-8ea8-13e0c5ef4831 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:20.240611 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:20.262561 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ade50-89d1-4dad-ba97-a2e9f6a1ee9f None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:20.295002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2cf5e0-6e65-4d0d-9ab4-78bccf4e657a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:20.295002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2cf5e0-6e65-4d0d-9ab4-78bccf4e657a None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:20.295002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2cf5e0-6e65-4d0d-9ab4-78bccf4e657a None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:20.295002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2cf5e0-6e65-4d0d-9ab4-78bccf4e657a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:20.311241 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c3fce-8941-492c-9ba6-410b386a2236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:20.311729 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c3fce-8941-492c-9ba6-410b386a2236 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:20.312114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c3fce-8941-492c-9ba6-410b386a2236 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:20.312600 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c3fce-8941-492c-9ba6-410b386a2236 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:20.313474 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c3fce-8941-492c-9ba6-410b386a2236 None admin] RBAC: Adding query filter params (group.id=43d0f79c969c4a9689c32145518b100d, role.id=adc45cdd4c9543b3b8b24141870f4b11, scope.project.id=91b9959e38d042f2a5aa8e5757e79251) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:20.314034 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c3fce-8941-492c-9ba6-410b386a2236 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:20.315552 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c3fce-8941-492c-9ba6-410b386a2236 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:20.322390 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 189/371] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Aug 8 17:32:20 2022] GET /identity/v3/role_assignments?group.id=43d0f79c969c4a9689c32145518b100d&scope.project.id=91b9959e38d042f2a5aa8e5757e79251&role.id=adc45cdd4c9543b3b8b24141870f4b11 => generated 260 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:20.327914 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c3fce-8941-492c-9ba6-410b386a2236 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:20.470390 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c3fce-8941-492c-9ba6-410b386a2236 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:20.522860 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:20.526012 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db266189-43b6-401c-8258-b781231767da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:20.529057 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db266189-43b6-401c-8258-b781231767da None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:20.529057 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db266189-43b6-401c-8258-b781231767da None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:20.529057 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db266189-43b6-401c-8258-b781231767da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:20.546028 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2cf5e0-6e65-4d0d-9ab4-78bccf4e657a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:20.547877 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2cf5e0-6e65-4d0d-9ab4-78bccf4e657a None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:20.559358 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:20.628586 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db266189-43b6-401c-8258-b781231767da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:20.632205 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db266189-43b6-401c-8258-b781231767da None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:20.763630 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 190/372] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:32:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:32:20.764805 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db266189-43b6-401c-8258-b781231767da None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:20.824965 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:20.828554 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 183/373] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:32:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 798 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:32:20.829915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2cf5e0-6e65-4d0d-9ab4-78bccf4e657a None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:20.883609 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db266189-43b6-401c-8258-b781231767da None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:20.939174 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46c4a1-c658-4f21-b232-19fc62a159be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:20.939796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46c4a1-c658-4f21-b232-19fc62a159be None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:20.940077 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46c4a1-c658-4f21-b232-19fc62a159be None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:20.940350 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46c4a1-c658-4f21-b232-19fc62a159be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:20.941115 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46c4a1-c658-4f21-b232-19fc62a159be None admin] RBAC: Adding query filter params (role.id=ff9689d3969d49a19db320a3514ddb56, user.id=edc167f5482248feba1982e55cc47f6a, scope.system=all) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:20.941435 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46c4a1-c658-4f21-b232-19fc62a159be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:20.942888 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46c4a1-c658-4f21-b232-19fc62a159be None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:20.957581 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 191/374] 10.222.0.70 () {56 vars in 1308 bytes} [Mon Aug 8 17:32:20 2022] GET /identity/v3/role_assignments?user.id=edc167f5482248feba1982e55cc47f6a&scope.system=all&role.id=ff9689d3969d49a19db320a3514ddb56 => generated 510 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:20.958253 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46c4a1-c658-4f21-b232-19fc62a159be None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:21.167244 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46c4a1-c658-4f21-b232-19fc62a159be None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:21.196097 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:21.212911 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:21.235133 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2cf5e0-6e65-4d0d-9ab4-78bccf4e657a None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:21.249612 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311b041-1051-4475-84d5-9a04a4d0b664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:21.250267 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311b041-1051-4475-84d5-9a04a4d0b664 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:21.250549 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311b041-1051-4475-84d5-9a04a4d0b664 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:21.250986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311b041-1051-4475-84d5-9a04a4d0b664 None admin] PATH_INFO: `/v3/projects/91b9959e38d042f2a5aa8e5757e79251` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:21.261057 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c311b041-1051-4475-84d5-9a04a4d0b664 None admin] RBAC: Authorizing `identity:get_project(project_id=91b9959e38d042f2a5aa8e5757e79251)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:21.261057 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c311b041-1051-4475-84d5-9a04a4d0b664 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:21.261057 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 192/375] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:32:20 2022] GET /identity/v3/projects/91b9959e38d042f2a5aa8e5757e79251 => generated 302 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:21.266150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311b041-1051-4475-84d5-9a04a4d0b664 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:21.337056 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca766d-b988-4b28-8c51-ad92311eb02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:21.337056 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca766d-b988-4b28-8c51-ad92311eb02f None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:21.337056 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca766d-b988-4b28-8c51-ad92311eb02f None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:21.337056 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca766d-b988-4b28-8c51-ad92311eb02f None admin] PATH_INFO: `/v3/projects/e8e66549226e41208010bac52754a1ba` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:21.337471 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca766d-b988-4b28-8c51-ad92311eb02f None admin] RBAC: Authorizing `identity:get_project(project_id=e8e66549226e41208010bac52754a1ba)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:21.337914 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca766d-b988-4b28-8c51-ad92311eb02f None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:21.339557 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 184/376] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:32:20 2022] GET /identity/v3/projects/e8e66549226e41208010bac52754a1ba => generated 344 bytes in 510 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:21.353760 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca766d-b988-4b28-8c51-ad92311eb02f None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:21.472878 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311b041-1051-4475-84d5-9a04a4d0b664 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:21.558382 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29cb40-af9b-4b04-8bec-062d2ef36076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:21.559104 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29cb40-af9b-4b04-8bec-062d2ef36076 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:21.561650 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29cb40-af9b-4b04-8bec-062d2ef36076 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:21.561650 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29cb40-af9b-4b04-8bec-062d2ef36076 None admin] PATH_INFO: `/v3/groups/43d0f79c969c4a9689c32145518b100d` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:21.561650 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29cb40-af9b-4b04-8bec-062d2ef36076 None admin] RBAC: Authorizing `identity:get_group(group_id=43d0f79c969c4a9689c32145518b100d)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:21.562176 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29cb40-af9b-4b04-8bec-062d2ef36076 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:21.565619 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 193/377] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Aug 8 17:32:21 2022] GET /identity/v3/groups/43d0f79c969c4a9689c32145518b100d => generated 226 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:21.568715 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca766d-b988-4b28-8c51-ad92311eb02f None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:21.571086 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29cb40-af9b-4b04-8bec-062d2ef36076 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:21.657796 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e191915-95c7-4b26-8907-3eccb53a226b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:21.658761 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e191915-95c7-4b26-8907-3eccb53a226b None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:21.659186 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e191915-95c7-4b26-8907-3eccb53a226b None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:21.659606 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e191915-95c7-4b26-8907-3eccb53a226b None admin] PATH_INFO: `/v3/groups/6fc1cde4cc2a4e56b4ba1f6c7aa5bcfa` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:21.671313 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:21.672184 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e191915-95c7-4b26-8907-3eccb53a226b None admin] RBAC: Authorizing `identity:get_group(group_id=6fc1cde4cc2a4e56b4ba1f6c7aa5bcfa)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:21.674895 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e191915-95c7-4b26-8907-3eccb53a226b None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:21.675690 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 185/378] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Aug 8 17:32:21 2022] GET /identity/v3/groups/6fc1cde4cc2a4e56b4ba1f6c7aa5bcfa => generated 229 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:21.683832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e191915-95c7-4b26-8907-3eccb53a226b None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:21.742600 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:21.808243 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29cb40-af9b-4b04-8bec-062d2ef36076 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:21.836495 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e191915-95c7-4b26-8907-3eccb53a226b None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:21.868868 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59327cef-4fea-44d7-b49c-9fbc6806af04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:21.869538 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59327cef-4fea-44d7-b49c-9fbc6806af04 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:21.869919 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59327cef-4fea-44d7-b49c-9fbc6806af04 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:21.870122 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59327cef-4fea-44d7-b49c-9fbc6806af04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:21.870807 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59327cef-4fea-44d7-b49c-9fbc6806af04 None admin] RBAC: Adding query filter params (group.id=43d0f79c969c4a9689c32145518b100d, role.id=0ff11803573b472ab020a59b7f452dcd, scope.project.id=91b9959e38d042f2a5aa8e5757e79251) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:21.871793 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59327cef-4fea-44d7-b49c-9fbc6806af04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:21.872892 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59327cef-4fea-44d7-b49c-9fbc6806af04 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:21.879583 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 194/379] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Aug 8 17:32:21 2022] GET /identity/v3/role_assignments?group.id=43d0f79c969c4a9689c32145518b100d&scope.project.id=91b9959e38d042f2a5aa8e5757e79251&role.id=0ff11803573b472ab020a59b7f452dcd => generated 260 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:21.880825 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7092266-5741-4cfb-925f-f6f24bac752f None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:21.882727 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7092266-5741-4cfb-925f-f6f24bac752f None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:21.883026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7092266-5741-4cfb-925f-f6f24bac752f None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:21.884387 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 195/380] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:21.886354 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09985c9-1f4f-40b3-bd13-8146dbc14d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:21.888051 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09985c9-1f4f-40b3-bd13-8146dbc14d55 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:21.889250 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09985c9-1f4f-40b3-bd13-8146dbc14d55 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:21.889250 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09985c9-1f4f-40b3-bd13-8146dbc14d55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:21.889435 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09985c9-1f4f-40b3-bd13-8146dbc14d55 None admin] RBAC: Adding query filter params (group.id=6fc1cde4cc2a4e56b4ba1f6c7aa5bcfa, role.id=5c25aa917ab34baabb795c54dd8a4d02, scope.project.id=e8e66549226e41208010bac52754a1ba) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:21.889687 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09985c9-1f4f-40b3-bd13-8146dbc14d55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:21.889787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab1f98-f5ae-483c-93e0-043f85050d6e None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:21.890058 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab1f98-f5ae-483c-93e0-043f85050d6e None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:21.890343 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab1f98-f5ae-483c-93e0-043f85050d6e None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:21.891173 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09985c9-1f4f-40b3-bd13-8146dbc14d55 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:21.893086 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 196/381] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:21.896725 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f2b37-c5e0-4c2c-bafe-e289527f43ad None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:21.896725 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f2b37-c5e0-4c2c-bafe-e289527f43ad None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:21.896948 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f2b37-c5e0-4c2c-bafe-e289527f43ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:21.908992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 186/382] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Aug 8 17:32:21 2022] GET /identity/v3/role_assignments?group.id=6fc1cde4cc2a4e56b4ba1f6c7aa5bcfa&scope.project.id=e8e66549226e41208010bac52754a1ba&role.id=5c25aa917ab34baabb795c54dd8a4d02 => generated 260 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:21.909344 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0c958-f1ad-46ce-a0ee-fb458605d4b6 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:21.913076 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0c958-f1ad-46ce-a0ee-fb458605d4b6 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:21.913076 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0c958-f1ad-46ce-a0ee-fb458605d4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:21.936674 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-e19f2b37-c5e0-4c2c-bafe-e289527f43ad None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:21.941072 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-e19f2b37-c5e0-4c2c-bafe-e289527f43ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:21.957081 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-1cb0c958-f1ad-46ce-a0ee-fb458605d4b6 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:21.958705 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-1cb0c958-f1ad-46ce-a0ee-fb458605d4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:22.111667 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 197/383] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:22.130916 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 187/384] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:22.139107 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f2b37-c5e0-4c2c-bafe-e289527f43ad None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:22.160530 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0c958-f1ad-46ce-a0ee-fb458605d4b6 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:22.193794 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:22.225505 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:22.325012 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0c958-f1ad-46ce-a0ee-fb458605d4b6 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:22.344162 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f2b37-c5e0-4c2c-bafe-e289527f43ad None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:22.399111 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9f775-a8ae-43e8-b438-423ff97180e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:22.399981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9f775-a8ae-43e8-b438-423ff97180e5 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:22.400407 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9f775-a8ae-43e8-b438-423ff97180e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:22.401547 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9f775-a8ae-43e8-b438-423ff97180e5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:22.428489 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee9f775-a8ae-43e8-b438-423ff97180e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:22.435871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-1ee9f775-a8ae-43e8-b438-423ff97180e5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 17:32:22.435871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:22.435871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:22.435871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:22.435871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:22.435871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:22.435871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:22.435871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:22.435871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:22.435871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:22.435871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:22.435871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:22.435871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:22.435871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:22.435871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:22.435871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:22.436858 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:22.436858 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:22.436858 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:22.436858 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:22.436858 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:22.436858 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:22.436858 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:22.436858 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:22.436858 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:22.436858 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:22.436858 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:22.436858 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:22.436858 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:22.436858 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:22.436858 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:22.436858 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:22.437769 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:22.437769 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:22.437769 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:22.437769 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:22.437769 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:22.437769 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:22.437769 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:22.437769 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:22.437769 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:22.437769 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:22.437769 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 17:32:22.437769 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:22.439172 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e77b5-9081-4514-bb0c-293dde67a91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:22.439975 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e77b5-9081-4514-bb0c-293dde67a91d None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:22.440383 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e77b5-9081-4514-bb0c-293dde67a91d None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:22.440825 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e77b5-9081-4514-bb0c-293dde67a91d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:22.445112 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 188/385] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 8 17:32:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:22.451504 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9f775-a8ae-43e8-b438-423ff97180e5 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:22.467698 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e77b5-9081-4514-bb0c-293dde67a91d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:22.472760 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-012e77b5-9081-4514-bb0c-293dde67a91d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 17:32:22.472760 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:22.472760 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:22.472760 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:22.472760 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:22.472760 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:22.472760 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:22.472760 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:22.472760 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:22.472760 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:22.472760 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:22.472760 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:22.472760 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:22.472760 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:22.472760 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:22.472760 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:22.473803 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:22.473803 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:22.473803 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:22.473803 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:22.473803 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:22.473803 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:22.473803 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:22.473803 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:22.473803 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:22.473803 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:22.473803 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:22.473803 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:22.473803 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:22.473803 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:22.473803 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:22.473803 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:22.474637 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:22.474637 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:22.474637 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:22.474637 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:22.474637 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:22.474637 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:22.474637 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:22.474637 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:22.474637 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:22.474637 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:22.474637 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 17:32:22.474637 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:22.479836 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 198/386] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:32:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:22.485859 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e77b5-9081-4514-bb0c-293dde67a91d None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:22.620154 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:22.675109 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9f775-a8ae-43e8-b438-423ff97180e5 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:22.689004 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:22.697304 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e77b5-9081-4514-bb0c-293dde67a91d None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:22.741571 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72376b5-52cb-4d8f-bb41-d91f10f57acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:22.741571 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72376b5-52cb-4d8f-bb41-d91f10f57acf None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:22.741571 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72376b5-52cb-4d8f-bb41-d91f10f57acf None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:22.741571 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72376b5-52cb-4d8f-bb41-d91f10f57acf None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:22.742011 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72376b5-52cb-4d8f-bb41-d91f10f57acf None admin] RBAC: Adding query filter params (name=member) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:22.742011 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72376b5-52cb-4d8f-bb41-d91f10f57acf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:22.742533 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72376b5-52cb-4d8f-bb41-d91f10f57acf None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:22.764158 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 199/387] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 8 17:32:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:32:22.765820 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2296e56-e994-425c-9bc7-ab2610aedf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:22.766448 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2296e56-e994-425c-9bc7-ab2610aedf7c None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:22.766729 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2296e56-e994-425c-9bc7-ab2610aedf7c None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:22.767004 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2296e56-e994-425c-9bc7-ab2610aedf7c None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:22.767679 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2296e56-e994-425c-9bc7-ab2610aedf7c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:22.767989 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2296e56-e994-425c-9bc7-ab2610aedf7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:22.769931 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72376b5-52cb-4d8f-bb41-d91f10f57acf None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:22.771299 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2296e56-e994-425c-9bc7-ab2610aedf7c None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:22.791696 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 189/388] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:32:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:22.797459 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2296e56-e994-425c-9bc7-ab2610aedf7c None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:22.978211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72376b5-52cb-4d8f-bb41-d91f10f57acf None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:23.000112 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2296e56-e994-425c-9bc7-ab2610aedf7c None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:23.046978 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859316c-52db-42e5-af65-45a1244eaa0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:23.054929 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859316c-52db-42e5-af65-45a1244eaa0c None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:23.054929 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859316c-52db-42e5-af65-45a1244eaa0c None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:23.054929 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859316c-52db-42e5-af65-45a1244eaa0c None admin] PATH_INFO: `/v3/groups/43d0f79c969c4a9689c32145518b100d` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:23.054929 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1859316c-52db-42e5-af65-45a1244eaa0c None admin] RBAC: Authorizing `identity:get_group(group_id=43d0f79c969c4a9689c32145518b100d)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:23.054929 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1859316c-52db-42e5-af65-45a1244eaa0c None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:23.059072 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 200/389] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Aug 8 17:32:22 2022] GET /identity/v3/groups/43d0f79c969c4a9689c32145518b100d => generated 226 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:32:23.060393 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859316c-52db-42e5-af65-45a1244eaa0c None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:23.079610 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f93be-8e34-430f-b306-9ff9ccd8219a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:23.079610 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f93be-8e34-430f-b306-9ff9ccd8219a None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:23.079610 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f93be-8e34-430f-b306-9ff9ccd8219a None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:23.079610 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f93be-8e34-430f-b306-9ff9ccd8219a None admin] PATH_INFO: `/v3/groups/43d0f79c969c4a9689c32145518b100d` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:23.080425 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f93be-8e34-430f-b306-9ff9ccd8219a None admin] RBAC: Authorizing `identity:get_group(group_id=43d0f79c969c4a9689c32145518b100d)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:23.083959 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f93be-8e34-430f-b306-9ff9ccd8219a None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:23.089123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 190/390] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Aug 8 17:32:22 2022] GET /identity/v3/groups/43d0f79c969c4a9689c32145518b100d => generated 226 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:23.095943 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f93be-8e34-430f-b306-9ff9ccd8219a None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:23.123358 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:23.134339 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:23.282240 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f93be-8e34-430f-b306-9ff9ccd8219a None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:23.314646 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859316c-52db-42e5-af65-45a1244eaa0c None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:23.327084 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317794ee-fef2-415a-ad35-6a43ebf7701a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:23.327881 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317794ee-fef2-415a-ad35-6a43ebf7701a None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:23.328270 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317794ee-fef2-415a-ad35-6a43ebf7701a None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:23.328813 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317794ee-fef2-415a-ad35-6a43ebf7701a None admin] PATH_INFO: `/v3/projects/dbe071067d79437b8969c9883cc256df` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:23.335855 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317794ee-fef2-415a-ad35-6a43ebf7701a None admin] RBAC: Authorizing `identity:get_project(project_id=dbe071067d79437b8969c9883cc256df)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:23.338981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317794ee-fef2-415a-ad35-6a43ebf7701a None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:23.343365 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 191/391] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:32:23 2022] GET /identity/v3/projects/dbe071067d79437b8969c9883cc256df => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:23.346260 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb9ac1-5643-43c1-b68d-bc280500b4a8 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:23.346710 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb9ac1-5643-43c1-b68d-bc280500b4a8 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:23.347217 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb9ac1-5643-43c1-b68d-bc280500b4a8 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:23.349500 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 192/392] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:23.351626 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb9ac1-5643-43c1-b68d-bc280500b4a8 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:23.392970 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579b162-9bdd-4dd0-b247-4c10e66e2079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:23.393883 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579b162-9bdd-4dd0-b247-4c10e66e2079 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:23.394314 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579b162-9bdd-4dd0-b247-4c10e66e2079 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:23.394734 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579b162-9bdd-4dd0-b247-4c10e66e2079 None admin] PATH_INFO: `/v3/projects/dbe071067d79437b8969c9883cc256df` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:23.396096 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579b162-9bdd-4dd0-b247-4c10e66e2079 None admin] RBAC: Authorizing `identity:get_project(project_id=dbe071067d79437b8969c9883cc256df)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:23.398632 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579b162-9bdd-4dd0-b247-4c10e66e2079 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:23.403184 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 201/393] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:32:23 2022] GET /identity/v3/projects/dbe071067d79437b8969c9883cc256df => generated 298 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:23.404625 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e625c-4edb-40e3-bc19-b271e8b906ea None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:23.406137 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e625c-4edb-40e3-bc19-b271e8b906ea None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:23.407067 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e625c-4edb-40e3-bc19-b271e8b906ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:23.431636 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-f11e625c-4edb-40e3-bc19-b271e8b906ea None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:23.433726 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-f11e625c-4edb-40e3-bc19-b271e8b906ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:23.536488 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:23.578800 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb9ac1-5643-43c1-b68d-bc280500b4a8 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:23.581820 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 202/394] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:23.582988 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e625c-4edb-40e3-bc19-b271e8b906ea None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:23.633192 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eef465-ce77-43eb-8f2a-0e315ac19a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:23.636281 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eef465-ce77-43eb-8f2a-0e315ac19a36 None admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:23.636707 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eef465-ce77-43eb-8f2a-0e315ac19a36 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:23.637345 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eef465-ce77-43eb-8f2a-0e315ac19a36 None admin] PATH_INFO: `/v3/projects/dbe071067d79437b8969c9883cc256df/groups/43d0f79c969c4a9689c32145518b100d/roles/0ff11803573b472ab020a59b7f452dcd` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:23.640105 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eef465-ce77-43eb-8f2a-0e315ac19a36 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbe071067d79437b8969c9883cc256df, group_id=43d0f79c969c4a9689c32145518b100d, role_id=0ff11803573b472ab020a59b7f452dcd)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:23.640862 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:23.642007 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eef465-ce77-43eb-8f2a-0e315ac19a36 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:23.711347 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 193/395] 10.222.0.70 () {58 vars in 1442 bytes} [Mon Aug 8 17:32:23 2022] PUT /identity/v3/projects/dbe071067d79437b8969c9883cc256df/groups/43d0f79c969c4a9689c32145518b100d/roles/0ff11803573b472ab020a59b7f452dcd => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:32:23.712645 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eef465-ce77-43eb-8f2a-0e315ac19a36 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:23.750078 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e625c-4edb-40e3-bc19-b271e8b906ea None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:23.813114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a76026-e798-4c8c-bd48-043f28ac378f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:23.813114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a76026-e798-4c8c-bd48-043f28ac378f None admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:23.813114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a76026-e798-4c8c-bd48-043f28ac378f None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:23.813114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a76026-e798-4c8c-bd48-043f28ac378f None admin] PATH_INFO: `/v3/projects/dbe071067d79437b8969c9883cc256df/groups/43d0f79c969c4a9689c32145518b100d/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:23.813489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a76026-e798-4c8c-bd48-043f28ac378f None admin] RBAC: Authorizing `identity:create_grant(project_id=dbe071067d79437b8969c9883cc256df, group_id=43d0f79c969c4a9689c32145518b100d, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:23.814042 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a76026-e798-4c8c-bd48-043f28ac378f None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:23.907014 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 203/396] 10.222.0.70 () {58 vars in 1442 bytes} [Mon Aug 8 17:32:23 2022] PUT /identity/v3/projects/dbe071067d79437b8969c9883cc256df/groups/43d0f79c969c4a9689c32145518b100d/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:32:23.919077 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eef465-ce77-43eb-8f2a-0e315ac19a36 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:23.990400 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c765eb2-2e2d-44cf-85e3-f5787b163692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:23.991621 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c765eb2-2e2d-44cf-85e3-f5787b163692 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:23.992006 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c765eb2-2e2d-44cf-85e3-f5787b163692 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:23.992282 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c765eb2-2e2d-44cf-85e3-f5787b163692 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:24.002957 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:24.009122 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c765eb2-2e2d-44cf-85e3-f5787b163692 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:24.011692 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-7c765eb2-2e2d-44cf-85e3-f5787b163692 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 17:32:24.011692 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:24.011692 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:24.011692 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:24.011692 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:24.011692 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:24.011692 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:24.011692 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:24.011692 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:24.011692 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:24.011692 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:24.011692 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:24.011692 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:24.011692 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:24.011692 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:24.011692 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:24.026046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:24.026046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:24.026046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:24.026046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:24.026046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:24.026046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:24.026046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:24.026046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:24.026046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:24.026046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:24.026046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:24.026046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:24.026046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:24.026046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:24.026046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:24.026046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:24.026875 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:24.026875 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:24.026875 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:24.026875 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:24.026875 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:24.026875 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:24.026875 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:24.026875 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:24.026875 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:24.026875 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:24.026875 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 17:32:24.026875 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:24.026875 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 194/397] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:32:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:24.027548 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a76026-e798-4c8c-bd48-043f28ac378f None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:24.197831 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:24.213995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a76026-e798-4c8c-bd48-043f28ac378f None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:24.254416 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0aa7b-8e72-4b72-8b56-ed0c7b649bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:24.255045 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0aa7b-8e72-4b72-8b56-ed0c7b649bef None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:24.255328 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0aa7b-8e72-4b72-8b56-ed0c7b649bef None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:24.255601 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0aa7b-8e72-4b72-8b56-ed0c7b649bef None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:24.256275 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f0aa7b-8e72-4b72-8b56-ed0c7b649bef None admin] RBAC: Adding query filter params (name=member) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:24.257365 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f0aa7b-8e72-4b72-8b56-ed0c7b649bef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:24.258805 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f0aa7b-8e72-4b72-8b56-ed0c7b649bef None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:24.267862 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 204/398] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 8 17:32:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:24.273890 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c765eb2-2e2d-44cf-85e3-f5787b163692 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:24.417001 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c765eb2-2e2d-44cf-85e3-f5787b163692 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:24.455096 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f492eb5-07be-41a4-abcf-e76d770bd36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:24.455651 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f492eb5-07be-41a4-abcf-e76d770bd36a None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:24.455931 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f492eb5-07be-41a4-abcf-e76d770bd36a None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:24.456201 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f492eb5-07be-41a4-abcf-e76d770bd36a None admin] PATH_INFO: `/v3/groups/43d0f79c969c4a9689c32145518b100d` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:24.457371 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f492eb5-07be-41a4-abcf-e76d770bd36a None admin] RBAC: Authorizing `identity:get_group(group_id=43d0f79c969c4a9689c32145518b100d)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:24.458816 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f492eb5-07be-41a4-abcf-e76d770bd36a None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:24.460865 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 195/399] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Aug 8 17:32:24 2022] GET /identity/v3/groups/43d0f79c969c4a9689c32145518b100d => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:24.466669 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0aa7b-8e72-4b72-8b56-ed0c7b649bef None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:24.484228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137b7b4-0d8a-473e-8ab7-696ed1d082e4 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:24.484989 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137b7b4-0d8a-473e-8ab7-696ed1d082e4 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:24.485530 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137b7b4-0d8a-473e-8ab7-696ed1d082e4 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:24.487444 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 196/400] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 17:32:24.493704 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c2915-bd42-4eb1-acad-4d42ff61d369 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:24.494268 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c2915-bd42-4eb1-acad-4d42ff61d369 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:24.494746 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c2915-bd42-4eb1-acad-4d42ff61d369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:24.524052 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-a89c2915-bd42-4eb1-acad-4d42ff61d369 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:24.526306 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-a89c2915-bd42-4eb1-acad-4d42ff61d369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:24.625859 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:24.629084 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0aa7b-8e72-4b72-8b56-ed0c7b649bef None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:24.635056 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 197/401] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 17:32:24.641141 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bac6eb-715d-4855-a464-46d353faff1c None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:24.641141 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bac6eb-715d-4855-a464-46d353faff1c None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:24.641141 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bac6eb-715d-4855-a464-46d353faff1c None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:24.650944 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 198/402] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:24.650944 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6125125-551b-4027-8c51-3063d72a22e0 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:24.650944 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6125125-551b-4027-8c51-3063d72a22e0 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:24.650944 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6125125-551b-4027-8c51-3063d72a22e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:24.680183 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-d6125125-551b-4027-8c51-3063d72a22e0 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:24.681828 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-d6125125-551b-4027-8c51-3063d72a22e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:24.694847 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd1f7c-2707-44c7-b5cc-a3dadb85fef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:24.695555 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd1f7c-2707-44c7-b5cc-a3dadb85fef8 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:24.695839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd1f7c-2707-44c7-b5cc-a3dadb85fef8 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:24.696588 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd1f7c-2707-44c7-b5cc-a3dadb85fef8 None admin] PATH_INFO: `/v3/projects/91b9959e38d042f2a5aa8e5757e79251` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:24.699942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cd1f7c-2707-44c7-b5cc-a3dadb85fef8 None admin] RBAC: Authorizing `identity:get_project(project_id=91b9959e38d042f2a5aa8e5757e79251)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:24.701464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cd1f7c-2707-44c7-b5cc-a3dadb85fef8 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:24.703464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 205/403] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:32:24 2022] GET /identity/v3/projects/91b9959e38d042f2a5aa8e5757e79251 => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:24.704542 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd1f7c-2707-44c7-b5cc-a3dadb85fef8 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:24.736207 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:24.778334 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 199/404] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 17:32:24.779392 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6125125-551b-4027-8c51-3063d72a22e0 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:24.883136 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd1f7c-2707-44c7-b5cc-a3dadb85fef8 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:24.919707 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6125125-551b-4027-8c51-3063d72a22e0 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:24.958655 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:24.962688 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848b279-4016-48b2-b889-5aa00b792dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:24.963330 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848b279-4016-48b2-b889-5aa00b792dce None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:24.963616 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848b279-4016-48b2-b889-5aa00b792dce None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:24.963889 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848b279-4016-48b2-b889-5aa00b792dce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:24.969683 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de358a21-bab9-4056-9191-ece73ff4da00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:24.975950 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de358a21-bab9-4056-9191-ece73ff4da00 None admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:24.975950 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de358a21-bab9-4056-9191-ece73ff4da00 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:24.975950 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de358a21-bab9-4056-9191-ece73ff4da00 None admin] PATH_INFO: `/v3/projects/91b9959e38d042f2a5aa8e5757e79251/groups/43d0f79c969c4a9689c32145518b100d/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:24.975950 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de358a21-bab9-4056-9191-ece73ff4da00 None admin] RBAC: Authorizing `identity:create_grant(project_id=91b9959e38d042f2a5aa8e5757e79251, group_id=43d0f79c969c4a9689c32145518b100d, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:24.975950 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de358a21-bab9-4056-9191-ece73ff4da00 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:24.982877 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f848b279-4016-48b2-b889-5aa00b792dce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:24.992295 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-f848b279-4016-48b2-b889-5aa00b792dce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:32:24.992295 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:24.992295 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:24.992295 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:24.992295 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:24.992295 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:24.992295 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:24.992295 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:24.992295 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:24.992295 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:24.992295 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:24.992295 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:24.992295 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:24.992295 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:24.992295 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:24.992295 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:24.993236 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:24.993236 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:24.993236 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:24.993236 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:24.993236 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:24.993236 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:24.993236 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:24.993236 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:24.993236 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:24.993236 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:24.993236 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:24.993236 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:24.993236 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:24.993236 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:24.993236 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:24.993236 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:24.994062 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:24.994062 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:24.994062 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:24.994062 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:24.994062 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:24.994062 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:24.994062 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:24.994062 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:24.994062 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:24.994062 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:24.994062 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:32:24.994062 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:24.996482 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 206/405] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 8 17:32:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:24.997489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848b279-4016-48b2-b889-5aa00b792dce None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:25.086729 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:25.109212 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 200/406] 10.222.0.70 () {58 vars in 1442 bytes} [Mon Aug 8 17:32:24 2022] PUT /identity/v3/projects/91b9959e38d042f2a5aa8e5757e79251/groups/43d0f79c969c4a9689c32145518b100d/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:32:25.115577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de358a21-bab9-4056-9191-ece73ff4da00 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:25.122961 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848b279-4016-48b2-b889-5aa00b792dce None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:25.169073 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a8872-f257-4d55-ac94-fc932918057b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:25.169073 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a8872-f257-4d55-ac94-fc932918057b None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:25.169073 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a8872-f257-4d55-ac94-fc932918057b None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:25.169073 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a8872-f257-4d55-ac94-fc932918057b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:25.184071 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a8872-f257-4d55-ac94-fc932918057b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:25.194937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-207a8872-f257-4d55-ac94-fc932918057b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 17:32:25.194937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:25.194937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:25.194937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:25.194937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:25.194937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:25.194937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:25.194937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:25.194937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:25.194937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:25.194937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:25.194937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:25.194937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:25.194937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:25.194937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:25.194937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:25.196165 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:25.196165 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:25.196165 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:25.196165 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:25.196165 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:25.196165 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:25.196165 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:25.196165 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:25.196165 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:25.196165 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:25.196165 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:25.196165 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:25.196165 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:25.196165 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:25.196165 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:25.196165 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:25.196967 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:25.196967 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:25.196967 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:25.196967 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:25.196967 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:25.196967 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:25.196967 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:25.196967 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:25.196967 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:25.196967 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:25.196967 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 17:32:25.196967 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:25.201795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 207/407] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 8 17:32:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:25.209183 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a8872-f257-4d55-ac94-fc932918057b None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:25.404674 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de358a21-bab9-4056-9191-ece73ff4da00 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:25.449064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a8872-f257-4d55-ac94-fc932918057b None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:25.509704 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fea64-0d99-4a97-9309-fdb6da782800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:25.510298 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fea64-0d99-4a97-9309-fdb6da782800 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:25.513134 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fea64-0d99-4a97-9309-fdb6da782800 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:25.513134 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fea64-0d99-4a97-9309-fdb6da782800 None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:25.513134 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394fea64-0d99-4a97-9309-fdb6da782800 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:25.513134 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394fea64-0d99-4a97-9309-fdb6da782800 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:25.513134 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394fea64-0d99-4a97-9309-fdb6da782800 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:25.530557 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 201/408] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:32:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:25.538104 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fea64-0d99-4a97-9309-fdb6da782800 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:25.540132 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e663169-1b98-446b-9026-358864f2ee9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:25.541116 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e663169-1b98-446b-9026-358864f2ee9c None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:25.541402 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e663169-1b98-446b-9026-358864f2ee9c None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:25.542663 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e663169-1b98-446b-9026-358864f2ee9c None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:25.543361 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e663169-1b98-446b-9026-358864f2ee9c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:25.543666 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e663169-1b98-446b-9026-358864f2ee9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:25.545075 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e663169-1b98-446b-9026-358864f2ee9c None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:25.562562 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:25.589770 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 208/409] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:32:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:32:25.591301 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e663169-1b98-446b-9026-358864f2ee9c None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:25.709017 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:25.716775 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e663169-1b98-446b-9026-358864f2ee9c None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:25.781056 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd4074-fdf1-4ac0-abbe-337c85f4c5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:25.781056 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd4074-fdf1-4ac0-abbe-337c85f4c5c0 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:25.781056 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd4074-fdf1-4ac0-abbe-337c85f4c5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:25.781056 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd4074-fdf1-4ac0-abbe-337c85f4c5c0 None admin] PATH_INFO: `/v3/groups/43d0f79c969c4a9689c32145518b100d` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:25.781623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fd4074-fdf1-4ac0-abbe-337c85f4c5c0 None admin] RBAC: Authorizing `identity:get_group(group_id=43d0f79c969c4a9689c32145518b100d)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:25.783043 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fd4074-fdf1-4ac0-abbe-337c85f4c5c0 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:25.787316 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 209/410] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Aug 8 17:32:25 2022] GET /identity/v3/groups/43d0f79c969c4a9689c32145518b100d => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:25.793879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd4074-fdf1-4ac0-abbe-337c85f4c5c0 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:25.795814 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fea64-0d99-4a97-9309-fdb6da782800 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:25.869090 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3c21d-76ae-4d94-be0c-5200520712ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:25.869737 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3c21d-76ae-4d94-be0c-5200520712ef None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:25.871031 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3c21d-76ae-4d94-be0c-5200520712ef None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:25.871031 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3c21d-76ae-4d94-be0c-5200520712ef None admin] PATH_INFO: `/v3/groups/6fc1cde4cc2a4e56b4ba1f6c7aa5bcfa` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:25.871363 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e3c21d-76ae-4d94-be0c-5200520712ef None admin] RBAC: Authorizing `identity:get_group(group_id=6fc1cde4cc2a4e56b4ba1f6c7aa5bcfa)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:25.872804 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e3c21d-76ae-4d94-be0c-5200520712ef None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:25.875774 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 202/411] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Aug 8 17:32:25 2022] GET /identity/v3/groups/6fc1cde4cc2a4e56b4ba1f6c7aa5bcfa => generated 229 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:25.884414 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3c21d-76ae-4d94-be0c-5200520712ef None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:25.943544 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:26.011419 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd4074-fdf1-4ac0-abbe-337c85f4c5c0 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:26.083573 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e36eb6-a254-4ae2-9953-001687b1c8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:26.085842 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e36eb6-a254-4ae2-9953-001687b1c8a1 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:26.089435 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e36eb6-a254-4ae2-9953-001687b1c8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:26.089924 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e36eb6-a254-4ae2-9953-001687b1c8a1 None admin] PATH_INFO: `/v3/projects/91b9959e38d042f2a5aa8e5757e79251` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:26.092139 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e36eb6-a254-4ae2-9953-001687b1c8a1 None admin] RBAC: Authorizing `identity:get_project(project_id=91b9959e38d042f2a5aa8e5757e79251)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:26.094745 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e36eb6-a254-4ae2-9953-001687b1c8a1 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:26.102327 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3c21d-76ae-4d94-be0c-5200520712ef None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:26.102815 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 210/412] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:32:25 2022] GET /identity/v3/projects/91b9959e38d042f2a5aa8e5757e79251 => generated 302 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:32:26.105330 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e36eb6-a254-4ae2-9953-001687b1c8a1 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:26.142609 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:26.179514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569bde1-8b81-47d0-84fd-6bf4024a3746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:26.180514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569bde1-8b81-47d0-84fd-6bf4024a3746 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:26.184261 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569bde1-8b81-47d0-84fd-6bf4024a3746 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:26.184763 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569bde1-8b81-47d0-84fd-6bf4024a3746 None admin] PATH_INFO: `/v3/projects/e8e66549226e41208010bac52754a1ba` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:26.186189 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4569bde1-8b81-47d0-84fd-6bf4024a3746 None admin] RBAC: Authorizing `identity:get_project(project_id=e8e66549226e41208010bac52754a1ba)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:26.187857 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4569bde1-8b81-47d0-84fd-6bf4024a3746 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:26.191894 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 203/413] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:32:25 2022] GET /identity/v3/projects/e8e66549226e41208010bac52754a1ba => generated 344 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:26.199869 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569bde1-8b81-47d0-84fd-6bf4024a3746 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:26.356239 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e36eb6-a254-4ae2-9953-001687b1c8a1 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:26.380884 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569bde1-8b81-47d0-84fd-6bf4024a3746 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:26.449556 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58101c43-f6cc-49f0-90c1-0736200263d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:26.450867 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58101c43-f6cc-49f0-90c1-0736200263d5 None admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:26.451812 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58101c43-f6cc-49f0-90c1-0736200263d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:26.452495 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58101c43-f6cc-49f0-90c1-0736200263d5 None admin] PATH_INFO: `/v3/projects/e8e66549226e41208010bac52754a1ba/groups/6fc1cde4cc2a4e56b4ba1f6c7aa5bcfa/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:26.461010 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58101c43-f6cc-49f0-90c1-0736200263d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8e66549226e41208010bac52754a1ba, group_id=6fc1cde4cc2a4e56b4ba1f6c7aa5bcfa, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:26.463920 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58101c43-f6cc-49f0-90c1-0736200263d5 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:26.497416 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063803ea-db12-4b51-8b7e-c51bbcca8f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:26.498771 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063803ea-db12-4b51-8b7e-c51bbcca8f89 None admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:26.499461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063803ea-db12-4b51-8b7e-c51bbcca8f89 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:26.500145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063803ea-db12-4b51-8b7e-c51bbcca8f89 None admin] PATH_INFO: `/v3/projects/91b9959e38d042f2a5aa8e5757e79251/groups/43d0f79c969c4a9689c32145518b100d/roles/0ff11803573b472ab020a59b7f452dcd` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:26.504055 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063803ea-db12-4b51-8b7e-c51bbcca8f89 None admin] RBAC: Authorizing `identity:create_grant(project_id=91b9959e38d042f2a5aa8e5757e79251, group_id=43d0f79c969c4a9689c32145518b100d, role_id=0ff11803573b472ab020a59b7f452dcd)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:26.507446 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063803ea-db12-4b51-8b7e-c51bbcca8f89 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:26.513389 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:26.581539 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 204/414] 10.222.0.70 () {58 vars in 1442 bytes} [Mon Aug 8 17:32:26 2022] PUT /identity/v3/projects/e8e66549226e41208010bac52754a1ba/groups/6fc1cde4cc2a4e56b4ba1f6c7aa5bcfa/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:32:26.583148 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670554f4-212c-4310-bdd2-29bb6a36a825 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:26.583620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670554f4-212c-4310-bdd2-29bb6a36a825 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:26.584078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670554f4-212c-4310-bdd2-29bb6a36a825 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:26.586842 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 205/415] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:26.592347 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b10641-f04e-41af-887c-4674a28e1f51 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:26.592849 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b10641-f04e-41af-887c-4674a28e1f51 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:26.593348 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b10641-f04e-41af-887c-4674a28e1f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:26.615384 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 211/416] 10.222.0.70 () {58 vars in 1442 bytes} [Mon Aug 8 17:32:26 2022] PUT /identity/v3/projects/91b9959e38d042f2a5aa8e5757e79251/groups/43d0f79c969c4a9689c32145518b100d/roles/0ff11803573b472ab020a59b7f452dcd => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:32:26.635384 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-63b10641-f04e-41af-887c-4674a28e1f51 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:26.637265 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-63b10641-f04e-41af-887c-4674a28e1f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:26.719934 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:26.774820 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 206/417] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:26.813856 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063803ea-db12-4b51-8b7e-c51bbcca8f89 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:26.949072 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063803ea-db12-4b51-8b7e-c51bbcca8f89 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:26.990104 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf248c-b215-4613-b39f-b9851554dddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:26.991493 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf248c-b215-4613-b39f-b9851554dddb None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:26.993065 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf248c-b215-4613-b39f-b9851554dddb None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:26.993065 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf248c-b215-4613-b39f-b9851554dddb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:27.004603 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf248c-b215-4613-b39f-b9851554dddb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:27.010683 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-5dbf248c-b215-4613-b39f-b9851554dddb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 17:32:27.010683 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:27.010683 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:27.010683 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:27.010683 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:27.010683 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:27.010683 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:27.010683 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:27.010683 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:27.010683 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:27.010683 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:27.010683 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:27.010683 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:27.010683 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:27.010683 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:27.010683 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:27.011605 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:27.011605 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:27.011605 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:27.011605 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:27.011605 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:27.011605 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:27.011605 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:27.011605 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:27.011605 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:27.011605 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:27.011605 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:27.011605 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:27.011605 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:27.011605 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:27.011605 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:27.011605 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:27.012418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:27.012418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:27.012418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:27.012418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:27.012418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:27.012418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:27.012418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:27.012418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:27.012418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:27.012418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:27.012418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 17:32:27.012418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:27.012418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 212/418] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 8 17:32:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:27.022467 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b10641-f04e-41af-887c-4674a28e1f51 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:27.084419 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977c85a-3925-4d46-a83a-8c90aa5e185f None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:27.085424 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977c85a-3925-4d46-a83a-8c90aa5e185f None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:27.085696 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977c85a-3925-4d46-a83a-8c90aa5e185f None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:27.097238 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 213/419] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:27.097238 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44533329-9512-4896-a052-88d5dd40d663 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:27.097238 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44533329-9512-4896-a052-88d5dd40d663 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:27.097238 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44533329-9512-4896-a052-88d5dd40d663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:27.150076 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-44533329-9512-4896-a052-88d5dd40d663 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:27.151298 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-44533329-9512-4896-a052-88d5dd40d663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:27.185469 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b10641-f04e-41af-887c-4674a28e1f51 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:27.229122 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfe8ed-4926-422d-a9d4-ca7eb294d849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:27.229665 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfe8ed-4926-422d-a9d4-ca7eb294d849 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:27.229938 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfe8ed-4926-422d-a9d4-ca7eb294d849 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:27.230206 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfe8ed-4926-422d-a9d4-ca7eb294d849 None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:27.230874 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfe8ed-4926-422d-a9d4-ca7eb294d849 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:27.231170 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfe8ed-4926-422d-a9d4-ca7eb294d849 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:27.232525 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfe8ed-4926-422d-a9d4-ca7eb294d849 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:27.254966 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 207/420] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:32:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:27.266126 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfe8ed-4926-422d-a9d4-ca7eb294d849 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:27.281405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:27.333068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:27.345698 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 214/421] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 17:32:27.387504 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44533329-9512-4896-a052-88d5dd40d663 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:27.481134 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfe8ed-4926-422d-a9d4-ca7eb294d849 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:27.557431 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141fabf1-5124-484d-8ba5-c2ab1ca40d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:27.558067 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fabf1-5124-484d-8ba5-c2ab1ca40d1a None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:27.558349 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fabf1-5124-484d-8ba5-c2ab1ca40d1a None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:27.558626 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fabf1-5124-484d-8ba5-c2ab1ca40d1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:27.650102 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141fabf1-5124-484d-8ba5-c2ab1ca40d1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:27.651867 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141fabf1-5124-484d-8ba5-c2ab1ca40d1a None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:27.683029 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44533329-9512-4896-a052-88d5dd40d663 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:27.701525 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:27.772091 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 208/422] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:32:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:32:27.783988 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141fabf1-5124-484d-8ba5-c2ab1ca40d1a None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:27.811791 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57127e-088c-4f40-a07b-a978dedc57d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:27.812444 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57127e-088c-4f40-a07b-a978dedc57d4 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:27.812738 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57127e-088c-4f40-a07b-a978dedc57d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:27.813013 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57127e-088c-4f40-a07b-a978dedc57d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:27.845062 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac57127e-088c-4f40-a07b-a978dedc57d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:27.852064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-ac57127e-088c-4f40-a07b-a978dedc57d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 17:32:27.852064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:27.852064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:27.852064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:27.852064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:27.852064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:27.852064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:27.852064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:27.852064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:27.852064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:27.852064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:27.852064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:27.852064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:27.852064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:27.852064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:27.852064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:27.852957 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:27.852957 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:27.852957 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:27.852957 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:27.852957 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:27.852957 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:27.852957 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:27.852957 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:27.852957 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:27.852957 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:27.852957 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:27.852957 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:27.852957 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:27.852957 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:27.852957 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:27.852957 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:27.853866 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:27.853866 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:27.853866 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:27.853866 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:27.853866 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:27.853866 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:27.853866 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:27.853866 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:27.853866 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:27.853866 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:27.853866 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 17:32:27.853866 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:27.862940 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 215/423] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:32:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 476 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:27.865069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57127e-088c-4f40-a07b-a978dedc57d4 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:27.970787 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141fabf1-5124-484d-8ba5-c2ab1ca40d1a None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:27.992007 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:28.051461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8968242-7c4c-4884-aaeb-4cf6541c741a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:28.052138 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8968242-7c4c-4884-aaeb-4cf6541c741a None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:28.052417 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8968242-7c4c-4884-aaeb-4cf6541c741a None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:28.052687 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8968242-7c4c-4884-aaeb-4cf6541c741a None admin] PATH_INFO: `/v3/projects/dbe071067d79437b8969c9883cc256df` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:28.054836 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8968242-7c4c-4884-aaeb-4cf6541c741a None admin] RBAC: Authorizing `identity:get_project(project_id=dbe071067d79437b8969c9883cc256df)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:28.057407 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8968242-7c4c-4884-aaeb-4cf6541c741a None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:28.058512 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 209/424] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:32:27 2022] GET /identity/v3/projects/dbe071067d79437b8969c9883cc256df => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:28.059956 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98efd29-a0fb-4181-856b-837cde771442 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:28.060239 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98efd29-a0fb-4181-856b-837cde771442 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:28.060519 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98efd29-a0fb-4181-856b-837cde771442 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:28.066064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 210/425] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:28.067194 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98efd29-a0fb-4181-856b-837cde771442 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:28.080969 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:28.111758 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57127e-088c-4f40-a07b-a978dedc57d4 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:28.177698 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b6209-624b-4675-a584-4687b17befb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:28.178647 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b6209-624b-4675-a584-4687b17befb2 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:28.179067 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b6209-624b-4675-a584-4687b17befb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:28.180451 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b6209-624b-4675-a584-4687b17befb2 None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:28.181391 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b6209-624b-4675-a584-4687b17befb2 None admin] RBAC: Adding query filter params (name=member) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:28.182871 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b6209-624b-4675-a584-4687b17befb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:28.184470 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b6209-624b-4675-a584-4687b17befb2 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:28.197959 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 216/426] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 8 17:32:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:28.202538 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbf20c-641e-4de3-baf0-eddc8acd4d79 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:28.203151 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbf20c-641e-4de3-baf0-eddc8acd4d79 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:28.203795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbf20c-641e-4de3-baf0-eddc8acd4d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:28.227120 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98efd29-a0fb-4181-856b-837cde771442 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:28.233847 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-f4fbf20c-641e-4de3-baf0-eddc8acd4d79 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:28.240177 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-f4fbf20c-641e-4de3-baf0-eddc8acd4d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:28.268996 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6dd6a0-e672-4c79-a218-f3e7c3821574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:28.270906 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6dd6a0-e672-4c79-a218-f3e7c3821574 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:28.271189 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6dd6a0-e672-4c79-a218-f3e7c3821574 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:28.271466 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6dd6a0-e672-4c79-a218-f3e7c3821574 None admin] PATH_INFO: `/v3/groups/43d0f79c969c4a9689c32145518b100d` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:28.275395 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6dd6a0-e672-4c79-a218-f3e7c3821574 None admin] RBAC: Authorizing `identity:get_group(group_id=43d0f79c969c4a9689c32145518b100d)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:28.278138 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6dd6a0-e672-4c79-a218-f3e7c3821574 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:28.279788 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 211/427] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Aug 8 17:32:28 2022] GET /identity/v3/groups/43d0f79c969c4a9689c32145518b100d => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:28.281080 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6dd6a0-e672-4c79-a218-f3e7c3821574 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:28.345951 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 217/428] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:28.354418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fbf20c-641e-4de3-baf0-eddc8acd4d79 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:28.383015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:28.414936 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:28.427912 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6dd6a0-e672-4c79-a218-f3e7c3821574 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:28.480452 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b892d8c-1867-4fb1-a408-68086227fe05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:28.481407 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b892d8c-1867-4fb1-a408-68086227fe05 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:28.481851 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b892d8c-1867-4fb1-a408-68086227fe05 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:28.482299 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b892d8c-1867-4fb1-a408-68086227fe05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:28.516012 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fbf20c-641e-4de3-baf0-eddc8acd4d79 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:28.562453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018bddd1-d49e-45bf-87d8-f2df9b0cd429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:28.563088 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b892d8c-1867-4fb1-a408-68086227fe05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:28.563348 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bddd1-d49e-45bf-87d8-f2df9b0cd429 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:28.563727 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bddd1-d49e-45bf-87d8-f2df9b0cd429 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:28.564098 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bddd1-d49e-45bf-87d8-f2df9b0cd429 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:28.564923 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018bddd1-d49e-45bf-87d8-f2df9b0cd429 None admin] RBAC: Adding query filter params (group.id=43d0f79c969c4a9689c32145518b100d, role.id=0ff11803573b472ab020a59b7f452dcd, scope.project.id=dbe071067d79437b8969c9883cc256df) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:28.565363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018bddd1-d49e-45bf-87d8-f2df9b0cd429 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:28.565672 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b892d8c-1867-4fb1-a408-68086227fe05 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:28.566978 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018bddd1-d49e-45bf-87d8-f2df9b0cd429 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:28.573255 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 218/429] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Aug 8 17:32:28 2022] GET /identity/v3/role_assignments?group.id=43d0f79c969c4a9689c32145518b100d&scope.project.id=dbe071067d79437b8969c9883cc256df&role.id=0ff11803573b472ab020a59b7f452dcd => generated 611 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:28.576780 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018bddd1-d49e-45bf-87d8-f2df9b0cd429 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:28.663784 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:28.700270 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 212/430] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:32:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:32:28.707340 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b892d8c-1867-4fb1-a408-68086227fe05 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:28.804097 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018bddd1-d49e-45bf-87d8-f2df9b0cd429 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:28.806098 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:28.862535 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325f67d-ea79-4a3f-97d8-cc40db70cb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:28.863335 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325f67d-ea79-4a3f-97d8-cc40db70cb13 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:28.863715 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325f67d-ea79-4a3f-97d8-cc40db70cb13 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:28.864090 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325f67d-ea79-4a3f-97d8-cc40db70cb13 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:28.866040 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b892d8c-1867-4fb1-a408-68086227fe05 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:28.878332 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325f67d-ea79-4a3f-97d8-cc40db70cb13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:28.884208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-f325f67d-ea79-4a3f-97d8-cc40db70cb13 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 17:32:28.884208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:28.884208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:28.884208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:28.884208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:28.884208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:28.884208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:28.884208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:28.884208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:28.884208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:28.884208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:28.884208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:28.884208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:28.884208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:28.884208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:28.884208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:28.887442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:28.887442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:28.887442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:28.887442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:28.887442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:28.887442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:28.887442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:28.887442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:28.887442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:28.887442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:28.887442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:28.887442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:28.887442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:28.887442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:28.887442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:28.887442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:28.888288 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:28.888288 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:28.888288 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:28.888288 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:28.888288 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:28.888288 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:28.888288 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:28.888288 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:28.888288 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:28.888288 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:28.888288 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 17:32:28.888288 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:28.888288 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 219/431] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:32:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:28.896099 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325f67d-ea79-4a3f-97d8-cc40db70cb13 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:28.930841 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5ea0a-24d4-4256-8d32-9637e6b8c75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:28.931905 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5ea0a-24d4-4256-8d32-9637e6b8c75f None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:28.932522 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5ea0a-24d4-4256-8d32-9637e6b8c75f None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:28.933013 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5ea0a-24d4-4256-8d32-9637e6b8c75f None admin] PATH_INFO: `/v3/projects/dbe071067d79437b8969c9883cc256df` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:28.934594 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad5ea0a-24d4-4256-8d32-9637e6b8c75f None admin] RBAC: Authorizing `identity:get_project(project_id=dbe071067d79437b8969c9883cc256df)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:28.936533 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad5ea0a-24d4-4256-8d32-9637e6b8c75f None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:28.943067 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 213/432] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:32:28 2022] GET /identity/v3/projects/dbe071067d79437b8969c9883cc256df => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:28.944491 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5ea0a-24d4-4256-8d32-9637e6b8c75f None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:28.996339 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:29.028629 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325f67d-ea79-4a3f-97d8-cc40db70cb13 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:29.068226 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e3971-7345-407d-9246-76ec7f2a8ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:29.069225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e3971-7345-407d-9246-76ec7f2a8ec1 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:29.069678 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e3971-7345-407d-9246-76ec7f2a8ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:29.070136 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e3971-7345-407d-9246-76ec7f2a8ec1 None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:29.070969 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e3971-7345-407d-9246-76ec7f2a8ec1 None admin] RBAC: Adding query filter params (name=member) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:29.071441 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e3971-7345-407d-9246-76ec7f2a8ec1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:29.073133 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e3971-7345-407d-9246-76ec7f2a8ec1 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:29.076501 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5ea0a-24d4-4256-8d32-9637e6b8c75f None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:29.082894 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 220/433] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 8 17:32:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:29.092606 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e3971-7345-407d-9246-76ec7f2a8ec1 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:29.130635 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:29.130916 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8b846-0da2-41f4-870c-a9ac53f02ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:29.131560 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8b846-0da2-41f4-870c-a9ac53f02ed8 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:29.131932 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8b846-0da2-41f4-870c-a9ac53f02ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:29.132104 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8b846-0da2-41f4-870c-a9ac53f02ed8 None admin] PATH_INFO: `/v3/groups/43d0f79c969c4a9689c32145518b100d` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:29.133298 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8b846-0da2-41f4-870c-a9ac53f02ed8 None admin] RBAC: Authorizing `identity:get_group(group_id=43d0f79c969c4a9689c32145518b100d)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:29.135270 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8b846-0da2-41f4-870c-a9ac53f02ed8 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:29.141721 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 214/434] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Aug 8 17:32:28 2022] GET /identity/v3/groups/43d0f79c969c4a9689c32145518b100d => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:29.150121 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c50fa-acf5-4ec8-8b67-c4f94762304f None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:29.150121 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c50fa-acf5-4ec8-8b67-c4f94762304f None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:29.150121 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c50fa-acf5-4ec8-8b67-c4f94762304f None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:29.150121 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 215/435] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:29.150121 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c50fa-acf5-4ec8-8b67-c4f94762304f None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:29.228918 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e3971-7345-407d-9246-76ec7f2a8ec1 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:29.266084 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c50fa-acf5-4ec8-8b67-c4f94762304f None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:29.267252 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7f1a5-312c-4a93-8563-b3d80692bca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:29.267866 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7f1a5-312c-4a93-8563-b3d80692bca2 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:29.268147 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7f1a5-312c-4a93-8563-b3d80692bca2 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:29.268496 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7f1a5-312c-4a93-8563-b3d80692bca2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:29.278271 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:29.302202 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e3c220-256a-41f6-a165-5103100e2e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:29.302831 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3c220-256a-41f6-a165-5103100e2e3e None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:29.303657 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3c220-256a-41f6-a165-5103100e2e3e None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:29.303934 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3c220-256a-41f6-a165-5103100e2e3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:29.304658 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e3c220-256a-41f6-a165-5103100e2e3e None admin] RBAC: Adding query filter params (group.id=43d0f79c969c4a9689c32145518b100d, role.id=adc45cdd4c9543b3b8b24141870f4b11, scope.project.id=dbe071067d79437b8969c9883cc256df) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:29.304967 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e3c220-256a-41f6-a165-5103100e2e3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:29.306438 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e3c220-256a-41f6-a165-5103100e2e3e None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:29.312635 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 216/436] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Aug 8 17:32:29 2022] GET /identity/v3/role_assignments?group.id=43d0f79c969c4a9689c32145518b100d&scope.project.id=dbe071067d79437b8969c9883cc256df&role.id=adc45cdd4c9543b3b8b24141870f4b11 => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:29.313875 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9371b-693a-4c8d-8ff7-2165cd0636c9 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:29.314155 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9371b-693a-4c8d-8ff7-2165cd0636c9 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:29.314429 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9371b-693a-4c8d-8ff7-2165cd0636c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:29.344760 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7f1a5-312c-4a93-8563-b3d80692bca2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:29.344962 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-cfe9371b-693a-4c8d-8ff7-2165cd0636c9 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:29.346007 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-cfe9371b-693a-4c8d-8ff7-2165cd0636c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:29.346575 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7f1a5-312c-4a93-8563-b3d80692bca2 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:29.378140 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:29.453067 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 217/437] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:29.453067 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092e867-2c00-40dc-b499-98e6c87c789c None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:29.453067 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092e867-2c00-40dc-b499-98e6c87c789c None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:29.453067 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092e867-2c00-40dc-b499-98e6c87c789c None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:29.460450 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 218/438] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:29.460450 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51795a-51b2-4ae7-89b3-5efc7ec1306f None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:29.460450 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51795a-51b2-4ae7-89b3-5efc7ec1306f None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:29.460450 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51795a-51b2-4ae7-89b3-5efc7ec1306f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:29.480633 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-ea51795a-51b2-4ae7-89b3-5efc7ec1306f None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:29.481827 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-ea51795a-51b2-4ae7-89b3-5efc7ec1306f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:29.486138 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 221/439] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:32:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 08 17:32:29.487160 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7f1a5-312c-4a93-8563-b3d80692bca2 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:29.591647 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 219/440] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:29.593701 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51795a-51b2-4ae7-89b3-5efc7ec1306f None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:29.645469 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:29.655219 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7f1a5-312c-4a93-8563-b3d80692bca2 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:29.695758 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:29.706808 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f474c-bf27-4a84-a154-48672c9a0217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:29.707094 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f474c-bf27-4a84-a154-48672c9a0217 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:29.707341 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f474c-bf27-4a84-a154-48672c9a0217 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:29.707608 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f474c-bf27-4a84-a154-48672c9a0217 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:29.720247 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f474c-bf27-4a84-a154-48672c9a0217 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:29.733631 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-d02f474c-bf27-4a84-a154-48672c9a0217 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:32:29.733631 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:29.733631 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:29.733631 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:29.733631 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:29.733631 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:29.733631 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:29.733631 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:29.733631 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:29.733631 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:29.733631 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:29.733631 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:29.733631 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:29.733631 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:29.733631 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:29.733631 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:29.734547 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:29.734547 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:29.734547 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:29.734547 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:29.734547 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:29.734547 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:29.734547 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:29.734547 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:29.734547 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:29.734547 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:29.734547 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:29.734547 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:29.734547 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:29.734547 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:29.734547 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:29.734547 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:29.735422 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:29.735422 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:29.735422 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:29.735422 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:29.735422 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:29.735422 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:29.735422 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:29.735422 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:29.735422 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:29.735422 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:29.735422 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:32:29.735422 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:29.738629 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 222/441] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 8 17:32:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:29.740366 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f474c-bf27-4a84-a154-48672c9a0217 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:29.762572 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51795a-51b2-4ae7-89b3-5efc7ec1306f None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:29.813118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5724b2-4582-4d4d-a702-7f78fe0d4192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:29.813501 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5724b2-4582-4d4d-a702-7f78fe0d4192 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:29.813757 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5724b2-4582-4d4d-a702-7f78fe0d4192 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:29.814035 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5724b2-4582-4d4d-a702-7f78fe0d4192 None admin] PATH_INFO: `/v3/projects/91b9959e38d042f2a5aa8e5757e79251` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:29.817003 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5724b2-4582-4d4d-a702-7f78fe0d4192 None admin] RBAC: Authorizing `identity:get_project(project_id=91b9959e38d042f2a5aa8e5757e79251)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:29.818246 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5724b2-4582-4d4d-a702-7f78fe0d4192 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:29.825830 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 220/442] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:32:29 2022] GET /identity/v3/projects/91b9959e38d042f2a5aa8e5757e79251 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:29.825830 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5724b2-4582-4d4d-a702-7f78fe0d4192 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:29.895589 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f474c-bf27-4a84-a154-48672c9a0217 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:29.932135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681a09b-1406-4cab-96f2-6f97bae96939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:29.932855 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681a09b-1406-4cab-96f2-6f97bae96939 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:29.933243 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681a09b-1406-4cab-96f2-6f97bae96939 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:29.933597 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681a09b-1406-4cab-96f2-6f97bae96939 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:29.945022 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681a09b-1406-4cab-96f2-6f97bae96939 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:29.949833 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-0681a09b-1406-4cab-96f2-6f97bae96939 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 17:32:29.949833 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:29.949833 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:29.949833 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:29.949833 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:29.949833 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:29.949833 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:29.949833 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:29.949833 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:29.949833 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:29.949833 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:29.949833 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:29.949833 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:29.949833 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:29.949833 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:29.949833 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:29.950714 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:29.950714 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:29.950714 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:29.950714 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:29.950714 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:29.950714 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:29.950714 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:29.950714 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:29.950714 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:29.950714 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:29.950714 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:29.950714 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:29.950714 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:29.950714 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:29.950714 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:29.950714 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:29.951504 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:29.951504 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:29.951504 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:29.951504 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:29.951504 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:29.951504 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:29.951504 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:29.951504 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:29.951504 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:29.951504 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:29.951504 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 17:32:29.951504 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:29.951504 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 223/443] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 8 17:32:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:29.952187 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681a09b-1406-4cab-96f2-6f97bae96939 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:29.954359 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5724b2-4582-4d4d-a702-7f78fe0d4192 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:29.956037 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:29.993487 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d679ec5-544e-4a90-9a1a-8e713f0d0e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:29.994021 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d679ec5-544e-4a90-9a1a-8e713f0d0e8d None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:29.994350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d679ec5-544e-4a90-9a1a-8e713f0d0e8d None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:29.994630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d679ec5-544e-4a90-9a1a-8e713f0d0e8d None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:29.995305 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d679ec5-544e-4a90-9a1a-8e713f0d0e8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:29.995736 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d679ec5-544e-4a90-9a1a-8e713f0d0e8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:29.997486 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d679ec5-544e-4a90-9a1a-8e713f0d0e8d None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:30.003869 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:30.007721 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 221/444] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:32:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:30.007721 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d679ec5-544e-4a90-9a1a-8e713f0d0e8d None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:30.077808 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681a09b-1406-4cab-96f2-6f97bae96939 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:30.118062 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc581a9-aceb-469c-928a-10ddc1fced07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:30.118690 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc581a9-aceb-469c-928a-10ddc1fced07 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:30.119296 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc581a9-aceb-469c-928a-10ddc1fced07 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:30.119296 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc581a9-aceb-469c-928a-10ddc1fced07 None admin] PATH_INFO: `/v3/groups/43d0f79c969c4a9689c32145518b100d` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:30.120338 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc581a9-aceb-469c-928a-10ddc1fced07 None admin] RBAC: Authorizing `identity:get_group(group_id=43d0f79c969c4a9689c32145518b100d)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:30.121822 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d679ec5-544e-4a90-9a1a-8e713f0d0e8d None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:30.121961 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc581a9-aceb-469c-928a-10ddc1fced07 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:30.125141 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 224/445] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Aug 8 17:32:29 2022] GET /identity/v3/groups/43d0f79c969c4a9689c32145518b100d => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:30.125141 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc581a9-aceb-469c-928a-10ddc1fced07 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:30.165602 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f7d7f-ff50-4b54-97e4-d0df8cf6643d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:30.166361 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f7d7f-ff50-4b54-97e4-d0df8cf6643d None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:30.166750 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f7d7f-ff50-4b54-97e4-d0df8cf6643d None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:30.167120 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f7d7f-ff50-4b54-97e4-d0df8cf6643d None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:30.167791 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f7d7f-ff50-4b54-97e4-d0df8cf6643d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:30.168094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f7d7f-ff50-4b54-97e4-d0df8cf6643d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:30.169485 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f7d7f-ff50-4b54-97e4-d0df8cf6643d None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:30.182901 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 222/446] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:32:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:30.182901 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f7d7f-ff50-4b54-97e4-d0df8cf6643d None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:30.214588 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:30.237231 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc581a9-aceb-469c-928a-10ddc1fced07 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:30.249022 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:30.274955 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042cb804-21d3-4b48-83b9-0324fd76057b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:30.275682 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042cb804-21d3-4b48-83b9-0324fd76057b None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:30.275971 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042cb804-21d3-4b48-83b9-0324fd76057b None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:30.276249 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042cb804-21d3-4b48-83b9-0324fd76057b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:30.289549 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f7d7f-ff50-4b54-97e4-d0df8cf6643d None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:30.326081 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7cd5c-e26c-441f-8913-d870dbf4d2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:30.326685 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7cd5c-e26c-441f-8913-d870dbf4d2c7 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:30.326964 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7cd5c-e26c-441f-8913-d870dbf4d2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:30.327298 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7cd5c-e26c-441f-8913-d870dbf4d2c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:30.328305 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7cd5c-e26c-441f-8913-d870dbf4d2c7 None admin] RBAC: Adding query filter params (group.id=43d0f79c969c4a9689c32145518b100d, role.id=adc45cdd4c9543b3b8b24141870f4b11, scope.project.id=91b9959e38d042f2a5aa8e5757e79251) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:30.328717 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7cd5c-e26c-441f-8913-d870dbf4d2c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:30.330295 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7cd5c-e26c-441f-8913-d870dbf4d2c7 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:30.336646 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 223/447] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Aug 8 17:32:30 2022] GET /identity/v3/role_assignments?group.id=43d0f79c969c4a9689c32145518b100d&scope.project.id=91b9959e38d042f2a5aa8e5757e79251&role.id=adc45cdd4c9543b3b8b24141870f4b11 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:30.337498 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7cd5c-e26c-441f-8913-d870dbf4d2c7 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:30.389866 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042cb804-21d3-4b48-83b9-0324fd76057b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:30.392534 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042cb804-21d3-4b48-83b9-0324fd76057b None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:30.475031 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:30.490617 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7cd5c-e26c-441f-8913-d870dbf4d2c7 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:30.540824 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb5e30-7cf3-40fe-8831-614bf5c9be3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:30.541596 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb5e30-7cf3-40fe-8831-614bf5c9be3b None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:30.541876 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb5e30-7cf3-40fe-8831-614bf5c9be3b None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:30.542151 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb5e30-7cf3-40fe-8831-614bf5c9be3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:30.545431 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 225/448] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:32:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:32:30.548983 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042cb804-21d3-4b48-83b9-0324fd76057b None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:30.564330 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:30.635657 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb5e30-7cf3-40fe-8831-614bf5c9be3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:30.638672 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb5e30-7cf3-40fe-8831-614bf5c9be3b None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:30.694345 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042cb804-21d3-4b48-83b9-0324fd76057b None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:30.750052 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169789c9-fc0a-4bf8-8034-f0494735c69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:30.750839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169789c9-fc0a-4bf8-8034-f0494735c69f None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:30.751125 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169789c9-fc0a-4bf8-8034-f0494735c69f None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:30.751412 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169789c9-fc0a-4bf8-8034-f0494735c69f None admin] PATH_INFO: `/v3/projects/e8e66549226e41208010bac52754a1ba` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:30.753150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169789c9-fc0a-4bf8-8034-f0494735c69f None admin] RBAC: Authorizing `identity:get_project(project_id=e8e66549226e41208010bac52754a1ba)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:30.754602 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169789c9-fc0a-4bf8-8034-f0494735c69f None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:30.757704 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 226/449] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:32:30 2022] GET /identity/v3/projects/e8e66549226e41208010bac52754a1ba => generated 344 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:32:30.763150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169789c9-fc0a-4bf8-8034-f0494735c69f None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:30.774376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:30.787928 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 224/450] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:32:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:32:30.793565 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb5e30-7cf3-40fe-8831-614bf5c9be3b None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:30.845653 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:30.877610 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169789c9-fc0a-4bf8-8034-f0494735c69f None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:30.901593 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb5e30-7cf3-40fe-8831-614bf5c9be3b None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:30.915721 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7200d95-46eb-48a5-a9b1-7c53c0106321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:30.916659 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7200d95-46eb-48a5-a9b1-7c53c0106321 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:30.916771 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7200d95-46eb-48a5-a9b1-7c53c0106321 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:30.917112 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7200d95-46eb-48a5-a9b1-7c53c0106321 None admin] PATH_INFO: `/v3/groups/6fc1cde4cc2a4e56b4ba1f6c7aa5bcfa` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:30.918351 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7200d95-46eb-48a5-a9b1-7c53c0106321 None admin] RBAC: Authorizing `identity:get_group(group_id=6fc1cde4cc2a4e56b4ba1f6c7aa5bcfa)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:30.920078 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7200d95-46eb-48a5-a9b1-7c53c0106321 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:30.926011 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 227/451] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Aug 8 17:32:30 2022] GET /identity/v3/groups/6fc1cde4cc2a4e56b4ba1f6c7aa5bcfa => generated 229 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:32:30.932395 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7200d95-46eb-48a5-a9b1-7c53c0106321 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:30.939365 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375652cf-cfa2-402b-be19-51d764b57007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:30.940073 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375652cf-cfa2-402b-be19-51d764b57007 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:30.940364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375652cf-cfa2-402b-be19-51d764b57007 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:30.940634 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375652cf-cfa2-402b-be19-51d764b57007 None admin] PATH_INFO: `/v3/projects/91b9959e38d042f2a5aa8e5757e79251` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:30.941774 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375652cf-cfa2-402b-be19-51d764b57007 None admin] RBAC: Authorizing `identity:get_project(project_id=91b9959e38d042f2a5aa8e5757e79251)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:30.943198 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375652cf-cfa2-402b-be19-51d764b57007 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:30.946033 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 225/452] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:32:30 2022] GET /identity/v3/projects/91b9959e38d042f2a5aa8e5757e79251 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:32:30.951070 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375652cf-cfa2-402b-be19-51d764b57007 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:31.014776 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:31.044789 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7200d95-46eb-48a5-a9b1-7c53c0106321 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:31.059553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375652cf-cfa2-402b-be19-51d764b57007 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:31.081729 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b0bd0-25e8-4d9c-93fb-1482beeb1a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:31.082341 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b0bd0-25e8-4d9c-93fb-1482beeb1a26 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:31.082594 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b0bd0-25e8-4d9c-93fb-1482beeb1a26 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:31.082864 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b0bd0-25e8-4d9c-93fb-1482beeb1a26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:31.083575 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b0bd0-25e8-4d9c-93fb-1482beeb1a26 None admin] RBAC: Adding query filter params (group.id=6fc1cde4cc2a4e56b4ba1f6c7aa5bcfa, role.id=5c25aa917ab34baabb795c54dd8a4d02, scope.project.id=e8e66549226e41208010bac52754a1ba) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:31.083900 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b0bd0-25e8-4d9c-93fb-1482beeb1a26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:31.085784 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b0bd0-25e8-4d9c-93fb-1482beeb1a26 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:31.091567 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 228/453] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Aug 8 17:32:30 2022] GET /identity/v3/role_assignments?group.id=6fc1cde4cc2a4e56b4ba1f6c7aa5bcfa&scope.project.id=e8e66549226e41208010bac52754a1ba&role.id=5c25aa917ab34baabb795c54dd8a4d02 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:32:31.104463 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada62614-c52e-4d82-9749-54fb01a78dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:31.105156 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada62614-c52e-4d82-9749-54fb01a78dda None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:31.105432 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada62614-c52e-4d82-9749-54fb01a78dda None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:31.105705 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada62614-c52e-4d82-9749-54fb01a78dda None admin] PATH_INFO: `/v3/groups/43d0f79c969c4a9689c32145518b100d` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:31.106951 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada62614-c52e-4d82-9749-54fb01a78dda None admin] RBAC: Authorizing `identity:get_group(group_id=43d0f79c969c4a9689c32145518b100d)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:31.108370 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada62614-c52e-4d82-9749-54fb01a78dda None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:31.110082 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 226/454] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Aug 8 17:32:30 2022] GET /identity/v3/groups/43d0f79c969c4a9689c32145518b100d => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:32:31.116589 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b0bd0-25e8-4d9c-93fb-1482beeb1a26 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:31.130263 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:31.231189 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b0bd0-25e8-4d9c-93fb-1482beeb1a26 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:31.272501 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87610ca0-6ec0-445d-8168-a2eeb38eacdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:31.273182 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87610ca0-6ec0-445d-8168-a2eeb38eacdd None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:31.273468 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87610ca0-6ec0-445d-8168-a2eeb38eacdd None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:31.273747 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87610ca0-6ec0-445d-8168-a2eeb38eacdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:31.274487 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87610ca0-6ec0-445d-8168-a2eeb38eacdd None admin] RBAC: Adding query filter params (group.id=43d0f79c969c4a9689c32145518b100d, role.id=0ff11803573b472ab020a59b7f452dcd, scope.project.id=91b9959e38d042f2a5aa8e5757e79251) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:31.274787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87610ca0-6ec0-445d-8168-a2eeb38eacdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:31.276236 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87610ca0-6ec0-445d-8168-a2eeb38eacdd None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:31.285572 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 229/455] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Aug 8 17:32:31 2022] GET /identity/v3/role_assignments?group.id=43d0f79c969c4a9689c32145518b100d&scope.project.id=91b9959e38d042f2a5aa8e5757e79251&role.id=0ff11803573b472ab020a59b7f452dcd => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:32:33.881441 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf0bbf-88d1-4515-a469-3ee63a7b8390 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:33.881976 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf0bbf-88d1-4515-a469-3ee63a7b8390 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:33.881976 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf0bbf-88d1-4515-a469-3ee63a7b8390 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:33.883541 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 227/456] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:33.899067 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a1358-65fe-429a-bc59-3edfd4b3c231 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:33.899859 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a1358-65fe-429a-bc59-3edfd4b3c231 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:33.900278 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a1358-65fe-429a-bc59-3edfd4b3c231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:33.922072 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-d05a1358-65fe-429a-bc59-3edfd4b3c231 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:33.923275 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-d05a1358-65fe-429a-bc59-3edfd4b3c231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:34.008110 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 230/457] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:34.056294 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf0bbf-88d1-4515-a469-3ee63a7b8390 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:34.109261 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe57ffb-3179-41c9-a2a4-2c0a7812ce67 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:34.109565 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe57ffb-3179-41c9-a2a4-2c0a7812ce67 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:34.109806 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe57ffb-3179-41c9-a2a4-2c0a7812ce67 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:34.111678 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 231/458] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 17:32:34.130982 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c275ae1-3a8f-4531-b534-ab68249bcb48 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:34.131419 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c275ae1-3a8f-4531-b534-ab68249bcb48 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:34.131754 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c275ae1-3a8f-4531-b534-ab68249bcb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:34.158175 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:34.175790 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-2c275ae1-3a8f-4531-b534-ab68249bcb48 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:34.177005 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-2c275ae1-3a8f-4531-b534-ab68249bcb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:34.202597 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf0bbf-88d1-4515-a469-3ee63a7b8390 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:34.263923 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:34.269417 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61286b3-6e81-4c17-9fc3-8472783b19e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:34.270061 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61286b3-6e81-4c17-9fc3-8472783b19e1 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:34.270337 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61286b3-6e81-4c17-9fc3-8472783b19e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:34.270609 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61286b3-6e81-4c17-9fc3-8472783b19e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:34.292751 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61286b3-6e81-4c17-9fc3-8472783b19e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:34.294281 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61286b3-6e81-4c17-9fc3-8472783b19e1 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:34.313374 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 232/459] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 17:32:34.328333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-f61286b3-6e81-4c17-9fc3-8472783b19e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:34.328333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:34.328333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:34.328333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:34.328333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:34.328333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:34.328333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:34.328333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:34.328333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:34.328333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:34.328333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:34.328333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:34.328333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:34.328333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:34.328333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:34.328333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:34.329359 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:34.329359 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:34.329359 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:34.329359 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:34.329359 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:34.329359 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:34.329359 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:34.329359 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:34.329359 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:34.329359 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:34.329359 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:34.329359 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:34.329359 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:34.329359 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:34.329359 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:34.329359 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:34.329359 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:34.330452 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:34.330452 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:34.330452 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:34.332116 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 228/460] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:34.337858 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c275ae1-3a8f-4531-b534-ab68249bcb48 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:34.348196 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61286b3-6e81-4c17-9fc3-8472783b19e1 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:34.526556 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c275ae1-3a8f-4531-b534-ab68249bcb48 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:34.545348 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61286b3-6e81-4c17-9fc3-8472783b19e1 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:34.586320 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488544e8-2825-45f1-8532-9f21ff465350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:34.587251 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488544e8-2825-45f1-8532-9f21ff465350 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:34.587532 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488544e8-2825-45f1-8532-9f21ff465350 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:34.587800 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488544e8-2825-45f1-8532-9f21ff465350 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:34.593802 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e5fbb-becf-48c9-904e-26ea26e87558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:34.594408 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e5fbb-becf-48c9-904e-26ea26e87558 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:34.594686 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e5fbb-becf-48c9-904e-26ea26e87558 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:34.594955 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e5fbb-becf-48c9-904e-26ea26e87558 None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:34.595594 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e5fbb-becf-48c9-904e-26ea26e87558 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:34.595894 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e5fbb-becf-48c9-904e-26ea26e87558 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:34.597464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e5fbb-becf-48c9-904e-26ea26e87558 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:34.599356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:34.601020 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488544e8-2825-45f1-8532-9f21ff465350 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:34.602936 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488544e8-2825-45f1-8532-9f21ff465350 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:34.611050 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 233/461] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:34.614232 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae98493-54f5-4c92-b2ab-9faccd6b0265 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:34.614232 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae98493-54f5-4c92-b2ab-9faccd6b0265 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:34.614232 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae98493-54f5-4c92-b2ab-9faccd6b0265 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:34.619247 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 234/462] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:34.620018 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae98493-54f5-4c92-b2ab-9faccd6b0265 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:34.620271 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-488544e8-2825-45f1-8532-9f21ff465350 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:34.620271 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:34.620271 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:34.620271 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:34.620271 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:34.620271 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:34.620271 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:34.620271 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:34.620271 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:34.620271 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:34.620271 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:34.620271 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:34.620271 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:34.620271 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:34.620271 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:34.620271 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:34.621364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:34.621364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:34.621364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:34.621364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:34.621364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:34.621364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:34.621364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:34.621364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:34.621364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:34.621364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:34.621364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:34.621364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:34.621364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:34.621364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:34.621364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:34.621364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:34.621364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:34.622452 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:34.622452 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:34.622452 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:34.624180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 229/463] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:34.625787 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b8d5a-ddff-495a-950c-0c444a21180f None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:34.627090 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b8d5a-ddff-495a-950c-0c444a21180f None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:34.627547 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b8d5a-ddff-495a-950c-0c444a21180f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:34.649932 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-5d1b8d5a-ddff-495a-950c-0c444a21180f None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:34.651998 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-5d1b8d5a-ddff-495a-950c-0c444a21180f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:34.688141 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:34.747286 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae98493-54f5-4c92-b2ab-9faccd6b0265 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:34.749187 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 230/464] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:34.750058 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b8d5a-ddff-495a-950c-0c444a21180f None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:34.789161 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237904e5-3faf-4e55-8d1d-fae9c6fa8730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:34.790136 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237904e5-3faf-4e55-8d1d-fae9c6fa8730 None admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:34.790663 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237904e5-3faf-4e55-8d1d-fae9c6fa8730 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:34.791679 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237904e5-3faf-4e55-8d1d-fae9c6fa8730 None admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:34.792820 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237904e5-3faf-4e55-8d1d-fae9c6fa8730 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:34.795358 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237904e5-3faf-4e55-8d1d-fae9c6fa8730 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:34.874156 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b8d5a-ddff-495a-950c-0c444a21180f None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:34.907729 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afefb30b-9261-44b2-ab5c-b713121315ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:34.908377 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefb30b-9261-44b2-ab5c-b713121315ed None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:34.908607 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefb30b-9261-44b2-ab5c-b713121315ed None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:34.908882 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefb30b-9261-44b2-ab5c-b713121315ed None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:34.909663 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afefb30b-9261-44b2-ab5c-b713121315ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:34.910253 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afefb30b-9261-44b2-ab5c-b713121315ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:34.915309 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afefb30b-9261-44b2-ab5c-b713121315ed None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:34.917489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 235/465] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Aug 8 17:32:34 2022] POST /identity/v3/users => generated 246 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:32:34.918303 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237904e5-3faf-4e55-8d1d-fae9c6fa8730 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:34.929793 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 231/466] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:34.931477 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856199bd-340f-42b2-b5bf-96779e51dab3 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:34.931964 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856199bd-340f-42b2-b5bf-96779e51dab3 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:34.932407 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856199bd-340f-42b2-b5bf-96779e51dab3 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:34.933891 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 232/467] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:34.946635 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d8b7f-1bc6-48cf-82be-816786488c23 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:34.946839 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d8b7f-1bc6-48cf-82be-816786488c23 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:34.947113 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d8b7f-1bc6-48cf-82be-816786488c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:34.973404 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-9e7d8b7f-1bc6-48cf-82be-816786488c23 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:34.975172 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-9e7d8b7f-1bc6-48cf-82be-816786488c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:34.996893 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:34.997604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:35.053270 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237904e5-3faf-4e55-8d1d-fae9c6fa8730 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:35.060655 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 233/468] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:35.061661 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d8b7f-1bc6-48cf-82be-816786488c23 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:35.092364 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d33fa-f969-434a-87c3-bdd60ec21963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:35.093008 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d33fa-f969-434a-87c3-bdd60ec21963 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:35.093359 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d33fa-f969-434a-87c3-bdd60ec21963 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:35.093643 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d33fa-f969-434a-87c3-bdd60ec21963 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:35.106312 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d33fa-f969-434a-87c3-bdd60ec21963 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:35.108735 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d33fa-f969-434a-87c3-bdd60ec21963 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:35.127406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-7c8d33fa-f969-434a-87c3-bdd60ec21963 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:35.127406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:35.127406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:35.127406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:35.127406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:35.127406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:35.127406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:35.127406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:35.127406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:35.127406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:35.127406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:35.127406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:35.127406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:35.127406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:35.127406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:35.127406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:35.128383 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:35.128383 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:35.128383 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:35.128383 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:35.128383 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:35.128383 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:35.128383 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:35.128383 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:35.128383 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:35.128383 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:35.128383 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:35.128383 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:35.128383 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:35.128383 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:35.128383 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:35.128383 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:35.128383 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:35.129327 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:35.129327 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:35.129327 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:35.129327 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 236/469] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:35.129551 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d33fa-f969-434a-87c3-bdd60ec21963 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:35.187691 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d8b7f-1bc6-48cf-82be-816786488c23 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:35.234356 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4828d3-a3b8-4ca7-88df-1d18b09d1b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:35.234889 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4828d3-a3b8-4ca7-88df-1d18b09d1b3e None admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:35.235169 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4828d3-a3b8-4ca7-88df-1d18b09d1b3e None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:35.235693 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4828d3-a3b8-4ca7-88df-1d18b09d1b3e None admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:35.236331 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4828d3-a3b8-4ca7-88df-1d18b09d1b3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:35.238287 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4828d3-a3b8-4ca7-88df-1d18b09d1b3e None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:35.265454 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d33fa-f969-434a-87c3-bdd60ec21963 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:35.267491 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:35.301456 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf6dd7-e046-48cd-bfbf-510402ef0b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:35.303010 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf6dd7-e046-48cd-bfbf-510402ef0b20 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:35.303982 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf6dd7-e046-48cd-bfbf-510402ef0b20 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:35.304474 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf6dd7-e046-48cd-bfbf-510402ef0b20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:35.315043 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf6dd7-e046-48cd-bfbf-510402ef0b20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:35.318544 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf6dd7-e046-48cd-bfbf-510402ef0b20 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:35.331935 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-9ecf6dd7-e046-48cd-bfbf-510402ef0b20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:35.331935 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:35.331935 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:35.331935 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:35.331935 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:35.331935 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:35.331935 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:35.331935 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:35.331935 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:35.331935 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:35.331935 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:35.331935 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:35.331935 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:35.331935 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:35.331935 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:35.331935 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:35.333069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:35.333069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:35.333069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:35.333069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:35.333069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:35.333069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:35.333069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:35.333069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:35.333069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:35.333069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:35.333069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:35.333069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:35.333069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:35.333069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:35.333069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:35.333069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:35.333069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:35.334149 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:35.334149 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:35.334149 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:35.334149 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 237/470] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:35.334769 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf6dd7-e046-48cd-bfbf-510402ef0b20 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:35.379144 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 234/471] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Aug 8 17:32:35 2022] POST /identity/v3/users => generated 248 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:32:35.391126 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ef20e-230a-4c46-b10e-e12bbeadc10c None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:35.391421 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ef20e-230a-4c46-b10e-e12bbeadc10c None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:35.391749 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ef20e-230a-4c46-b10e-e12bbeadc10c None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:35.393468 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 235/472] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:35.394206 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ef20e-230a-4c46-b10e-e12bbeadc10c None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:35.417358 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:35.469796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf6dd7-e046-48cd-bfbf-510402ef0b20 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:35.529811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe403c9c-f822-4c33-9373-4b9b9f09d13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:35.530463 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe403c9c-f822-4c33-9373-4b9b9f09d13b None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:35.530812 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe403c9c-f822-4c33-9373-4b9b9f09d13b None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:35.531174 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe403c9c-f822-4c33-9373-4b9b9f09d13b None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:35.531911 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe403c9c-f822-4c33-9373-4b9b9f09d13b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:35.532287 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe403c9c-f822-4c33-9373-4b9b9f09d13b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:35.533811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe403c9c-f822-4c33-9373-4b9b9f09d13b None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:35.550571 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 238/473] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:35.552100 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89805dd6-6a23-4b75-8b66-a3f00264cefb None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:35.552100 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89805dd6-6a23-4b75-8b66-a3f00264cefb None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:35.552873 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89805dd6-6a23-4b75-8b66-a3f00264cefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:35.566821 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ef20e-230a-4c46-b10e-e12bbeadc10c None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:35.572993 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-89805dd6-6a23-4b75-8b66-a3f00264cefb None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:35.574224 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-89805dd6-6a23-4b75-8b66-a3f00264cefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:35.584504 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:35.607653 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef4dbc-0ebe-41c2-8e2b-a92a98530328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:35.608264 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef4dbc-0ebe-41c2-8e2b-a92a98530328 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:35.608542 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef4dbc-0ebe-41c2-8e2b-a92a98530328 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:35.608809 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef4dbc-0ebe-41c2-8e2b-a92a98530328 None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:35.609520 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef4dbc-0ebe-41c2-8e2b-a92a98530328 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:35.609824 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef4dbc-0ebe-41c2-8e2b-a92a98530328 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:35.611453 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef4dbc-0ebe-41c2-8e2b-a92a98530328 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:35.624659 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 236/474] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:35.625368 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef4dbc-0ebe-41c2-8e2b-a92a98530328 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:35.658820 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 239/475] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:35.659650 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89805dd6-6a23-4b75-8b66-a3f00264cefb None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:35.703274 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:35.749064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef4dbc-0ebe-41c2-8e2b-a92a98530328 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:35.790882 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89805dd6-6a23-4b75-8b66-a3f00264cefb None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:35.794423 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc69e9-8605-4d3e-ac3c-05904cb0f391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:35.795308 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc69e9-8605-4d3e-ac3c-05904cb0f391 None admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:35.795868 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc69e9-8605-4d3e-ac3c-05904cb0f391 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:35.796363 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc69e9-8605-4d3e-ac3c-05904cb0f391 None admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:35.797244 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc69e9-8605-4d3e-ac3c-05904cb0f391 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:35.798882 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc69e9-8605-4d3e-ac3c-05904cb0f391 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:35.830380 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34b01d-dc81-46e3-914d-4faa9449d677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:35.831041 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34b01d-dc81-46e3-914d-4faa9449d677 None admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:35.831327 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34b01d-dc81-46e3-914d-4faa9449d677 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:35.831599 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34b01d-dc81-46e3-914d-4faa9449d677 None admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:35.832294 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34b01d-dc81-46e3-914d-4faa9449d677 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:35.834561 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34b01d-dc81-46e3-914d-4faa9449d677 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:35.910836 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 237/476] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Aug 8 17:32:35 2022] POST /identity/v3/users => generated 248 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:32:35.912345 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc69e9-8605-4d3e-ac3c-05904cb0f391 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:35.930486 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:35.945280 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 240/477] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Aug 8 17:32:35 2022] POST /identity/v3/users => generated 249 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:32:36.064673 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc69e9-8605-4d3e-ac3c-05904cb0f391 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:36.095508 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:36.116930 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21597f1a-8635-4c19-9957-41c169fe52b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:36.117944 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21597f1a-8635-4c19-9957-41c169fe52b4 None admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:36.118442 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21597f1a-8635-4c19-9957-41c169fe52b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:36.118934 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21597f1a-8635-4c19-9957-41c169fe52b4 None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:36.119775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21597f1a-8635-4c19-9957-41c169fe52b4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:36.121560 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21597f1a-8635-4c19-9957-41c169fe52b4 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:36.162743 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.sql.core [None req-21597f1a-8635-4c19-9957-41c169fe52b4 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 08 17:32:36.162743 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 08 17:32:36.162743 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [parameters: {'id': '2b9e76e41e4941ec90bcf3c750161239', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 08 17:32:36.162743 dv-cinder-852364-1-smb devstack@keystone.service[86920]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86920) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 08 17:32:36.179628 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-21597f1a-8635-4c19-9957-41c169fe52b4 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 08 17:32:36.179628 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:36.179628 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 08 17:32:36.179628 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 08 17:32:36.179628 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 08 17:32:36.179628 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 08 17:32:36.179628 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 08 17:32:36.179628 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application result = self._query(query) Aug 08 17:32:36.179628 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 08 17:32:36.179628 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application conn.query(q) Aug 08 17:32:36.179628 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 08 17:32:36.179628 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 08 17:32:36.179628 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 08 17:32:36.179628 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application result.read() Aug 08 17:32:36.179628 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 08 17:32:36.180570 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 08 17:32:36.180570 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 08 17:32:36.180570 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 08 17:32:36.180570 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 08 17:32:36.180570 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 08 17:32:36.180570 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 08 17:32:36.180570 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 08 17:32:36.180570 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 08 17:32:36.180570 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:36.180570 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 08 17:32:36.180570 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:36.180570 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:36.180570 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 08 17:32:36.180570 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 08 17:32:36.180570 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 08 17:32:36.180570 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return ref.to_dict() Aug 08 17:32:36.180570 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 08 17:32:36.180570 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application next(self.gen) Aug 08 17:32:36.181564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 08 17:32:36.181564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application yield resource Aug 08 17:32:36.181564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 08 17:32:36.181564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application next(self.gen) Aug 08 17:32:36.181564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 08 17:32:36.181564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self.session.rollback() Aug 08 17:32:36.181564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 08 17:32:36.181564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self.force_reraise() Aug 08 17:32:36.181564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 08 17:32:36.181564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise self.value Aug 08 17:32:36.181564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 08 17:32:36.181564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 08 17:32:36.181564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 08 17:32:36.181564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application session.commit() Aug 08 17:32:36.181564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 08 17:32:36.181564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 08 17:32:36.181564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 08 17:32:36.182440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._prepare_impl() Aug 08 17:32:36.182440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 08 17:32:36.182440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self.session.flush() Aug 08 17:32:36.182440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 08 17:32:36.182440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._flush(objects) Aug 08 17:32:36.182440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 08 17:32:36.182440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 08 17:32:36.182440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 08 17:32:36.182440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application compat.raise_( Aug 08 17:32:36.182440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 08 17:32:36.182440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception Aug 08 17:32:36.182440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 08 17:32:36.182440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application flush_context.execute() Aug 08 17:32:36.182440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 08 17:32:36.182440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rec.execute(self) Aug 08 17:32:36.182440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 08 17:32:36.182440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 08 17:32:36.183350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 08 17:32:36.183350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 08 17:32:36.183350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 08 17:32:36.183350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 08 17:32:36.183350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 08 17:32:36.183350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 08 17:32:36.183350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 08 17:32:36.183350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 08 17:32:36.183350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 08 17:32:36.183350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 08 17:32:36.183350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 08 17:32:36.183350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 08 17:32:36.183350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 08 17:32:36.183350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 08 17:32:36.183350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 08 17:32:36.183350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception Aug 08 17:32:36.185794 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 08 17:32:36.185794 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 08 17:32:36.185794 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 08 17:32:36.185794 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 08 17:32:36.185794 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 08 17:32:36.185794 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application result = self._query(query) Aug 08 17:32:36.185794 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 08 17:32:36.185794 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application conn.query(q) Aug 08 17:32:36.185794 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 08 17:32:36.185794 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 08 17:32:36.185794 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 08 17:32:36.185794 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application result.read() Aug 08 17:32:36.185794 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 08 17:32:36.185794 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 08 17:32:36.185794 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 08 17:32:36.185794 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 08 17:32:36.187863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 08 17:32:36.187863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 08 17:32:36.187863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 08 17:32:36.187863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 08 17:32:36.187863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 08 17:32:36.187863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 08 17:32:36.187863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [parameters: {'id': '2b9e76e41e4941ec90bcf3c750161239', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 08 17:32:36.187863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 08 17:32:36.187863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:36.187863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 17:32:36.187863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:36.187863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:36.187863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:36.187863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:36.187863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:36.187863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:36.194155 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:36.194155 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:36.194155 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:36.194155 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:36.194155 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:36.194155 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:36.194155 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 08 17:32:36.194155 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 08 17:32:36.194155 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:36.194155 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:36.194155 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 08 17:32:36.194155 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 08 17:32:36.194155 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 08 17:32:36.194155 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 08 17:32:36.194155 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 08 17:32:36.194155 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:36.196168 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 238/478] 10.222.0.70 () {60 vars in 1131 bytes} [Mon Aug 8 17:32:35 2022] POST /identity/v3/roles => generated 144 bytes in 273 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:36.196751 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34b01d-dc81-46e3-914d-4faa9449d677 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:36.310005 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34b01d-dc81-46e3-914d-4faa9449d677 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:36.346121 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0dac59-5dca-4b63-b31c-1e9e4b438fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:36.346685 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0dac59-5dca-4b63-b31c-1e9e4b438fd6 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:36.346970 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0dac59-5dca-4b63-b31c-1e9e4b438fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:36.347246 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0dac59-5dca-4b63-b31c-1e9e4b438fd6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:36.359059 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0dac59-5dca-4b63-b31c-1e9e4b438fd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:36.365938 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-be0dac59-5dca-4b63-b31c-1e9e4b438fd6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 17:32:36.365938 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:36.365938 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:36.365938 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:36.365938 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:36.365938 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:36.365938 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:36.365938 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:36.365938 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:36.365938 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:36.365938 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:36.365938 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:36.365938 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:36.365938 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:36.365938 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:36.365938 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:36.366844 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:36.366844 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:36.366844 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:36.366844 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:36.366844 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:36.366844 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:36.366844 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:36.366844 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:36.366844 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:36.366844 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:36.366844 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:36.366844 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:36.366844 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:36.366844 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:36.366844 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:36.366844 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:36.367645 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:36.367645 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:36.367645 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:36.367645 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:36.367645 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:36.367645 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:36.367645 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:36.367645 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:36.367645 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:36.367645 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:36.367645 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 17:32:36.367645 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:36.367645 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 241/479] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 8 17:32:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:36.372954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21597f1a-8635-4c19-9957-41c169fe52b4 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:36.481980 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21597f1a-8635-4c19-9957-41c169fe52b4 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:36.517002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd758a-d520-407c-9045-49fdf5e8e516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:36.517647 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd758a-d520-407c-9045-49fdf5e8e516 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:36.517927 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd758a-d520-407c-9045-49fdf5e8e516 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:36.518196 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd758a-d520-407c-9045-49fdf5e8e516 None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:36.518863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd758a-d520-407c-9045-49fdf5e8e516 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:36.519166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd758a-d520-407c-9045-49fdf5e8e516 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:36.520556 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd758a-d520-407c-9045-49fdf5e8e516 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:36.529619 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 239/480] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:32:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:37.325070 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90466be-436b-4135-8267-7ed90592c568 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:37.325070 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90466be-436b-4135-8267-7ed90592c568 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:37.325070 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90466be-436b-4135-8267-7ed90592c568 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:37.325070 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 242/481] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:37.341824 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87580087-f5b5-41e5-9f18-0e40867650a4 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:37.342466 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87580087-f5b5-41e5-9f18-0e40867650a4 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:37.342670 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87580087-f5b5-41e5-9f18-0e40867650a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:37.384988 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-87580087-f5b5-41e5-9f18-0e40867650a4 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:37.386233 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-87580087-f5b5-41e5-9f18-0e40867650a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:37.457848 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:37.497356 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 240/482] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 17:32:37.527424 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90466be-436b-4135-8267-7ed90592c568 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:37.654139 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:37.705876 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90466be-436b-4135-8267-7ed90592c568 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:37.740277 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20622718-39fb-49a4-a929-23ed89fc6f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:37.741079 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20622718-39fb-49a4-a929-23ed89fc6f06 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:37.741285 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20622718-39fb-49a4-a929-23ed89fc6f06 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:37.741559 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20622718-39fb-49a4-a929-23ed89fc6f06 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:37.751818 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20622718-39fb-49a4-a929-23ed89fc6f06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:37.757464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-20622718-39fb-49a4-a929-23ed89fc6f06 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:32:37.757464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:37.757464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:37.757464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:37.757464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:37.757464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:37.757464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:37.757464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:37.757464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:37.757464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:37.757464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:37.757464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:37.757464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:37.757464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:37.757464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:37.757464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:37.758352 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:37.758352 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:37.758352 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:37.758352 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:37.758352 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:37.758352 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:37.758352 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:37.758352 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:37.758352 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:37.758352 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:37.758352 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:37.758352 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:37.758352 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:37.758352 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:37.758352 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:37.758352 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:37.759160 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:37.759160 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:37.759160 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:37.759160 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:37.759160 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:37.759160 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:37.759160 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:37.759160 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:37.759160 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:37.759160 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:37.759160 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:32:37.759160 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:37.759160 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 243/483] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 8 17:32:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:37.770291 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87580087-f5b5-41e5-9f18-0e40867650a4 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:37.790591 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eee805-4647-4549-bbfb-509d1b26e066 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:37.790869 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eee805-4647-4549-bbfb-509d1b26e066 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:37.791145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eee805-4647-4549-bbfb-509d1b26e066 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:37.792467 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 244/484] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:37.806675 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6fc45-a0aa-4128-a391-3f4d22c299dd None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:37.806959 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6fc45-a0aa-4128-a391-3f4d22c299dd None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:37.807237 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6fc45-a0aa-4128-a391-3f4d22c299dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:37.838033 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-96c6fc45-a0aa-4128-a391-3f4d22c299dd None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:37.839257 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-96c6fc45-a0aa-4128-a391-3f4d22c299dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:37.882363 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87580087-f5b5-41e5-9f18-0e40867650a4 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:37.925823 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d471b-43d3-440a-861f-01a348372f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:37.926352 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d471b-43d3-440a-861f-01a348372f7a None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:37.926636 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d471b-43d3-440a-861f-01a348372f7a None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:37.926907 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d471b-43d3-440a-861f-01a348372f7a None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:37.928378 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026d471b-43d3-440a-861f-01a348372f7a None admin] RBAC: Adding query filter params (name=service) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:37.928506 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026d471b-43d3-440a-861f-01a348372f7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:37.929824 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026d471b-43d3-440a-861f-01a348372f7a None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:37.946765 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 241/485] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 8 17:32:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:37.955595 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 245/486] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 17:32:37.957151 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d471b-43d3-440a-861f-01a348372f7a None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:37.980383 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6fc45-a0aa-4128-a391-3f4d22c299dd None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:38.031662 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:38.053433 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:38.144462 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6fc45-a0aa-4128-a391-3f4d22c299dd None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:38.154440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d471b-43d3-440a-861f-01a348372f7a None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:38.202041 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1983257-5fbb-4cbb-a80e-cfce8922c5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:38.202668 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1983257-5fbb-4cbb-a80e-cfce8922c5d3 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:38.202952 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1983257-5fbb-4cbb-a80e-cfce8922c5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:38.203222 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1983257-5fbb-4cbb-a80e-cfce8922c5d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:38.214337 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572850da-fd8f-4b53-8b54-ac768c01e9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:38.214798 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1983257-5fbb-4cbb-a80e-cfce8922c5d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:38.215380 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572850da-fd8f-4b53-8b54-ac768c01e9ef None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:38.215803 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572850da-fd8f-4b53-8b54-ac768c01e9ef None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:38.216214 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572850da-fd8f-4b53-8b54-ac768c01e9ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:38.216324 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1983257-5fbb-4cbb-a80e-cfce8922c5d3 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:38.230898 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-c1983257-5fbb-4cbb-a80e-cfce8922c5d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:38.230898 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:38.230898 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:38.230898 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:38.230898 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:38.230898 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:38.230898 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:38.230898 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:38.230898 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:38.230898 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:38.230898 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:38.230898 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:38.230898 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:38.230898 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:38.230898 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:38.230898 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:38.232172 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:38.232172 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:38.232172 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:38.232172 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:38.232172 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:38.232172 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:38.232172 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:38.232172 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:38.232172 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:38.232172 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:38.232172 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:38.232172 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:38.232172 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:38.232172 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:38.232172 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:38.232172 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:38.232172 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:38.233243 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:38.233243 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:38.233243 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:38.233586 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 242/487] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:38.238129 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1983257-5fbb-4cbb-a80e-cfce8922c5d3 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:38.246187 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572850da-fd8f-4b53-8b54-ac768c01e9ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:38.251336 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-572850da-fd8f-4b53-8b54-ac768c01e9ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:32:38.251336 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:38.251336 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:38.251336 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:38.251336 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:38.251336 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:38.251336 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:38.251336 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:38.251336 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:38.251336 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:38.251336 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:38.251336 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:38.251336 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:38.251336 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:38.251336 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:38.251336 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:38.252317 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:38.252317 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:38.252317 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:38.252317 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:38.252317 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:38.252317 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:38.252317 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:38.252317 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:38.252317 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:38.252317 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:38.252317 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:38.252317 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:38.252317 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:38.252317 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:38.252317 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:38.252317 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:38.253154 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:38.253154 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:38.253154 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:38.253154 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:38.253154 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:38.253154 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:38.253154 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:38.253154 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:38.253154 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:38.253154 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:38.253154 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:32:38.253154 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:38.259173 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 246/488] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 8 17:32:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:32:38.264455 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572850da-fd8f-4b53-8b54-ac768c01e9ef None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:38.370054 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:38.382822 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1983257-5fbb-4cbb-a80e-cfce8922c5d3 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:38.453762 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c7302-2e43-440a-bf40-c24d1544b1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:38.454287 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c7302-2e43-440a-bf40-c24d1544b1dd None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:38.454570 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c7302-2e43-440a-bf40-c24d1544b1dd None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:38.454844 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c7302-2e43-440a-bf40-c24d1544b1dd None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:38.455489 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c7302-2e43-440a-bf40-c24d1544b1dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:38.455791 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c7302-2e43-440a-bf40-c24d1544b1dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:38.457184 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c7302-2e43-440a-bf40-c24d1544b1dd None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:38.474102 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572850da-fd8f-4b53-8b54-ac768c01e9ef None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:38.484958 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 243/489] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:38.486113 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c7302-2e43-440a-bf40-c24d1544b1dd None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:38.498423 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:38.545617 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bcb646-3962-48a0-84e5-3b7fe603d6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:38.546232 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcb646-3962-48a0-84e5-3b7fe603d6da None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:38.546519 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcb646-3962-48a0-84e5-3b7fe603d6da None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:38.546795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcb646-3962-48a0-84e5-3b7fe603d6da None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:38.547464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bcb646-3962-48a0-84e5-3b7fe603d6da None admin] RBAC: Adding query filter params (name=service) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:38.547765 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bcb646-3962-48a0-84e5-3b7fe603d6da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:38.551466 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bcb646-3962-48a0-84e5-3b7fe603d6da None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:38.570565 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 247/490] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 8 17:32:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:32:38.575028 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bcb646-3962-48a0-84e5-3b7fe603d6da None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:38.682145 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c7302-2e43-440a-bf40-c24d1544b1dd None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:38.729265 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bcb646-3962-48a0-84e5-3b7fe603d6da None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:38.730085 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f3d2b-24da-4aad-add0-c7612b8bc831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:38.731032 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f3d2b-24da-4aad-add0-c7612b8bc831 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:38.731316 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f3d2b-24da-4aad-add0-c7612b8bc831 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:38.731592 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f3d2b-24da-4aad-add0-c7612b8bc831 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:38.743607 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f3d2b-24da-4aad-add0-c7612b8bc831 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:38.745726 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f3d2b-24da-4aad-add0-c7612b8bc831 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:38.763727 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-3a0f3d2b-24da-4aad-add0-c7612b8bc831 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 17:32:38.763727 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:38.763727 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:38.763727 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:38.763727 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:38.763727 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:38.763727 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:38.763727 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:38.763727 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:38.763727 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:38.763727 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:38.763727 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:38.763727 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:32:38.763727 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:32:38.763727 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:32:38.763727 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:32:38.764696 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:38.764696 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:38.764696 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:32:38.764696 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:32:38.764696 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:32:38.764696 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:32:38.764696 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:38.764696 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:38.764696 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:38.764696 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:38.764696 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:38.764696 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:38.764696 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:38.764696 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:38.764696 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:38.764696 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:38.764696 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:38.764696 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:38.765639 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:38.765639 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:38.765639 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:32:38.765639 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:32:38.765639 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:32:38.765639 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:32:38.765639 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:32:38.765639 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:32:38.765639 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 17:32:38.765639 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:38.765639 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 244/491] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Aug 8 17:32:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:38.766227 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58271213-525c-4cc5-af1c-17c6e4772902 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:38.766442 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58271213-525c-4cc5-af1c-17c6e4772902 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:38.768159 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58271213-525c-4cc5-af1c-17c6e4772902 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:38.768286 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d078bb8-5494-4bcc-a483-db402321c734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:38.768395 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 245/492] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:38.768479 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d078bb8-5494-4bcc-a483-db402321c734 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:38.769627 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d078bb8-5494-4bcc-a483-db402321c734 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:38.769627 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d078bb8-5494-4bcc-a483-db402321c734 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:38.770294 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58271213-525c-4cc5-af1c-17c6e4772902 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:38.784397 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d078bb8-5494-4bcc-a483-db402321c734 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:38.785896 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d078bb8-5494-4bcc-a483-db402321c734 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:38.791900 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:38.801558 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-9d078bb8-5494-4bcc-a483-db402321c734 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:38.801558 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:38.801558 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:38.801558 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:38.801558 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:38.801558 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:38.801558 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:38.801558 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:38.801558 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:38.801558 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:38.801558 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:38.801558 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:38.801558 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:38.801558 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:38.801558 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:38.801558 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:38.802754 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:38.802754 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:38.802754 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:38.802754 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:38.802754 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:38.802754 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:38.802754 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:38.802754 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:38.802754 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:38.802754 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:38.802754 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:38.802754 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:38.802754 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:38.802754 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:38.802754 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:38.802754 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:38.802754 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:38.803843 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:38.803843 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:38.803843 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:38.803843 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 248/493] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:38.804111 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893e1ef-983c-420c-87d1-cd915745b86f None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:38.804350 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893e1ef-983c-420c-87d1-cd915745b86f None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:38.804625 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893e1ef-983c-420c-87d1-cd915745b86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:38.823823 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-c893e1ef-983c-420c-87d1-cd915745b86f None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:38.825063 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-c893e1ef-983c-420c-87d1-cd915745b86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:38.844539 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:38.916044 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58271213-525c-4cc5-af1c-17c6e4772902 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:38.916235 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 249/494] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:38.916235 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893e1ef-983c-420c-87d1-cd915745b86f None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:38.961593 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f89294-7d52-4210-ac6e-bef92ab1f2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:38.962250 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f89294-7d52-4210-ac6e-bef92ab1f2f7 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:38.962582 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f89294-7d52-4210-ac6e-bef92ab1f2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:38.962862 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f89294-7d52-4210-ac6e-bef92ab1f2f7 None admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:38.963588 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f89294-7d52-4210-ac6e-bef92ab1f2f7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:38.963891 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f89294-7d52-4210-ac6e-bef92ab1f2f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:38.965484 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f89294-7d52-4210-ac6e-bef92ab1f2f7 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:39.004469 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 246/495] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Aug 8 17:32:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:32:39.005324 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f89294-7d52-4210-ac6e-bef92ab1f2f7 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:39.051895 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893e1ef-983c-420c-87d1-cd915745b86f None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:39.081191 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:39.088859 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef70cc-b6bf-4809-8925-e2402b27d404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:39.089494 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef70cc-b6bf-4809-8925-e2402b27d404 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:39.090042 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef70cc-b6bf-4809-8925-e2402b27d404 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:39.090042 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef70cc-b6bf-4809-8925-e2402b27d404 None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:39.090721 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef70cc-b6bf-4809-8925-e2402b27d404 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:39.091022 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef70cc-b6bf-4809-8925-e2402b27d404 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:39.092390 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef70cc-b6bf-4809-8925-e2402b27d404 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:39.108317 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 250/496] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:39.108317 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef70cc-b6bf-4809-8925-e2402b27d404 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:39.118346 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f89294-7d52-4210-ac6e-bef92ab1f2f7 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:39.123565 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:39.155817 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec4a9c-6df9-4354-8875-d6dd74d00654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:39.156541 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec4a9c-6df9-4354-8875-d6dd74d00654 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:39.156822 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec4a9c-6df9-4354-8875-d6dd74d00654 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:39.157128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec4a9c-6df9-4354-8875-d6dd74d00654 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:39.168064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec4a9c-6df9-4354-8875-d6dd74d00654 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:39.172686 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-f0ec4a9c-6df9-4354-8875-d6dd74d00654 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:32:39.172686 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:39.172686 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:39.172686 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:39.172686 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:39.172686 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:39.172686 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:39.172686 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:39.172686 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:39.172686 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:39.172686 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:39.172686 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:39.172686 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:39.172686 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:39.172686 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:39.172686 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:39.173624 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:39.173624 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:39.173624 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:39.173624 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:39.173624 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:39.173624 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:39.173624 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:39.173624 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:39.173624 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:39.173624 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:39.173624 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:39.173624 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:39.173624 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:39.173624 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:39.173624 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:39.173624 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:39.174475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:39.174475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:39.174475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:39.174475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:39.174475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:39.174475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:39.174475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:39.174475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:39.174475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:39.174475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:39.174475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:32:39.174475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:39.174475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 247/497] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 8 17:32:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:39.175173 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72062085-0724-4d8e-a17a-3adecc6cbe64 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:39.175242 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72062085-0724-4d8e-a17a-3adecc6cbe64 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:39.175830 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72062085-0724-4d8e-a17a-3adecc6cbe64 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:39.177640 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 248/498] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:39.182054 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72062085-0724-4d8e-a17a-3adecc6cbe64 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:39.225265 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef70cc-b6bf-4809-8925-e2402b27d404 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:39.264856 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c6500-6ebf-4481-a46a-388057a0c837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:39.265492 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c6500-6ebf-4481-a46a-388057a0c837 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:39.265698 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c6500-6ebf-4481-a46a-388057a0c837 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:39.265971 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c6500-6ebf-4481-a46a-388057a0c837 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:39.289094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72062085-0724-4d8e-a17a-3adecc6cbe64 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:39.317398 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:39.323594 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970e99e-3340-4249-ae4b-da58eeb4f08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:39.324216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970e99e-3340-4249-ae4b-da58eeb4f08d None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:39.324493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970e99e-3340-4249-ae4b-da58eeb4f08d None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:39.324774 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970e99e-3340-4249-ae4b-da58eeb4f08d None admin] PATH_INFO: `/v3/users/glance` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:39.331735 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d970e99e-3340-4249-ae4b-da58eeb4f08d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:39.333253 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d970e99e-3340-4249-ae4b-da58eeb4f08d None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:39.334075 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c6500-6ebf-4481-a46a-388057a0c837 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:39.335504 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c6500-6ebf-4481-a46a-388057a0c837 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:39.344937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-d970e99e-3340-4249-ae4b-da58eeb4f08d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 08 17:32:39.344937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:39.344937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:39.344937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:39.344937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:39.344937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:39.344937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:39.344937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:39.344937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:39.344937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:39.344937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:39.344937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:39.344937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:32:39.344937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:32:39.344937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:32:39.344937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:32:39.346065 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:39.346065 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:39.346065 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:32:39.346065 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:32:39.346065 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:32:39.346065 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:32:39.346065 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:39.346065 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:39.346065 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:39.346065 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:39.346065 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:39.346065 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:39.346065 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:39.346065 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:39.346065 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:39.346065 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:39.346065 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:39.346065 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:39.347094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:39.347094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:39.347094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:32:39.347094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:32:39.347094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:32:39.347094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:32:39.347094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:32:39.347094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:32:39.347094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 08 17:32:39.347094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:39.347094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 249/499] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:32:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:39.347094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970e99e-3340-4249-ae4b-da58eeb4f08d None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:39.354601 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:39.441775 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 251/500] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:32:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:32:39.443722 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588b08e-a1dc-4dd5-b585-f6c2d83c4dba None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:39.444012 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588b08e-a1dc-4dd5-b585-f6c2d83c4dba None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:39.444287 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588b08e-a1dc-4dd5-b585-f6c2d83c4dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:39.454540 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970e99e-3340-4249-ae4b-da58eeb4f08d None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:39.462154 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-9588b08e-a1dc-4dd5-b585-f6c2d83c4dba None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:39.463340 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-9588b08e-a1dc-4dd5-b585-f6c2d83c4dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:39.488458 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5f9be-67c9-480c-97ba-614998e9ccf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:39.489079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5f9be-67c9-480c-97ba-614998e9ccf4 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:39.489942 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5f9be-67c9-480c-97ba-614998e9ccf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:39.490232 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5f9be-67c9-480c-97ba-614998e9ccf4 None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:39.490891 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5f9be-67c9-480c-97ba-614998e9ccf4 None admin] RBAC: Adding query filter params (name=service) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:39.491193 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5f9be-67c9-480c-97ba-614998e9ccf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:39.492560 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5f9be-67c9-480c-97ba-614998e9ccf4 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:39.500344 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 250/501] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 8 17:32:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:39.501525 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de38c41-749e-478d-b79c-7a270b79043a None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:39.501809 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de38c41-749e-478d-b79c-7a270b79043a None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:39.502081 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de38c41-749e-478d-b79c-7a270b79043a None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:39.503265 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 251/502] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:39.503948 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de38c41-749e-478d-b79c-7a270b79043a None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:39.532561 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 252/503] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:39.533353 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588b08e-a1dc-4dd5-b585-f6c2d83c4dba None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:39.571340 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:39.578271 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:39.619864 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de38c41-749e-478d-b79c-7a270b79043a None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:39.632654 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588b08e-a1dc-4dd5-b585-f6c2d83c4dba None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:39.652670 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08286ea2-34d8-4191-a621-7e74f080358c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:39.653297 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08286ea2-34d8-4191-a621-7e74f080358c None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:39.653574 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08286ea2-34d8-4191-a621-7e74f080358c None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:39.653847 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08286ea2-34d8-4191-a621-7e74f080358c None admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:39.654564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08286ea2-34d8-4191-a621-7e74f080358c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:39.654866 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08286ea2-34d8-4191-a621-7e74f080358c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:39.656294 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08286ea2-34d8-4191-a621-7e74f080358c None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:39.667205 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2dfa7-d543-45c9-8cbf-56cd93679e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:39.667825 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2dfa7-d543-45c9-8cbf-56cd93679e18 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:39.668103 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2dfa7-d543-45c9-8cbf-56cd93679e18 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:39.668373 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2dfa7-d543-45c9-8cbf-56cd93679e18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:39.673497 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 252/504] 10.222.0.70 () {56 vars in 1137 bytes} [Mon Aug 8 17:32:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:39.674290 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08286ea2-34d8-4191-a621-7e74f080358c None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:39.683181 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2dfa7-d543-45c9-8cbf-56cd93679e18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:39.684687 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2dfa7-d543-45c9-8cbf-56cd93679e18 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:39.699263 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-e2c2dfa7-d543-45c9-8cbf-56cd93679e18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:39.699263 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:39.699263 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:39.699263 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:39.699263 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:39.699263 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:39.699263 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:39.699263 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:39.699263 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:39.699263 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:39.699263 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:39.699263 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:39.699263 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:39.699263 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:39.699263 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:39.699263 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:39.700356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:39.700356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:39.700356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:39.700356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:39.700356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:39.700356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:39.700356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:39.700356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:39.700356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:39.700356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:39.700356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:39.700356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:39.700356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:39.700356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:39.700356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:39.700356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:39.700356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:39.701245 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:39.701245 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:39.701245 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:39.701245 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 253/505] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:39.701475 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd4562-4150-436c-b9b3-7c636bc1c0e7 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:39.701771 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd4562-4150-436c-b9b3-7c636bc1c0e7 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:39.702069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd4562-4150-436c-b9b3-7c636bc1c0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:39.719614 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-a8dd4562-4150-436c-b9b3-7c636bc1c0e7 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:39.720817 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-a8dd4562-4150-436c-b9b3-7c636bc1c0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:39.777038 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08286ea2-34d8-4191-a621-7e74f080358c None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:39.787816 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 254/506] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:39.788591 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd4562-4150-436c-b9b3-7c636bc1c0e7 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:39.788751 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:39.812540 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9dbab-5640-42fb-8ea4-98aa126a4f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:39.813191 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9dbab-5640-42fb-8ea4-98aa126a4f4a None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:39.813473 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9dbab-5640-42fb-8ea4-98aa126a4f4a None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:39.813742 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9dbab-5640-42fb-8ea4-98aa126a4f4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:39.814731 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:39.823434 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9dbab-5640-42fb-8ea4-98aa126a4f4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:39.824856 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9dbab-5640-42fb-8ea4-98aa126a4f4a None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:39.840079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-08a9dbab-5640-42fb-8ea4-98aa126a4f4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:39.840079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:39.840079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:39.840079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:39.840079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:39.840079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:39.840079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:39.840079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:39.840079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:39.840079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:39.840079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:39.840079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:39.840079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:39.840079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:39.840079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:39.840079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:39.841126 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:39.841126 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:39.841126 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:39.841126 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:39.841126 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:39.841126 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:39.841126 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:39.841126 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:39.841126 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:39.841126 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:39.841126 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:39.841126 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:39.841126 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:39.841126 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:39.841126 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:39.841126 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:39.841126 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:39.842057 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:39.842057 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:39.842057 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:39.842057 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 253/507] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:39.842272 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9dbab-5640-42fb-8ea4-98aa126a4f4a None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:39.889249 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd4562-4150-436c-b9b3-7c636bc1c0e7 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:39.923622 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75688450-31a5-4a0a-9418-190210b478c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:39.924248 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75688450-31a5-4a0a-9418-190210b478c0 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:39.924525 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75688450-31a5-4a0a-9418-190210b478c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:39.924789 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75688450-31a5-4a0a-9418-190210b478c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:39.935124 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75688450-31a5-4a0a-9418-190210b478c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:39.939673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-75688450-31a5-4a0a-9418-190210b478c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:32:39.939673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:39.939673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:39.939673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:39.939673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:39.939673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:39.939673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:39.939673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:39.939673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:39.939673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:39.939673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:39.939673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:39.939673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:39.939673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:39.939673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:39.939673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:39.940671 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:39.940671 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:39.940671 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:39.940671 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:39.940671 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:39.940671 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:39.940671 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:39.940671 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:39.940671 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:39.940671 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:39.940671 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:39.940671 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:39.940671 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:39.940671 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:39.940671 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:39.940671 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:39.941560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:39.941560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:39.941560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:39.941560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:39.941560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:39.941560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:39.941560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:39.941560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:39.941560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:39.941560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:39.941560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:32:39.941560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:39.941560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 255/508] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 8 17:32:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:39.941560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75688450-31a5-4a0a-9418-190210b478c0 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:39.951932 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9dbab-5640-42fb-8ea4-98aa126a4f4a None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:39.987649 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7e675-c276-46e3-a030-e1f7381dbc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:39.988244 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7e675-c276-46e3-a030-e1f7381dbc2f None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:39.988522 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7e675-c276-46e3-a030-e1f7381dbc2f None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:39.988796 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7e675-c276-46e3-a030-e1f7381dbc2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:40.018399 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:40.025348 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:40.040421 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75688450-31a5-4a0a-9418-190210b478c0 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:40.056854 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7e675-c276-46e3-a030-e1f7381dbc2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:40.058478 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7e675-c276-46e3-a030-e1f7381dbc2f None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:40.075492 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63395c9-7d52-473b-8f75-126913d3887a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:40.076097 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63395c9-7d52-473b-8f75-126913d3887a None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:40.076383 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63395c9-7d52-473b-8f75-126913d3887a None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:40.076670 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63395c9-7d52-473b-8f75-126913d3887a None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:40.077322 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63395c9-7d52-473b-8f75-126913d3887a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:40.077626 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63395c9-7d52-473b-8f75-126913d3887a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:40.079013 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63395c9-7d52-473b-8f75-126913d3887a None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:40.090273 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 256/509] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:40.091149 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63395c9-7d52-473b-8f75-126913d3887a None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:40.158882 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 254/510] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:32:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:32:40.159726 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7e675-c276-46e3-a030-e1f7381dbc2f None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:40.196452 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63395c9-7d52-473b-8f75-126913d3887a None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:40.221170 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:40.229565 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0097b-6723-4aa9-b78d-a07fcf5b0d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:40.230195 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0097b-6723-4aa9-b78d-a07fcf5b0d7e None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:40.230471 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0097b-6723-4aa9-b78d-a07fcf5b0d7e None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:40.232646 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0097b-6723-4aa9-b78d-a07fcf5b0d7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:40.242032 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0097b-6723-4aa9-b78d-a07fcf5b0d7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:40.243480 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0097b-6723-4aa9-b78d-a07fcf5b0d7e None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:40.249991 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:40.259783 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-50b0097b-6723-4aa9-b78d-a07fcf5b0d7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:40.259783 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:40.259783 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:40.259783 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:40.259783 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:40.259783 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:40.259783 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:40.259783 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:40.259783 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:40.259783 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:40.259783 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:40.259783 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:40.259783 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:40.259783 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:40.259783 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:40.259783 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:40.260995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:40.260995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:40.260995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:40.260995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:40.260995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:40.260995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:40.260995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:40.260995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:40.260995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:40.260995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:40.260995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:40.260995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:40.260995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:40.260995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:40.260995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:40.260995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:40.260995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:40.268033 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:40.268033 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:40.268033 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:40.268264 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7e675-c276-46e3-a030-e1f7381dbc2f None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:40.268352 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 257/511] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:40.268352 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0097b-6723-4aa9-b78d-a07fcf5b0d7e None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:40.295418 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a9b21-729f-430b-bfdb-16019bac3f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:40.295951 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a9b21-729f-430b-bfdb-16019bac3f14 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:40.296232 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a9b21-729f-430b-bfdb-16019bac3f14 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:40.296511 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a9b21-729f-430b-bfdb-16019bac3f14 None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:40.297180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a9b21-729f-430b-bfdb-16019bac3f14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:40.297502 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a9b21-729f-430b-bfdb-16019bac3f14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:40.298878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a9b21-729f-430b-bfdb-16019bac3f14 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:40.315148 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 255/512] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:40.315148 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a9b21-729f-430b-bfdb-16019bac3f14 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:40.366238 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0097b-6723-4aa9-b78d-a07fcf5b0d7e None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:40.398624 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de95d6-db1d-4fcf-ae07-530713d6ab19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:40.399234 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de95d6-db1d-4fcf-ae07-530713d6ab19 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:40.399512 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de95d6-db1d-4fcf-ae07-530713d6ab19 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:40.399789 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de95d6-db1d-4fcf-ae07-530713d6ab19 None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:40.400440 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de95d6-db1d-4fcf-ae07-530713d6ab19 None admin] RBAC: Adding query filter params (name=service) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:40.400740 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de95d6-db1d-4fcf-ae07-530713d6ab19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:40.402140 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de95d6-db1d-4fcf-ae07-530713d6ab19 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:40.410004 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 258/513] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 8 17:32:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:40.410800 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de95d6-db1d-4fcf-ae07-530713d6ab19 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:40.411079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a9b21-729f-430b-bfdb-16019bac3f14 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:40.436555 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:40.448100 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf66ea3-2ab8-4da8-b0be-13db63f33c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:40.448716 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf66ea3-2ab8-4da8-b0be-13db63f33c07 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:40.448992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf66ea3-2ab8-4da8-b0be-13db63f33c07 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:40.449297 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf66ea3-2ab8-4da8-b0be-13db63f33c07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:40.455650 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf66ea3-2ab8-4da8-b0be-13db63f33c07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:40.457101 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf66ea3-2ab8-4da8-b0be-13db63f33c07 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:40.468617 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-eaf66ea3-2ab8-4da8-b0be-13db63f33c07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:32:40.468617 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:40.468617 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:40.468617 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:40.468617 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:40.468617 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:40.468617 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:40.468617 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:40.468617 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:40.468617 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:40.468617 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:40.468617 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:40.468617 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:32:40.468617 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:32:40.468617 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:32:40.469516 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:32:40.469516 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:40.469516 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:40.469516 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:40.469516 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:40.469516 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:40.469516 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:40.469516 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:40.469516 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:40.469516 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:40.469516 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:40.469516 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:40.469516 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:40.469516 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:40.469516 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:40.469516 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:40.469516 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:40.470399 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:32:40.470399 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:32:40.470399 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:32:40.470399 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:32:40.470399 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:32:40.470399 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:32:40.470399 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:32:40.470399 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:40.470399 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 256/514] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:32:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:40.471069 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf66ea3-2ab8-4da8-b0be-13db63f33c07 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:40.477261 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:40.518225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de95d6-db1d-4fcf-ae07-530713d6ab19 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:40.551641 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab0d6e-6298-414b-b3ff-7ccf2e891f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:40.552328 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab0d6e-6298-414b-b3ff-7ccf2e891f9f None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:40.552611 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab0d6e-6298-414b-b3ff-7ccf2e891f9f None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:40.552886 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab0d6e-6298-414b-b3ff-7ccf2e891f9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:40.563497 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab0d6e-6298-414b-b3ff-7ccf2e891f9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:40.564943 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab0d6e-6298-414b-b3ff-7ccf2e891f9f None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:40.572224 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf66ea3-2ab8-4da8-b0be-13db63f33c07 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:40.578964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-edab0d6e-6298-414b-b3ff-7ccf2e891f9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:40.578964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:40.578964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:40.578964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:40.578964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:40.578964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:40.578964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:40.578964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:40.578964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:40.578964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:40.578964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:40.578964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:40.578964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:40.578964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:40.578964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:40.578964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:40.580053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:40.580053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:40.580053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:40.580053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:40.580053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:40.580053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:40.580053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:40.580053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:40.580053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:40.580053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:40.580053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:40.580053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:40.580053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:40.580053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:40.580053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:40.580053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:40.580053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:40.581186 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:40.581186 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:40.581186 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:40.581186 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 259/515] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:40.581186 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab0d6e-6298-414b-b3ff-7ccf2e891f9f None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:40.612010 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337954a-1077-48f5-a04b-c87bbfd98f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:40.612610 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337954a-1077-48f5-a04b-c87bbfd98f1d None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:40.612891 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337954a-1077-48f5-a04b-c87bbfd98f1d None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:40.613206 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337954a-1077-48f5-a04b-c87bbfd98f1d None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:40.613846 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337954a-1077-48f5-a04b-c87bbfd98f1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:40.614149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337954a-1077-48f5-a04b-c87bbfd98f1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:40.616182 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337954a-1077-48f5-a04b-c87bbfd98f1d None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:40.627750 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 257/516] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:40.628541 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337954a-1077-48f5-a04b-c87bbfd98f1d None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:40.674371 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:40.681042 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab0d6e-6298-414b-b3ff-7ccf2e891f9f None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:40.693978 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:40.714408 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87336310-ee77-498b-9b1d-cee2a4ed3252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:40.715019 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87336310-ee77-498b-9b1d-cee2a4ed3252 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:40.715295 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87336310-ee77-498b-9b1d-cee2a4ed3252 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:40.715559 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87336310-ee77-498b-9b1d-cee2a4ed3252 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:40.722849 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87336310-ee77-498b-9b1d-cee2a4ed3252 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:40.724808 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87336310-ee77-498b-9b1d-cee2a4ed3252 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:40.732123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337954a-1077-48f5-a04b-c87bbfd98f1d None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:40.737737 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-87336310-ee77-498b-9b1d-cee2a4ed3252 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 17:32:40.737737 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:40.737737 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:40.737737 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:40.737737 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:40.737737 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:40.737737 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:40.737737 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:40.737737 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:40.737737 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:40.737737 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:40.737737 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:40.737737 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:32:40.737737 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:32:40.737737 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:32:40.737737 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:32:40.738804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:40.738804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:40.738804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:32:40.738804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:32:40.738804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:32:40.738804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:32:40.738804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:40.738804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:40.738804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:40.738804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:40.738804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:40.738804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:40.738804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:40.738804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:40.738804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:40.738804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:40.738804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:40.738804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:40.740161 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:40.740161 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:40.740161 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:32:40.740161 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:32:40.740161 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:32:40.740161 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:32:40.740161 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:32:40.740161 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:32:40.740161 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 17:32:40.740161 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:40.740161 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 260/517] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:32:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:40.740161 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87336310-ee77-498b-9b1d-cee2a4ed3252 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:40.770008 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863edc50-7a7e-46dd-b7bd-48f6b46d3fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:40.771155 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863edc50-7a7e-46dd-b7bd-48f6b46d3fa9 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:40.771612 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863edc50-7a7e-46dd-b7bd-48f6b46d3fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:40.771884 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863edc50-7a7e-46dd-b7bd-48f6b46d3fa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:40.781927 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863edc50-7a7e-46dd-b7bd-48f6b46d3fa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:40.783380 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863edc50-7a7e-46dd-b7bd-48f6b46d3fa9 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:40.797900 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-863edc50-7a7e-46dd-b7bd-48f6b46d3fa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:40.797900 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:40.797900 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:40.797900 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:40.797900 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:40.797900 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:40.797900 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:40.797900 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:40.797900 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:40.797900 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:40.797900 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:40.797900 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:40.797900 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:40.797900 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:40.797900 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:40.797900 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:40.798981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:40.798981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:40.798981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:40.798981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:40.798981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:40.798981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:40.798981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:40.798981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:40.798981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:40.798981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:40.798981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:40.798981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:40.798981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:40.798981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:40.798981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:40.798981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:40.798981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:40.804633 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:40.804633 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:40.804633 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:40.804633 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 258/518] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:40.804633 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863edc50-7a7e-46dd-b7bd-48f6b46d3fa9 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:40.841786 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87336310-ee77-498b-9b1d-cee2a4ed3252 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:40.876804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766ac29-0638-431b-8603-2926c6d03ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:40.877436 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766ac29-0638-431b-8603-2926c6d03ab0 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:40.877719 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766ac29-0638-431b-8603-2926c6d03ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:40.877993 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766ac29-0638-431b-8603-2926c6d03ab0 None admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:40.878686 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766ac29-0638-431b-8603-2926c6d03ab0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:40.878992 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766ac29-0638-431b-8603-2926c6d03ab0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:40.880497 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766ac29-0638-431b-8603-2926c6d03ab0 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:40.896580 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:40.898598 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 261/519] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 8 17:32:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:40.899457 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766ac29-0638-431b-8603-2926c6d03ab0 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:40.903659 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863edc50-7a7e-46dd-b7bd-48f6b46d3fa9 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:40.932368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:40.939922 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788ec04-a851-4a9b-9bd7-99e0ce365e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:40.940589 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788ec04-a851-4a9b-9bd7-99e0ce365e01 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:40.940873 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788ec04-a851-4a9b-9bd7-99e0ce365e01 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:40.941183 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788ec04-a851-4a9b-9bd7-99e0ce365e01 None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:40.941861 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788ec04-a851-4a9b-9bd7-99e0ce365e01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:40.947362 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788ec04-a851-4a9b-9bd7-99e0ce365e01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:40.947362 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788ec04-a851-4a9b-9bd7-99e0ce365e01 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:40.955363 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 259/520] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:40.956202 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788ec04-a851-4a9b-9bd7-99e0ce365e01 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:41.009839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766ac29-0638-431b-8603-2926c6d03ab0 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:41.043400 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b101bc-f67d-4a8c-b569-c674be04e295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:41.044002 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b101bc-f67d-4a8c-b569-c674be04e295 None admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:41.044285 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b101bc-f67d-4a8c-b569-c674be04e295 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:41.044560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b101bc-f67d-4a8c-b569-c674be04e295 None admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:41.045245 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b101bc-f67d-4a8c-b569-c674be04e295 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:41.046693 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b101bc-f67d-4a8c-b569-c674be04e295 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:41.060829 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788ec04-a851-4a9b-9bd7-99e0ce365e01 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:41.092689 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f024a-c01b-495a-a972-52a261086ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:41.093312 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f024a-c01b-495a-a972-52a261086ae8 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:41.093588 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f024a-c01b-495a-a972-52a261086ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:41.093858 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f024a-c01b-495a-a972-52a261086ae8 None admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:41.094571 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f024a-c01b-495a-a972-52a261086ae8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:41.094892 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f024a-c01b-495a-a972-52a261086ae8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:41.096280 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f024a-c01b-495a-a972-52a261086ae8 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:41.113479 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 260/521] 10.222.0.70 () {56 vars in 1137 bytes} [Mon Aug 8 17:32:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:41.114897 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f024a-c01b-495a-a972-52a261086ae8 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:41.126623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 262/522] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Aug 8 17:32:40 2022] POST /identity/v3/users => generated 247 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:32:41.127552 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b101bc-f67d-4a8c-b569-c674be04e295 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:41.128675 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:41.227298 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f024a-c01b-495a-a972-52a261086ae8 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:41.231398 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:41.245826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b101bc-f67d-4a8c-b569-c674be04e295 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:41.266350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709727af-1c10-46df-89db-15ff2dd2e2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:41.266971 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709727af-1c10-46df-89db-15ff2dd2e2d0 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:41.267252 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709727af-1c10-46df-89db-15ff2dd2e2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:41.267527 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709727af-1c10-46df-89db-15ff2dd2e2d0 None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:41.268175 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709727af-1c10-46df-89db-15ff2dd2e2d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:41.268498 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709727af-1c10-46df-89db-15ff2dd2e2d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:41.269930 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709727af-1c10-46df-89db-15ff2dd2e2d0 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:41.283981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 261/523] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:41.284295 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709727af-1c10-46df-89db-15ff2dd2e2d0 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:41.285433 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc423850-2375-46b8-97e8-fef7c259014e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:41.286632 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc423850-2375-46b8-97e8-fef7c259014e None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:41.286918 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc423850-2375-46b8-97e8-fef7c259014e None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:41.287195 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc423850-2375-46b8-97e8-fef7c259014e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:41.288032 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc423850-2375-46b8-97e8-fef7c259014e None admin] RBAC: Adding query filter params (role.id=6d5d281c40dd4e69803141f48615b386, scope.project.id=047a28b7cd11486da9d330723a384812, user.id=3973b8fbfbb9475896e4e110ca8aa615) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:41.288340 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc423850-2375-46b8-97e8-fef7c259014e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:41.289871 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc423850-2375-46b8-97e8-fef7c259014e None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:41.296601 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 263/524] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:32:41 2022] GET /identity/v3/role_assignments?user.id=3973b8fbfbb9475896e4e110ca8aa615&scope.project.id=047a28b7cd11486da9d330723a384812&role.id=6d5d281c40dd4e69803141f48615b386 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:41.298327 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc423850-2375-46b8-97e8-fef7c259014e None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:41.380553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:41.421160 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709727af-1c10-46df-89db-15ff2dd2e2d0 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:41.447442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc423850-2375-46b8-97e8-fef7c259014e None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:41.475706 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7010ebc-c6ca-4565-95b7-571ac50f0860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:41.476337 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7010ebc-c6ca-4565-95b7-571ac50f0860 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:41.476615 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7010ebc-c6ca-4565-95b7-571ac50f0860 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:41.476887 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7010ebc-c6ca-4565-95b7-571ac50f0860 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:41.487329 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7010ebc-c6ca-4565-95b7-571ac50f0860 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:41.488796 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7010ebc-c6ca-4565-95b7-571ac50f0860 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:41.500365 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb1e7f-76ff-418d-a039-1620bb49837f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:41.501418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb1e7f-76ff-418d-a039-1620bb49837f None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:41.501848 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb1e7f-76ff-418d-a039-1620bb49837f None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:41.502271 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb1e7f-76ff-418d-a039-1620bb49837f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:41.507839 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-d7010ebc-c6ca-4565-95b7-571ac50f0860 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:32:41.507839 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:41.507839 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:41.507839 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:41.507839 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:41.507839 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:41.507839 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:41.507839 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:41.507839 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:41.507839 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:41.507839 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:41.507839 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:41.507839 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:32:41.507839 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:32:41.507839 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:32:41.508873 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:32:41.508873 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:41.508873 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:41.508873 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:41.508873 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:41.508873 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:41.508873 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:41.508873 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:41.508873 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:41.508873 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:41.508873 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:41.508873 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:41.508873 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:41.508873 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:41.508873 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:41.508873 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:41.508873 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:41.509779 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:32:41.509779 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:32:41.509779 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:32:41.509779 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:32:41.509779 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:32:41.509779 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:32:41.509779 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:32:41.509779 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:41.510252 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 262/525] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:32:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:41.511379 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7010ebc-c6ca-4565-95b7-571ac50f0860 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:41.533453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:41.610252 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb1e7f-76ff-418d-a039-1620bb49837f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:41.611885 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb1e7f-76ff-418d-a039-1620bb49837f None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:41.643302 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7010ebc-c6ca-4565-95b7-571ac50f0860 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:41.683751 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:41.691129 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10296ac7-d30b-4755-bf2d-9c9ac252228f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:41.691766 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10296ac7-d30b-4755-bf2d-9c9ac252228f None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:41.692047 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10296ac7-d30b-4755-bf2d-9c9ac252228f None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:41.692358 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10296ac7-d30b-4755-bf2d-9c9ac252228f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:41.701822 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10296ac7-d30b-4755-bf2d-9c9ac252228f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:41.703845 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10296ac7-d30b-4755-bf2d-9c9ac252228f None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:41.718766 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-10296ac7-d30b-4755-bf2d-9c9ac252228f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 08 17:32:41.718766 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:41.718766 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:41.718766 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:41.718766 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:41.718766 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:41.718766 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:41.718766 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:41.718766 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:41.718766 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:41.718766 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:41.718766 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:41.718766 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:32:41.718766 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:32:41.718766 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:32:41.718766 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:32:41.719729 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:41.719729 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:41.719729 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:32:41.719729 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:32:41.719729 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:32:41.719729 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:32:41.719729 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:41.719729 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:41.719729 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:41.719729 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:41.719729 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:41.719729 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:41.719729 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:41.719729 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:41.719729 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:41.719729 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:41.719729 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:41.719729 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:41.720648 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:41.720648 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:41.720648 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:32:41.720648 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:32:41.720648 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:32:41.720648 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:32:41.720648 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:32:41.720648 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:32:41.720648 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 08 17:32:41.720648 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:41.721202 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 263/526] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 8 17:32:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:41.721939 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10296ac7-d30b-4755-bf2d-9c9ac252228f None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:41.725224 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 264/527] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:32:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:32:41.727170 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb1e7f-76ff-418d-a039-1620bb49837f None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:41.786800 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:41.843057 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10296ac7-d30b-4755-bf2d-9c9ac252228f None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:41.850254 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb1e7f-76ff-418d-a039-1620bb49837f None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:41.881047 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c1956-f74a-4b45-b2bb-1a82ab4dd2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:41.881670 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c1956-f74a-4b45-b2bb-1a82ab4dd2b7 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:41.881948 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c1956-f74a-4b45-b2bb-1a82ab4dd2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:41.882214 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c1956-f74a-4b45-b2bb-1a82ab4dd2b7 None admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:41.882903 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c1956-f74a-4b45-b2bb-1a82ab4dd2b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:41.883255 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c1956-f74a-4b45-b2bb-1a82ab4dd2b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:41.884868 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c1956-f74a-4b45-b2bb-1a82ab4dd2b7 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:41.894160 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73d649-095c-417d-8c78-0c18b89399fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:41.894714 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73d649-095c-417d-8c78-0c18b89399fa None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:41.894997 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73d649-095c-417d-8c78-0c18b89399fa None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:41.895268 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73d649-095c-417d-8c78-0c18b89399fa None admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:41.897270 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73d649-095c-417d-8c78-0c18b89399fa None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:41.897581 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73d649-095c-417d-8c78-0c18b89399fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:41.899039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73d649-095c-417d-8c78-0c18b89399fa None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:41.904041 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 264/528] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 8 17:32:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:41.904873 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c1956-f74a-4b45-b2bb-1a82ab4dd2b7 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:41.949081 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 265/529] 10.222.0.70 () {56 vars in 1139 bytes} [Mon Aug 8 17:32:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:41.949951 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73d649-095c-417d-8c78-0c18b89399fa None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:41.973348 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:42.028713 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c1956-f74a-4b45-b2bb-1a82ab4dd2b7 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:42.057619 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73d649-095c-417d-8c78-0c18b89399fa None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:42.069134 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94e1a4-491e-4532-8c20-131797a4fd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:42.069685 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:42.071127 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94e1a4-491e-4532-8c20-131797a4fd1d None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:42.071547 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94e1a4-491e-4532-8c20-131797a4fd1d None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:42.071952 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94e1a4-491e-4532-8c20-131797a4fd1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:42.084691 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94e1a4-491e-4532-8c20-131797a4fd1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:42.086399 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94e1a4-491e-4532-8c20-131797a4fd1d None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:42.094060 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f4459-0c68-4783-82f3-19ccd39efb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:42.094667 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f4459-0c68-4783-82f3-19ccd39efb87 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:42.094951 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f4459-0c68-4783-82f3-19ccd39efb87 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:42.095222 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f4459-0c68-4783-82f3-19ccd39efb87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:42.096132 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f4459-0c68-4783-82f3-19ccd39efb87 None admin] RBAC: Adding query filter params (role.id=6d5d281c40dd4e69803141f48615b386, scope.project.id=047a28b7cd11486da9d330723a384812, user.id=4fab95367403451b921099425345b3ea) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:42.096247 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f4459-0c68-4783-82f3-19ccd39efb87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:42.097719 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f4459-0c68-4783-82f3-19ccd39efb87 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:42.102917 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-6b94e1a4-491e-4532-8c20-131797a4fd1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:42.102917 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:42.102917 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:42.102917 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:42.102917 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:42.102917 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:42.102917 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:42.102917 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:42.102917 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:42.102917 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:42.102917 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:42.102917 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:42.102917 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:42.102917 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:42.102917 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:42.102917 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:42.104038 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:42.104038 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:42.104038 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:42.104038 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:42.104038 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:42.104038 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:42.104038 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:42.104038 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:42.104038 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:42.104038 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:42.104038 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:42.104038 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:42.104038 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:42.104038 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:42.104038 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:42.104038 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:42.104038 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:42.105063 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:42.105063 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:42.105063 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:42.106500 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 265/531] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:42.107462 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94e1a4-491e-4532-8c20-131797a4fd1d None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:42.109129 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 266/531] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:32:41 2022] GET /identity/v3/role_assignments?user.id=4fab95367403451b921099425345b3ea&scope.project.id=047a28b7cd11486da9d330723a384812&role.id=6d5d281c40dd4e69803141f48615b386 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:42.116527 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f4459-0c68-4783-82f3-19ccd39efb87 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:42.307522 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94e1a4-491e-4532-8c20-131797a4fd1d None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:42.311932 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:42.321485 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f4459-0c68-4783-82f3-19ccd39efb87 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:42.364459 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6bb38b-5829-42b4-8f53-0e06759f085a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:42.365459 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6bb38b-5829-42b4-8f53-0e06759f085a None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:42.365741 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6bb38b-5829-42b4-8f53-0e06759f085a None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:42.366017 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6bb38b-5829-42b4-8f53-0e06759f085a None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:42.366660 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6bb38b-5829-42b4-8f53-0e06759f085a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:42.366962 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6bb38b-5829-42b4-8f53-0e06759f085a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:42.368345 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6bb38b-5829-42b4-8f53-0e06759f085a None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:42.380441 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47516caa-9b45-4597-8edb-24d27c519287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:42.381060 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47516caa-9b45-4597-8edb-24d27c519287 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:42.381346 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47516caa-9b45-4597-8edb-24d27c519287 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:42.381620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47516caa-9b45-4597-8edb-24d27c519287 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:42.392385 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 267/532] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:32:42.400542 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6bb38b-5829-42b4-8f53-0e06759f085a None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:42.474237 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:42.509555 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47516caa-9b45-4597-8edb-24d27c519287 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:42.511049 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47516caa-9b45-4597-8edb-24d27c519287 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:42.590847 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6bb38b-5829-42b4-8f53-0e06759f085a None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:42.659048 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536fe98-d797-4862-a910-8e113d97fb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:42.659710 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536fe98-d797-4862-a910-8e113d97fb4e None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:42.659941 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536fe98-d797-4862-a910-8e113d97fb4e None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:42.660222 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536fe98-d797-4862-a910-8e113d97fb4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:42.669854 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536fe98-d797-4862-a910-8e113d97fb4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:42.671320 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536fe98-d797-4862-a910-8e113d97fb4e None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:42.672812 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 266/533] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:32:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:32:42.679649 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47516caa-9b45-4597-8edb-24d27c519287 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:42.688369 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:42.700172 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-d536fe98-d797-4862-a910-8e113d97fb4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:32:42.700172 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:42.700172 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:42.700172 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:42.700172 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:42.700172 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:42.700172 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:42.700172 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:42.700172 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:42.700172 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:42.700172 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:42.700172 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:42.700172 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:32:42.700172 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:32:42.700172 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:32:42.711357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:32:42.711357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:42.711357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:42.711357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:42.711357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:42.711357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:42.711357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:42.711357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:42.711357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:42.711357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:42.711357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:42.711357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:42.711357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:42.711357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:42.711357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:42.711357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:42.711357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:42.712232 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:32:42.712232 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:32:42.712232 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:32:42.712232 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:32:42.712232 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:32:42.712232 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:32:42.712232 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:32:42.712232 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:42.712232 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 268/534] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:32:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:32:42.712232 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536fe98-d797-4862-a910-8e113d97fb4e None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:42.855916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:42.866798 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47516caa-9b45-4597-8edb-24d27c519287 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:42.873163 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536fe98-d797-4862-a910-8e113d97fb4e None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:42.931093 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6211b-8cd6-46b3-8485-e0006a362eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:42.932539 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6211b-8cd6-46b3-8485-e0006a362eb7 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:42.933470 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6211b-8cd6-46b3-8485-e0006a362eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:42.934282 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6211b-8cd6-46b3-8485-e0006a362eb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:42.936068 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9bd1e-f241-423e-896b-0bf7eb205279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:42.937098 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9bd1e-f241-423e-896b-0bf7eb205279 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:42.938686 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9bd1e-f241-423e-896b-0bf7eb205279 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:42.939185 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9bd1e-f241-423e-896b-0bf7eb205279 None admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:42.940831 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c9bd1e-f241-423e-896b-0bf7eb205279 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:42.941855 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c9bd1e-f241-423e-896b-0bf7eb205279 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:42.945427 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c9bd1e-f241-423e-896b-0bf7eb205279 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:42.957372 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d6211b-8cd6-46b3-8485-e0006a362eb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:42.959838 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d6211b-8cd6-46b3-8485-e0006a362eb7 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:42.971807 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 269/535] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 8 17:32:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:42.977461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9bd1e-f241-423e-896b-0bf7eb205279 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:42.985349 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-52d6211b-8cd6-46b3-8485-e0006a362eb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:42.985349 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:42.985349 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:42.985349 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:42.985349 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:42.985349 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:42.985349 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:42.985349 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:42.985349 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:42.985349 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:42.985349 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:42.985349 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:42.985349 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:42.985349 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:42.985349 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:42.985349 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:42.986351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:42.986351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:42.986351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:42.986351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:42.986351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:42.986351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:42.986351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:42.986351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:42.986351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:42.986351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:42.986351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:42.986351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:42.986351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:42.986351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:42.986351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:42.986351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:42.986351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:42.987212 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:42.987212 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:42.987212 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:42.999095 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 267/536] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:32:43.002286 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6211b-8cd6-46b3-8485-e0006a362eb7 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:43.104906 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:43.140638 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9bd1e-f241-423e-896b-0bf7eb205279 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:43.183654 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e238a-892b-4f5a-97ff-b61e1af81e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:43.184653 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e238a-892b-4f5a-97ff-b61e1af81e2c None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:43.185234 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e238a-892b-4f5a-97ff-b61e1af81e2c None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:43.185647 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e238a-892b-4f5a-97ff-b61e1af81e2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:43.186783 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e238a-892b-4f5a-97ff-b61e1af81e2c None admin] RBAC: Adding query filter params (role.id=6d5d281c40dd4e69803141f48615b386, scope.project.id=047a28b7cd11486da9d330723a384812, user.id=44340c24b5784b58b829e2faa62ac58a) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:43.187638 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e238a-892b-4f5a-97ff-b61e1af81e2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:43.189535 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e238a-892b-4f5a-97ff-b61e1af81e2c None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:43.190380 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6211b-8cd6-46b3-8485-e0006a362eb7 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:43.197389 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 270/537] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:32:42 2022] GET /identity/v3/role_assignments?user.id=44340c24b5784b58b829e2faa62ac58a&scope.project.id=047a28b7cd11486da9d330723a384812&role.id=6d5d281c40dd4e69803141f48615b386 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:32:43.247848 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9c72d-7d5c-430e-9f88-8448541a0539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:43.248836 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9c72d-7d5c-430e-9f88-8448541a0539 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:43.249354 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9c72d-7d5c-430e-9f88-8448541a0539 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:43.249824 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9c72d-7d5c-430e-9f88-8448541a0539 None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:43.250689 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd9c72d-7d5c-430e-9f88-8448541a0539 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:43.251184 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd9c72d-7d5c-430e-9f88-8448541a0539 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:43.252756 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd9c72d-7d5c-430e-9f88-8448541a0539 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:43.272187 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 268/538] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:43.277933 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e238a-892b-4f5a-97ff-b61e1af81e2c None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:43.309412 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:43.418056 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e238a-892b-4f5a-97ff-b61e1af81e2c None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:43.425636 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0d6ef-b6a1-4a2e-b587-6148264b5988 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:43.425967 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0d6ef-b6a1-4a2e-b587-6148264b5988 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:43.426183 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0d6ef-b6a1-4a2e-b587-6148264b5988 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:43.428415 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 269/539] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 17:32:43.434945 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856da22-f0d3-456a-95d3-fb506cc53057 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:43.435261 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856da22-f0d3-456a-95d3-fb506cc53057 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:43.435478 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856da22-f0d3-456a-95d3-fb506cc53057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:43.473157 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-f856da22-f0d3-456a-95d3-fb506cc53057 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:43.474608 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-f856da22-f0d3-456a-95d3-fb506cc53057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:43.478829 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b36a55-9224-46b6-a2dd-18ddecefc6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:43.479471 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b36a55-9224-46b6-a2dd-18ddecefc6cf None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:43.479754 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b36a55-9224-46b6-a2dd-18ddecefc6cf None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:43.480026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b36a55-9224-46b6-a2dd-18ddecefc6cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:43.491809 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b36a55-9224-46b6-a2dd-18ddecefc6cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:43.492831 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b36a55-9224-46b6-a2dd-18ddecefc6cf None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:43.509514 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-18b36a55-9224-46b6-a2dd-18ddecefc6cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:32:43.509514 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:43.509514 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:43.509514 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:43.509514 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:43.509514 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:43.509514 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:43.509514 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:43.509514 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:43.509514 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:43.509514 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:43.509514 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:43.509514 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:32:43.509514 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:32:43.509514 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:32:43.510419 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:32:43.510419 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:43.510419 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:43.510419 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:43.510419 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:43.510419 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:43.510419 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:43.510419 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:43.510419 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:43.510419 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:43.510419 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:43.510419 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:43.510419 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:43.510419 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:43.510419 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:43.510419 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:43.510419 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:43.511286 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:32:43.511286 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:32:43.511286 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:32:43.511286 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:32:43.511286 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:32:43.511286 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:32:43.511286 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:32:43.511286 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:43.511286 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 271/540] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:32:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:32:43.517562 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b36a55-9224-46b6-a2dd-18ddecefc6cf None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:43.586203 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 270/541] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:43.622025 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856da22-f0d3-456a-95d3-fb506cc53057 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:43.627227 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:43.650029 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b36a55-9224-46b6-a2dd-18ddecefc6cf None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:43.687490 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c905179-c2ed-4c68-8715-5e9bf91d215a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:43.688867 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c905179-c2ed-4c68-8715-5e9bf91d215a None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:43.689375 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c905179-c2ed-4c68-8715-5e9bf91d215a None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:43.689862 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c905179-c2ed-4c68-8715-5e9bf91d215a None admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:43.690754 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c905179-c2ed-4c68-8715-5e9bf91d215a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:43.691256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c905179-c2ed-4c68-8715-5e9bf91d215a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:43.693712 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c905179-c2ed-4c68-8715-5e9bf91d215a None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:43.705389 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:43.707471 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 272/542] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 8 17:32:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:32:43.709566 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401a69a-1e4b-4bb7-bffd-788723f82980 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:43.710106 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401a69a-1e4b-4bb7-bffd-788723f82980 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:43.710598 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401a69a-1e4b-4bb7-bffd-788723f82980 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:43.712059 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 273/543] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:43.713623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401a69a-1e4b-4bb7-bffd-788723f82980 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:43.763396 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856da22-f0d3-456a-95d3-fb506cc53057 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:43.799559 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b6492-a9b7-49c9-a74d-a9846a449723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:43.800182 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b6492-a9b7-49c9-a74d-a9846a449723 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:43.800457 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b6492-a9b7-49c9-a74d-a9846a449723 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:43.800723 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b6492-a9b7-49c9-a74d-a9846a449723 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:43.812609 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b6492-a9b7-49c9-a74d-a9846a449723 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:43.819726 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-bd3b6492-a9b7-49c9-a74d-a9846a449723 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:32:43.819726 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:43.819726 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:43.819726 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:43.819726 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:43.819726 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:43.819726 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:43.819726 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:43.819726 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:43.819726 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:43.819726 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:43.819726 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:43.819726 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:43.819726 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:43.819726 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:43.819726 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:43.820640 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:43.820640 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:43.820640 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:43.820640 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:43.820640 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:43.820640 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:43.820640 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:43.820640 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:43.820640 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:43.820640 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:43.820640 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:43.820640 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:43.820640 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:43.820640 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:43.820640 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:43.820640 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:43.821514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:43.821514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:43.821514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:43.821514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:43.821514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:43.821514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:43.821514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:43.821514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:43.821514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:43.821514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:43.821514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:32:43.821514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:43.825280 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 271/544] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 8 17:32:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:32:43.826611 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7738bf-faf0-493a-8a99-fdcbd2602c40 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:43.826900 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7738bf-faf0-493a-8a99-fdcbd2602c40 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:43.827170 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7738bf-faf0-493a-8a99-fdcbd2602c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:43.828760 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401a69a-1e4b-4bb7-bffd-788723f82980 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:43.846058 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-3f7738bf-faf0-493a-8a99-fdcbd2602c40 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:43.847312 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-3f7738bf-faf0-493a-8a99-fdcbd2602c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:43.869023 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469a801-e697-47e6-87b8-d0b1bafce263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:43.869993 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469a801-e697-47e6-87b8-d0b1bafce263 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:43.870498 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469a801-e697-47e6-87b8-d0b1bafce263 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:43.870987 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469a801-e697-47e6-87b8-d0b1bafce263 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:43.871962 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d469a801-e697-47e6-87b8-d0b1bafce263 None admin] RBAC: Adding query filter params (role.id=6d5d281c40dd4e69803141f48615b386, scope.project.id=047a28b7cd11486da9d330723a384812, user.id=bdb6f0f0cde24b05a34b78d48dc45c0d) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:43.872519 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d469a801-e697-47e6-87b8-d0b1bafce263 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:43.874257 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d469a801-e697-47e6-87b8-d0b1bafce263 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:43.881569 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 274/545] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:32:43 2022] GET /identity/v3/role_assignments?user.id=bdb6f0f0cde24b05a34b78d48dc45c0d&scope.project.id=047a28b7cd11486da9d330723a384812&role.id=6d5d281c40dd4e69803141f48615b386 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:43.882814 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469a801-e697-47e6-87b8-d0b1bafce263 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:43.885961 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:43.929458 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 272/546] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:43.952761 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7738bf-faf0-493a-8a99-fdcbd2602c40 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:43.999341 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469a801-e697-47e6-87b8-d0b1bafce263 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:44.016885 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:44.073600 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02637a-009b-4f58-8d3e-938ecf7323cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:44.074222 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02637a-009b-4f58-8d3e-938ecf7323cd None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:44.074505 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02637a-009b-4f58-8d3e-938ecf7323cd None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:44.074777 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02637a-009b-4f58-8d3e-938ecf7323cd None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:44.075464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c02637a-009b-4f58-8d3e-938ecf7323cd None admin] RBAC: Adding query filter params (name=service) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:44.075766 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c02637a-009b-4f58-8d3e-938ecf7323cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:44.077225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c02637a-009b-4f58-8d3e-938ecf7323cd None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:44.100705 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 275/547] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 8 17:32:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:44.107355 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02637a-009b-4f58-8d3e-938ecf7323cd None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:44.151208 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7738bf-faf0-493a-8a99-fdcbd2602c40 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:44.228049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:44.230427 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1f815-8246-4625-88b0-da4d1fef5b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:44.231059 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1f815-8246-4625-88b0-da4d1fef5b7c None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:44.231353 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1f815-8246-4625-88b0-da4d1fef5b7c None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:44.231594 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1f815-8246-4625-88b0-da4d1fef5b7c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:44.258142 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1f815-8246-4625-88b0-da4d1fef5b7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:44.262807 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-c0a1f815-8246-4625-88b0-da4d1fef5b7c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:32:44.262807 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:44.262807 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:44.262807 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:44.262807 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:44.262807 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:44.262807 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:44.262807 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:44.262807 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:44.262807 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:44.262807 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:44.262807 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:44.262807 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:44.262807 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:44.262807 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:44.262807 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:44.263795 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:44.263795 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:44.263795 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:44.263795 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:44.263795 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:44.263795 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:44.263795 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:44.263795 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:44.263795 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:44.263795 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:44.263795 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:44.263795 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:44.263795 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:44.263795 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:44.263795 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:44.263795 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:44.264590 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:44.264590 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:44.264590 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:44.264590 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:44.264590 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:44.264590 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:44.264590 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:44.264590 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:44.264590 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:44.264590 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:44.264590 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:32:44.264590 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:44.264590 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 273/548] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 8 17:32:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:32:44.278046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1f815-8246-4625-88b0-da4d1fef5b7c None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:44.283830 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02637a-009b-4f58-8d3e-938ecf7323cd None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:44.362266 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142c13c-359b-4428-bdc1-f67a0ef9da63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:44.362909 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142c13c-359b-4428-bdc1-f67a0ef9da63 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:44.363191 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142c13c-359b-4428-bdc1-f67a0ef9da63 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:44.363460 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142c13c-359b-4428-bdc1-f67a0ef9da63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:44.389271 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d142c13c-359b-4428-bdc1-f67a0ef9da63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:44.390750 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d142c13c-359b-4428-bdc1-f67a0ef9da63 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:44.427124 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-d142c13c-359b-4428-bdc1-f67a0ef9da63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:44.427124 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:44.427124 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:44.427124 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:44.427124 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:44.427124 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:44.427124 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:44.427124 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:44.427124 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:44.427124 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:44.427124 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:44.427124 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:44.427124 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:44.427124 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:44.427124 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:44.427124 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:44.429256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:44.429256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:44.429256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:44.429256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:44.429256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:44.429256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:44.429256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:44.429256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:44.429256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:44.429256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:44.429256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:44.429256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:44.429256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:44.429256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:44.429256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:44.429256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:44.429256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:44.430163 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:44.430163 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:44.430163 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:44.430331 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:44.431899 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 276/549] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:32:44.437903 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142c13c-359b-4428-bdc1-f67a0ef9da63 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:44.445528 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1f815-8246-4625-88b0-da4d1fef5b7c None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:44.496849 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5e849-697d-4740-8a50-6400472f540a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:44.497809 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5e849-697d-4740-8a50-6400472f540a None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:44.498287 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5e849-697d-4740-8a50-6400472f540a None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:44.498785 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5e849-697d-4740-8a50-6400472f540a None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:44.499665 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee5e849-697d-4740-8a50-6400472f540a None admin] RBAC: Adding query filter params (name=service) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:44.500181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee5e849-697d-4740-8a50-6400472f540a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:44.501809 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee5e849-697d-4740-8a50-6400472f540a None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:44.512086 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 274/550] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 8 17:32:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:44.518439 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c54a6-9f2e-4a74-a31b-2ad4a92a35ec None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:44.519398 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c54a6-9f2e-4a74-a31b-2ad4a92a35ec None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:44.521636 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c54a6-9f2e-4a74-a31b-2ad4a92a35ec None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:44.525061 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 275/551] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:44 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:44.526036 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c54a6-9f2e-4a74-a31b-2ad4a92a35ec None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:44.594871 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142c13c-359b-4428-bdc1-f67a0ef9da63 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:44.618650 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:44.634373 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40897cc1-fd9f-4a9a-bc7e-fdd2e2327f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:44.635507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40897cc1-fd9f-4a9a-bc7e-fdd2e2327f52 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:44.636954 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40897cc1-fd9f-4a9a-bc7e-fdd2e2327f52 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:44.636954 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40897cc1-fd9f-4a9a-bc7e-fdd2e2327f52 None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:44.637760 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40897cc1-fd9f-4a9a-bc7e-fdd2e2327f52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:44.638247 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40897cc1-fd9f-4a9a-bc7e-fdd2e2327f52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:44.639840 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40897cc1-fd9f-4a9a-bc7e-fdd2e2327f52 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:44.660173 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 277/552] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:44.660173 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704397f-fffe-4153-9f7f-b1af6e740d1f None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:44.660173 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704397f-fffe-4153-9f7f-b1af6e740d1f None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:44.660173 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704397f-fffe-4153-9f7f-b1af6e740d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:44.668789 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c54a6-9f2e-4a74-a31b-2ad4a92a35ec None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:44.690737 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-6704397f-fffe-4153-9f7f-b1af6e740d1f None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:44.691960 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-6704397f-fffe-4153-9f7f-b1af6e740d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:44.726709 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e788b1b-bd05-4c5a-bcd1-4ee98c3b71de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:44.727345 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e788b1b-bd05-4c5a-bcd1-4ee98c3b71de None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:44.727623 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e788b1b-bd05-4c5a-bcd1-4ee98c3b71de None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:44.727894 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e788b1b-bd05-4c5a-bcd1-4ee98c3b71de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:44.745405 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e788b1b-bd05-4c5a-bcd1-4ee98c3b71de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:44.747109 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e788b1b-bd05-4c5a-bcd1-4ee98c3b71de None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:44.768227 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-3e788b1b-bd05-4c5a-bcd1-4ee98c3b71de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:44.768227 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:44.768227 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:44.768227 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:44.768227 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:44.768227 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:44.768227 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:44.768227 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:44.768227 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:44.768227 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:44.768227 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:44.768227 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:44.768227 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:44.768227 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:44.768227 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:44.768227 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:44.770105 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:44.770105 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:44.770105 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:44.770105 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:44.770105 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:44.770105 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:44.770105 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:44.770105 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:44.770105 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:44.770105 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:44.770105 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:44.770105 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:44.770105 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:44.770105 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:44.770105 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:44.770105 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:44.770105 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:44.771965 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:44.771965 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:44.771965 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:44.771965 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 276/553] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:44.777256 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e788b1b-bd05-4c5a-bcd1-4ee98c3b71de None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:44.794548 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:44.797651 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 278/554] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:44.798892 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704397f-fffe-4153-9f7f-b1af6e740d1f None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:44.926225 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e788b1b-bd05-4c5a-bcd1-4ee98c3b71de None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:44.952435 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704397f-fffe-4153-9f7f-b1af6e740d1f None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:44.972137 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:44.976173 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177408db-f3fa-462c-a125-b4bcc495044f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:44.976828 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177408db-f3fa-462c-a125-b4bcc495044f None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:44.977361 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177408db-f3fa-462c-a125-b4bcc495044f None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:44.977361 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177408db-f3fa-462c-a125-b4bcc495044f None admin] PATH_INFO: `/v3/users/swift` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:44.985791 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177408db-f3fa-462c-a125-b4bcc495044f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:44.987233 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177408db-f3fa-462c-a125-b4bcc495044f None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:45.002553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-177408db-f3fa-462c-a125-b4bcc495044f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 08 17:32:45.002553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:45.002553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:45.002553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:45.002553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:45.002553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:45.002553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:45.002553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:45.002553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:45.002553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:45.002553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:45.002553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:45.002553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:32:45.002553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:32:45.002553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:32:45.002553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:32:45.003592 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:45.003592 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:45.003592 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:32:45.003592 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:32:45.003592 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:32:45.003592 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:32:45.003592 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:45.003592 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:45.003592 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:45.003592 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:45.003592 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:45.003592 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:45.003592 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:45.003592 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:45.003592 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:45.003592 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:45.003592 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:45.003592 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:45.005149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:45.005149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:45.005149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:32:45.005149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:32:45.005149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:32:45.005149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:32:45.005149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:32:45.005149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:32:45.005149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 08 17:32:45.005149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:45.005149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 277/555] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 8 17:32:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:45.005149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177408db-f3fa-462c-a125-b4bcc495044f None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:45.022020 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff43e5-3979-4622-8ae4-bea68cf681b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:45.023577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff43e5-3979-4622-8ae4-bea68cf681b6 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:45.024055 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff43e5-3979-4622-8ae4-bea68cf681b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:45.024536 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff43e5-3979-4622-8ae4-bea68cf681b6 None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:45.027730 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff43e5-3979-4622-8ae4-bea68cf681b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:45.028214 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff43e5-3979-4622-8ae4-bea68cf681b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:45.030588 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff43e5-3979-4622-8ae4-bea68cf681b6 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:45.057061 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 279/556] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:45.057061 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff43e5-3979-4622-8ae4-bea68cf681b6 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:45.123944 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:45.173144 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177408db-f3fa-462c-a125-b4bcc495044f None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:45.199284 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff43e5-3979-4622-8ae4-bea68cf681b6 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:45.224258 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b9327-9b58-469f-8f65-25e3aa514d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:45.225890 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b9327-9b58-469f-8f65-25e3aa514d02 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:45.226414 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b9327-9b58-469f-8f65-25e3aa514d02 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:45.226909 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b9327-9b58-469f-8f65-25e3aa514d02 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:45.243227 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61b9327-9b58-469f-8f65-25e3aa514d02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:45.245152 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9d8c7-2eb5-4028-8e1d-eff88da2df1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:45.245784 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9d8c7-2eb5-4028-8e1d-eff88da2df1f None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:45.246066 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9d8c7-2eb5-4028-8e1d-eff88da2df1f None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:45.246344 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9d8c7-2eb5-4028-8e1d-eff88da2df1f None admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:45.247103 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9d8c7-2eb5-4028-8e1d-eff88da2df1f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:45.247425 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9d8c7-2eb5-4028-8e1d-eff88da2df1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:45.249126 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9d8c7-2eb5-4028-8e1d-eff88da2df1f None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:45.253535 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-d61b9327-9b58-469f-8f65-25e3aa514d02 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:32:45.253535 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:45.253535 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:45.253535 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:45.253535 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:45.253535 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:45.253535 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:45.253535 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:45.253535 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:45.253535 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:45.253535 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:45.253535 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:45.253535 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:45.253535 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:45.253535 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:45.253535 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:45.254945 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:45.254945 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:45.254945 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:45.254945 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:45.254945 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:45.254945 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:45.254945 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:45.254945 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:45.254945 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:45.254945 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:45.254945 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:45.254945 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:45.254945 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:45.254945 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:45.254945 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:45.254945 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:45.255922 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:45.255922 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:45.255922 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:45.255922 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:45.255922 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:45.255922 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:45.255922 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:45.255922 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:45.255922 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:45.255922 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:45.255922 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:32:45.255922 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:45.259352 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 278/557] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 8 17:32:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:45.260583 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b9327-9b58-469f-8f65-25e3aa514d02 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:45.284097 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 280/558] 10.222.0.70 () {56 vars in 1135 bytes} [Mon Aug 8 17:32:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:45.287994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9d8c7-2eb5-4028-8e1d-eff88da2df1f None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:45.321655 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:45.386051 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b9327-9b58-469f-8f65-25e3aa514d02 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:45.409489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9d8c7-2eb5-4028-8e1d-eff88da2df1f None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:45.419426 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:45.426429 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706435a-98b6-4a17-b92f-c21210585d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:45.433087 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706435a-98b6-4a17-b92f-c21210585d74 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:45.433087 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706435a-98b6-4a17-b92f-c21210585d74 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:45.433087 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706435a-98b6-4a17-b92f-c21210585d74 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:45.436083 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706435a-98b6-4a17-b92f-c21210585d74 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:45.437685 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706435a-98b6-4a17-b92f-c21210585d74 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:45.450673 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-9706435a-98b6-4a17-b92f-c21210585d74 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 17:32:45.450673 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:45.450673 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:45.450673 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:45.450673 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:45.450673 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:45.450673 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:45.450673 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:45.450673 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:45.450673 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:45.450673 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:45.450673 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:45.450673 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:32:45.450673 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:32:45.450673 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:32:45.450673 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:32:45.451775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:45.451775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:45.451775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:32:45.451775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:32:45.451775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:32:45.451775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:32:45.451775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:45.451775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:45.451775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:45.451775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:45.451775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:45.451775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:45.451775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:45.451775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:45.451775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:45.451775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:45.451775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:45.451775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:45.452738 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:45.452738 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:45.452738 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:32:45.452738 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:32:45.452738 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:32:45.452738 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:32:45.452738 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:32:45.452738 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:32:45.452738 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 17:32:45.452738 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:45.457043 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 279/559] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Aug 8 17:32:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:45.458395 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706435a-98b6-4a17-b92f-c21210585d74 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:45.465181 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde457ea-a9c0-4e57-945d-1f7dd6b3954b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:45.466068 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde457ea-a9c0-4e57-945d-1f7dd6b3954b None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:45.466601 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde457ea-a9c0-4e57-945d-1f7dd6b3954b None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:45.467137 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde457ea-a9c0-4e57-945d-1f7dd6b3954b None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:45.468158 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde457ea-a9c0-4e57-945d-1f7dd6b3954b None admin] RBAC: Adding query filter params (name=service) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:45.468678 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde457ea-a9c0-4e57-945d-1f7dd6b3954b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:45.470456 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde457ea-a9c0-4e57-945d-1f7dd6b3954b None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:45.480600 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 281/560] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 8 17:32:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:45.481905 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde457ea-a9c0-4e57-945d-1f7dd6b3954b None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:45.572806 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706435a-98b6-4a17-b92f-c21210585d74 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:45.574401 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:45.590729 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde457ea-a9c0-4e57-945d-1f7dd6b3954b None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:45.611453 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd022aa-f32f-4551-a4ab-90a4b335a522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:45.612898 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd022aa-f32f-4551-a4ab-90a4b335a522 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:45.613218 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd022aa-f32f-4551-a4ab-90a4b335a522 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:45.613493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd022aa-f32f-4551-a4ab-90a4b335a522 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:45.626487 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d5007-eed7-4836-9d74-b0d9770594db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:45.627096 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d5007-eed7-4836-9d74-b0d9770594db None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:45.627367 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d5007-eed7-4836-9d74-b0d9770594db None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:45.627645 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d5007-eed7-4836-9d74-b0d9770594db None admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:45.628366 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d5007-eed7-4836-9d74-b0d9770594db None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:45.628668 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d5007-eed7-4836-9d74-b0d9770594db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:45.630425 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d5007-eed7-4836-9d74-b0d9770594db None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:45.648773 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 282/561] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Aug 8 17:32:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:45.649658 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d5007-eed7-4836-9d74-b0d9770594db None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:45.681448 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:45.693738 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd022aa-f32f-4551-a4ab-90a4b335a522 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:45.695643 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd022aa-f32f-4551-a4ab-90a4b335a522 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:45.758265 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d5007-eed7-4836-9d74-b0d9770594db None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:45.795398 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04506fc2-6d45-49d4-b25b-8d12406ee882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:45.796124 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04506fc2-6d45-49d4-b25b-8d12406ee882 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:45.796518 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04506fc2-6d45-49d4-b25b-8d12406ee882 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:45.796792 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04506fc2-6d45-49d4-b25b-8d12406ee882 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:45.808946 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 280/562] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:32:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:32:45.808946 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5008d-1305-4709-b40d-6b97b6afb568 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:45.808946 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5008d-1305-4709-b40d-6b97b6afb568 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:45.808946 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5008d-1305-4709-b40d-6b97b6afb568 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:45.812858 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04506fc2-6d45-49d4-b25b-8d12406ee882 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:45.812960 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 281/563] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:45.812960 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5008d-1305-4709-b40d-6b97b6afb568 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:45.813165 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04506fc2-6d45-49d4-b25b-8d12406ee882 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:45.813165 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:45.828917 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-04506fc2-6d45-49d4-b25b-8d12406ee882 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:45.828917 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:45.828917 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:45.828917 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:45.828917 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:45.828917 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:45.828917 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:45.828917 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:45.828917 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:45.828917 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:45.828917 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:45.828917 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:45.828917 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:45.828917 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:45.828917 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:45.828917 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:45.830133 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:45.830133 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:45.830133 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:45.830133 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:45.830133 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:45.830133 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:45.830133 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:45.830133 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:45.830133 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:45.830133 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:45.830133 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:45.830133 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:45.830133 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:45.830133 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:45.830133 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:45.830133 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:45.830133 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:45.831035 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:45.831035 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:45.831035 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:45.831035 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 283/564] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:45.831279 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04506fc2-6d45-49d4-b25b-8d12406ee882 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:45.918969 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:45.930096 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5008d-1305-4709-b40d-6b97b6afb568 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:45.939913 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04506fc2-6d45-49d4-b25b-8d12406ee882 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:45.966624 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32b7d5-1e25-4a82-bcd7-817b39ae5455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:45.967363 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32b7d5-1e25-4a82-bcd7-817b39ae5455 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:45.967643 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32b7d5-1e25-4a82-bcd7-817b39ae5455 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:45.967948 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32b7d5-1e25-4a82-bcd7-817b39ae5455 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:45.976073 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386d0a9-e3ad-4e88-b20e-14cc54224693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:45.976707 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386d0a9-e3ad-4e88-b20e-14cc54224693 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:45.976989 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386d0a9-e3ad-4e88-b20e-14cc54224693 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:45.977286 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386d0a9-e3ad-4e88-b20e-14cc54224693 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:45.978413 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32b7d5-1e25-4a82-bcd7-817b39ae5455 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:45.980130 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32b7d5-1e25-4a82-bcd7-817b39ae5455 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:45.989870 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386d0a9-e3ad-4e88-b20e-14cc54224693 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:45.991329 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386d0a9-e3ad-4e88-b20e-14cc54224693 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:45.996963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-2a32b7d5-1e25-4a82-bcd7-817b39ae5455 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:45.996963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:45.996963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:45.996963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:45.996963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:45.996963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:45.996963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:45.996963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:45.996963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:45.996963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:45.996963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:45.996963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:45.996963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:45.996963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:45.996963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:45.996963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:45.998064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:45.998064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:45.998064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:45.998064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:45.998064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:45.998064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:45.998064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:45.998064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:45.998064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:45.998064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:45.998064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:45.998064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:45.998064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:45.998064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:45.998064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:45.998064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:45.998064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:45.999003 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:45.999003 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:45.999003 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:45.999003 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 282/565] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:45.999738 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f918a1-f36a-47ae-a6c6-2f7bf74fe96e None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:45.999738 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f918a1-f36a-47ae-a6c6-2f7bf74fe96e None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:45.999895 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f918a1-f36a-47ae-a6c6-2f7bf74fe96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:46.011074 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-0386d0a9-e3ad-4e88-b20e-14cc54224693 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:46.011074 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:46.011074 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:46.011074 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:46.011074 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:46.011074 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:46.011074 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:46.011074 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:46.011074 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:46.011074 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:46.011074 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:46.011074 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:46.011074 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:46.011074 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:46.011074 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:46.011074 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:46.012114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:46.012114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:46.012114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:46.012114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:46.012114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:46.012114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:46.012114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:46.012114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:46.012114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:46.012114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:46.012114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:46.012114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:46.012114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:46.012114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:46.012114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:46.012114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:46.012114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:46.013005 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:46.013005 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:46.013005 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:46.016614 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 284/566] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:46.017476 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386d0a9-e3ad-4e88-b20e-14cc54224693 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:46.019190 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-c7f918a1-f36a-47ae-a6c6-2f7bf74fe96e None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:46.021968 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-c7f918a1-f36a-47ae-a6c6-2f7bf74fe96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:46.068020 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:46.092294 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 283/567] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:46.093094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f918a1-f36a-47ae-a6c6-2f7bf74fe96e None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:46.123806 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386d0a9-e3ad-4e88-b20e-14cc54224693 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:46.158419 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eee410-967f-44b2-8aaf-762a55e4c549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:46.159134 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eee410-967f-44b2-8aaf-762a55e4c549 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:46.159418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eee410-967f-44b2-8aaf-762a55e4c549 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:46.159689 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eee410-967f-44b2-8aaf-762a55e4c549 None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:46.160329 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eee410-967f-44b2-8aaf-762a55e4c549 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:46.161281 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eee410-967f-44b2-8aaf-762a55e4c549 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:46.162726 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eee410-967f-44b2-8aaf-762a55e4c549 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:46.174233 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:46.179955 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 285/568] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:46.180744 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eee410-967f-44b2-8aaf-762a55e4c549 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:46.205605 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f918a1-f36a-47ae-a6c6-2f7bf74fe96e None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:46.240876 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd8cc4-7b8c-4e70-bcdd-323447bf601d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:46.241804 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd8cc4-7b8c-4e70-bcdd-323447bf601d None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:46.242089 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd8cc4-7b8c-4e70-bcdd-323447bf601d None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:46.242363 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd8cc4-7b8c-4e70-bcdd-323447bf601d None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:46.242998 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd8cc4-7b8c-4e70-bcdd-323447bf601d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:46.243302 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd8cc4-7b8c-4e70-bcdd-323447bf601d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:46.244672 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd8cc4-7b8c-4e70-bcdd-323447bf601d None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:46.255600 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 284/569] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:46.256396 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd8cc4-7b8c-4e70-bcdd-323447bf601d None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:46.280332 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eee410-967f-44b2-8aaf-762a55e4c549 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:46.290107 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:46.314850 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13c625-cd61-421b-b648-65615b154b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:46.315452 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13c625-cd61-421b-b648-65615b154b36 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:46.315734 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13c625-cd61-421b-b648-65615b154b36 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:46.316007 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13c625-cd61-421b-b648-65615b154b36 None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:46.316645 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13c625-cd61-421b-b648-65615b154b36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:46.317007 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13c625-cd61-421b-b648-65615b154b36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:46.318517 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13c625-cd61-421b-b648-65615b154b36 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:46.330178 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 286/570] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:46.331240 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13c625-cd61-421b-b648-65615b154b36 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:46.356282 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd8cc4-7b8c-4e70-bcdd-323447bf601d None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:46.385929 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:46.391199 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812096b2-9c2b-4e2b-8657-95c59ef8cef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:46.391866 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812096b2-9c2b-4e2b-8657-95c59ef8cef5 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:46.392143 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812096b2-9c2b-4e2b-8657-95c59ef8cef5 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:46.392424 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812096b2-9c2b-4e2b-8657-95c59ef8cef5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:46.403414 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812096b2-9c2b-4e2b-8657-95c59ef8cef5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:46.408238 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-812096b2-9c2b-4e2b-8657-95c59ef8cef5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:32:46.408238 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:46.408238 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:46.408238 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:46.408238 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:46.408238 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:46.408238 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:46.408238 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:46.408238 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:46.408238 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:46.408238 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:46.408238 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:46.408238 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:46.408238 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:46.408238 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:46.408238 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:46.409216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:46.409216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:46.409216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:46.409216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:46.409216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:46.409216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:46.409216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:46.409216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:46.409216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:46.409216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:46.409216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:46.409216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:46.409216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:46.409216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:46.409216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:46.409216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:46.410068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:46.410068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:46.410068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:46.410068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:46.410068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:46.410068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:46.410068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:46.410068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:46.410068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:46.410068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:46.410068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:32:46.410068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:46.410068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 285/571] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 8 17:32:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:46.411502 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9182696-0732-489d-9e57-53a07eee11e4 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:46.411661 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9182696-0732-489d-9e57-53a07eee11e4 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:46.411796 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9182696-0732-489d-9e57-53a07eee11e4 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:46.417479 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 286/572] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:46.418270 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9182696-0732-489d-9e57-53a07eee11e4 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:46.437161 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13c625-cd61-421b-b648-65615b154b36 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:46.471242 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3c886-25b4-4d3e-93fa-22b4ae93ef8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:46.471861 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3c886-25b4-4d3e-93fa-22b4ae93ef8c None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:46.472148 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3c886-25b4-4d3e-93fa-22b4ae93ef8c None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:46.472415 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3c886-25b4-4d3e-93fa-22b4ae93ef8c None admin] PATH_INFO: `/v3/users/glance` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:46.480029 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd3c886-25b4-4d3e-93fa-22b4ae93ef8c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:46.481498 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd3c886-25b4-4d3e-93fa-22b4ae93ef8c None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:46.493379 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-4fd3c886-25b4-4d3e-93fa-22b4ae93ef8c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 08 17:32:46.493379 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:46.493379 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:46.493379 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:46.493379 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:46.493379 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:46.493379 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:46.493379 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:46.493379 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:46.493379 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:46.493379 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:46.493379 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:46.493379 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:32:46.493379 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:32:46.493379 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:32:46.493379 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:32:46.494499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:46.494499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:46.494499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:32:46.494499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:32:46.494499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:32:46.494499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:32:46.494499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:46.494499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:46.494499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:46.494499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:46.494499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:46.494499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:46.494499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:46.494499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:46.494499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:46.494499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:46.494499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:46.494499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:46.495445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:46.495445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:46.495445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:32:46.495445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:32:46.495445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:32:46.495445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:32:46.495445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:32:46.495445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:32:46.495445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 08 17:32:46.495445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:46.495445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 287/573] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:32:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:46.495445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3c886-25b4-4d3e-93fa-22b4ae93ef8c None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:46.524122 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9182696-0732-489d-9e57-53a07eee11e4 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:46.524561 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:46.557848 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee142d1-89cd-4994-8c63-436fa3a43b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:46.558457 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee142d1-89cd-4994-8c63-436fa3a43b3b None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:46.558726 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee142d1-89cd-4994-8c63-436fa3a43b3b None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:46.558995 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee142d1-89cd-4994-8c63-436fa3a43b3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:46.565552 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee142d1-89cd-4994-8c63-436fa3a43b3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:46.567141 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee142d1-89cd-4994-8c63-436fa3a43b3b None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:46.578007 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-7ee142d1-89cd-4994-8c63-436fa3a43b3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:32:46.578007 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:46.578007 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:46.578007 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:46.578007 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:46.578007 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:46.578007 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:46.578007 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:46.578007 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:46.578007 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:46.578007 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:46.578007 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:46.578007 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:32:46.578007 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:32:46.578007 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:32:46.578914 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:32:46.578914 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:46.578914 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:46.578914 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:46.578914 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:46.578914 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:46.578914 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:46.578914 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:46.578914 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:46.578914 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:46.578914 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:46.578914 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:46.578914 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:46.578914 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:46.578914 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:46.578914 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:46.578914 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:46.579815 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:32:46.579815 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:32:46.579815 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:32:46.579815 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:32:46.579815 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:32:46.579815 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:32:46.579815 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:32:46.579815 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:46.580863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 287/574] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:32:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:46.581848 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee142d1-89cd-4994-8c63-436fa3a43b3b None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:46.595859 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3c886-25b4-4d3e-93fa-22b4ae93ef8c None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:46.631251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8dead-b26b-4860-940b-cd2e575da164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:46.632222 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8dead-b26b-4860-940b-cd2e575da164 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:46.632675 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8dead-b26b-4860-940b-cd2e575da164 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:46.632955 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8dead-b26b-4860-940b-cd2e575da164 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:46.635486 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:46.639934 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8dead-b26b-4860-940b-cd2e575da164 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:46.641408 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8dead-b26b-4860-940b-cd2e575da164 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:46.652505 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-90d8dead-b26b-4860-940b-cd2e575da164 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:32:46.652505 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:46.652505 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:46.652505 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:46.652505 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:46.652505 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:46.652505 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:46.652505 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:46.652505 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:46.652505 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:46.652505 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:46.652505 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:46.652505 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:32:46.652505 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:32:46.652505 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:32:46.653577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:32:46.653577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:46.653577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:46.653577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:46.653577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:46.653577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:46.653577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:46.653577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:46.653577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:46.653577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:46.653577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:46.653577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:46.653577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:46.653577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:46.653577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:46.653577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:46.653577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:46.654477 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:32:46.654477 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:32:46.654477 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:32:46.654477 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:32:46.654477 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:32:46.654477 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:32:46.654477 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:32:46.654477 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:46.654477 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 288/575] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:32:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:46.655255 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802c3b3-d37d-4c12-a291-9cf4b82fc397 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:46.655255 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802c3b3-d37d-4c12-a291-9cf4b82fc397 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:46.655255 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802c3b3-d37d-4c12-a291-9cf4b82fc397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:46.672606 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-8802c3b3-d37d-4c12-a291-9cf4b82fc397 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:46.673825 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-8802c3b3-d37d-4c12-a291-9cf4b82fc397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:46.683162 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee142d1-89cd-4994-8c63-436fa3a43b3b None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:46.716824 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fac2f6-2f25-45e5-93f7-fdca9db7d380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:46.717462 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fac2f6-2f25-45e5-93f7-fdca9db7d380 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:46.717739 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fac2f6-2f25-45e5-93f7-fdca9db7d380 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:46.718013 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fac2f6-2f25-45e5-93f7-fdca9db7d380 None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:46.718678 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fac2f6-2f25-45e5-93f7-fdca9db7d380 None admin] RBAC: Adding query filter params (name=service) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:46.718977 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fac2f6-2f25-45e5-93f7-fdca9db7d380 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:46.720340 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fac2f6-2f25-45e5-93f7-fdca9db7d380 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:46.728476 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 288/576] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 8 17:32:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:46.729294 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fac2f6-2f25-45e5-93f7-fdca9db7d380 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:46.742096 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 289/577] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:46.742932 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802c3b3-d37d-4c12-a291-9cf4b82fc397 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:46.762115 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:46.830406 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fac2f6-2f25-45e5-93f7-fdca9db7d380 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:46.841188 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802c3b3-d37d-4c12-a291-9cf4b82fc397 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:46.843917 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:46.863959 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544b40f-615f-4178-8462-cf30ed648515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:46.864639 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544b40f-615f-4178-8462-cf30ed648515 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:46.864918 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544b40f-615f-4178-8462-cf30ed648515 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:46.865229 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544b40f-615f-4178-8462-cf30ed648515 None admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:46.865940 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544b40f-615f-4178-8462-cf30ed648515 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:46.866244 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544b40f-615f-4178-8462-cf30ed648515 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:46.867660 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544b40f-615f-4178-8462-cf30ed648515 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:46.875271 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3e5ed-7bb2-490d-865c-cd50ff2740fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:46.875874 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3e5ed-7bb2-490d-865c-cd50ff2740fc None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:46.876166 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3e5ed-7bb2-490d-865c-cd50ff2740fc None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:46.876436 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3e5ed-7bb2-490d-865c-cd50ff2740fc None admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:46.877890 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3e5ed-7bb2-490d-865c-cd50ff2740fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:46.877890 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3e5ed-7bb2-490d-865c-cd50ff2740fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:46.878857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3e5ed-7bb2-490d-865c-cd50ff2740fc None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:46.885771 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 289/578] 10.222.0.70 () {56 vars in 1137 bytes} [Mon Aug 8 17:32:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:46.886520 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544b40f-615f-4178-8462-cf30ed648515 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:46.896092 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 290/579] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 8 17:32:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:46.896092 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3e5ed-7bb2-490d-865c-cd50ff2740fc None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:46.971950 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:46.984225 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544b40f-615f-4178-8462-cf30ed648515 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:46.992760 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3e5ed-7bb2-490d-865c-cd50ff2740fc None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:47.019339 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe7aa9-c88e-4ad6-b410-ba0f4056958d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:47.020505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe7aa9-c88e-4ad6-b410-ba0f4056958d None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:47.020794 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe7aa9-c88e-4ad6-b410-ba0f4056958d None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:47.021191 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe7aa9-c88e-4ad6-b410-ba0f4056958d None admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:47.021891 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe7aa9-c88e-4ad6-b410-ba0f4056958d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:47.022216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe7aa9-c88e-4ad6-b410-ba0f4056958d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:47.023645 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe7aa9-c88e-4ad6-b410-ba0f4056958d None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:47.027469 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82814c2d-f7ec-4919-9971-9ccea43d4ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:47.028097 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82814c2d-f7ec-4919-9971-9ccea43d4ccc None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:47.028382 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82814c2d-f7ec-4919-9971-9ccea43d4ccc None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:47.028658 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82814c2d-f7ec-4919-9971-9ccea43d4ccc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:47.035211 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 290/580] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 8 17:32:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:47.036061 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe7aa9-c88e-4ad6-b410-ba0f4056958d None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:47.039677 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82814c2d-f7ec-4919-9971-9ccea43d4ccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:47.041305 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82814c2d-f7ec-4919-9971-9ccea43d4ccc None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:47.055879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-82814c2d-f7ec-4919-9971-9ccea43d4ccc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:47.055879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:47.055879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:47.055879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:47.055879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:47.055879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:47.055879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:47.055879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:47.055879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:47.055879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:47.055879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:47.055879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:47.055879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:47.055879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:47.055879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:47.055879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:47.056864 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:47.056864 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:47.056864 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:47.056864 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:47.056864 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:47.056864 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:47.056864 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:47.056864 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:47.056864 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:47.056864 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:47.056864 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:47.056864 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:47.056864 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:47.056864 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:47.056864 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:47.056864 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:47.056864 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:47.057901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:47.057901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:47.057901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:47.057901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 291/581] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:47.058134 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82814c2d-f7ec-4919-9971-9ccea43d4ccc None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:47.068559 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:47.137892 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe7aa9-c88e-4ad6-b410-ba0f4056958d None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:47.160291 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82814c2d-f7ec-4919-9971-9ccea43d4ccc None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:47.171264 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6111f4-fb9b-45e2-bdea-22e96995f6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:47.171886 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6111f4-fb9b-45e2-bdea-22e96995f6da None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:47.172165 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6111f4-fb9b-45e2-bdea-22e96995f6da None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:47.172436 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6111f4-fb9b-45e2-bdea-22e96995f6da None admin] PATH_INFO: `/v3/roles/service` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:47.183638 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6111f4-fb9b-45e2-bdea-22e96995f6da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:47.188740 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-7b6111f4-fb9b-45e2-bdea-22e96995f6da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:32:47.188740 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:47.188740 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:47.188740 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:47.188740 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:47.188740 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:47.188740 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:47.188740 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:47.188740 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:47.188740 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:47.188740 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:47.188740 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:47.188740 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:47.188740 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:47.188740 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:47.188740 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:47.189818 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:47.189818 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:47.189818 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:47.189818 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:47.189818 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:47.189818 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:47.189818 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:47.189818 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:47.189818 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:47.189818 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:47.189818 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:47.189818 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:47.189818 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:47.189818 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:47.189818 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:47.189818 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:47.190676 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:47.190676 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:47.190676 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:47.190676 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:47.190676 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:47.190676 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:47.190676 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:47.190676 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:47.190676 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:47.190676 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:47.190676 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:32:47.190676 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:47.190676 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 291/582] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 8 17:32:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:47.190676 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6111f4-fb9b-45e2-bdea-22e96995f6da None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:47.192266 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:47.199774 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d893b-56c5-4a1c-9ef0-cfad67c5da31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:47.200402 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d893b-56c5-4a1c-9ef0-cfad67c5da31 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:47.200683 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d893b-56c5-4a1c-9ef0-cfad67c5da31 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:47.200963 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d893b-56c5-4a1c-9ef0-cfad67c5da31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:47.211995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d893b-56c5-4a1c-9ef0-cfad67c5da31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:47.213469 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d893b-56c5-4a1c-9ef0-cfad67c5da31 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:47.227826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-722d893b-56c5-4a1c-9ef0-cfad67c5da31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:47.227826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:47.227826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:47.227826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:47.227826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:47.227826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:47.227826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:47.227826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:47.227826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:47.227826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:47.227826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:47.227826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:47.227826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:47.227826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:47.227826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:47.227826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:47.228936 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:47.228936 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:47.228936 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:47.228936 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:47.228936 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:47.228936 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:47.228936 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:47.228936 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:47.228936 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:47.228936 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:47.228936 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:47.228936 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:47.228936 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:47.228936 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:47.228936 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:47.228936 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:47.228936 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:47.229880 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:47.229880 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:47.229880 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:47.233764 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 292/583] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:47.234876 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d893b-56c5-4a1c-9ef0-cfad67c5da31 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:47.281804 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:47.290766 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6111f4-fb9b-45e2-bdea-22e96995f6da None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:47.324661 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06bd6f-3b7f-4772-9afc-6552c103cd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:47.325333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06bd6f-3b7f-4772-9afc-6552c103cd21 None admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:47.325609 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06bd6f-3b7f-4772-9afc-6552c103cd21 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:47.325875 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06bd6f-3b7f-4772-9afc-6552c103cd21 None admin] PATH_INFO: `/v3/projects/047a28b7cd11486da9d330723a384812/users/3973b8fbfbb9475896e4e110ca8aa615/roles/6d5d281c40dd4e69803141f48615b386` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:47.335060 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d893b-56c5-4a1c-9ef0-cfad67c5da31 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:47.340673 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b06bd6f-3b7f-4772-9afc-6552c103cd21 None admin] RBAC: Authorizing `identity:create_grant(project_id=047a28b7cd11486da9d330723a384812, user_id=3973b8fbfbb9475896e4e110ca8aa615, role_id=6d5d281c40dd4e69803141f48615b386)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:47.342188 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b06bd6f-3b7f-4772-9afc-6552c103cd21 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:47.368162 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac61c54-4d20-4800-8f31-f7f1a3878641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:47.368758 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac61c54-4d20-4800-8f31-f7f1a3878641 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:47.369050 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac61c54-4d20-4800-8f31-f7f1a3878641 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:47.369361 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac61c54-4d20-4800-8f31-f7f1a3878641 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:47.370074 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac61c54-4d20-4800-8f31-f7f1a3878641 None admin] RBAC: Adding query filter params (role.id=6d5d281c40dd4e69803141f48615b386, scope.project.id=047a28b7cd11486da9d330723a384812, user.id=67b83ff95ed44f35af2e412a700ca567) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:47.370379 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac61c54-4d20-4800-8f31-f7f1a3878641 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:47.371781 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac61c54-4d20-4800-8f31-f7f1a3878641 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:47.376904 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 293/584] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:32:47 2022] GET /identity/v3/role_assignments?user.id=67b83ff95ed44f35af2e412a700ca567&scope.project.id=047a28b7cd11486da9d330723a384812&role.id=6d5d281c40dd4e69803141f48615b386 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:47.377701 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac61c54-4d20-4800-8f31-f7f1a3878641 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:47.416661 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 292/585] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 8 17:32:47 2022] PUT /identity/v3/projects/047a28b7cd11486da9d330723a384812/users/3973b8fbfbb9475896e4e110ca8aa615/roles/6d5d281c40dd4e69803141f48615b386 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:32:47.417832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06bd6f-3b7f-4772-9afc-6552c103cd21 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:47.449810 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:47.529618 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac61c54-4d20-4800-8f31-f7f1a3878641 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:47.563227 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06bd6f-3b7f-4772-9afc-6552c103cd21 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:47.572840 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadb9e0-f07d-4420-b02f-1f29bb56c057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:47.573603 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadb9e0-f07d-4420-b02f-1f29bb56c057 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:47.573968 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadb9e0-f07d-4420-b02f-1f29bb56c057 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:47.574346 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadb9e0-f07d-4420-b02f-1f29bb56c057 None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:47.575114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eadb9e0-f07d-4420-b02f-1f29bb56c057 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:47.575488 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eadb9e0-f07d-4420-b02f-1f29bb56c057 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:47.576967 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eadb9e0-f07d-4420-b02f-1f29bb56c057 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:47.590772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 294/586] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:47.591718 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadb9e0-f07d-4420-b02f-1f29bb56c057 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:47.610135 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792ec8a-4ca7-480c-8145-1e37b174da1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:47.611045 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792ec8a-4ca7-480c-8145-1e37b174da1d None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:47.611507 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792ec8a-4ca7-480c-8145-1e37b174da1d None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:47.611988 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792ec8a-4ca7-480c-8145-1e37b174da1d None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:47.612911 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792ec8a-4ca7-480c-8145-1e37b174da1d None admin] RBAC: Adding query filter params (name=service) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:47.613247 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792ec8a-4ca7-480c-8145-1e37b174da1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:47.614788 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792ec8a-4ca7-480c-8145-1e37b174da1d None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:47.626365 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 293/587] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 8 17:32:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:47.626990 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792ec8a-4ca7-480c-8145-1e37b174da1d None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:47.637002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:47.716225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadb9e0-f07d-4420-b02f-1f29bb56c057 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:47.726079 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:47.760332 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792ec8a-4ca7-480c-8145-1e37b174da1d None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:47.762596 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb71ae-0ae0-4025-b0bc-4611600a7b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:47.764028 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb71ae-0ae0-4025-b0bc-4611600a7b9a None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:47.764313 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb71ae-0ae0-4025-b0bc-4611600a7b9a None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:47.764588 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb71ae-0ae0-4025-b0bc-4611600a7b9a None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:47.765259 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb71ae-0ae0-4025-b0bc-4611600a7b9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:47.765566 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb71ae-0ae0-4025-b0bc-4611600a7b9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:47.766933 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb71ae-0ae0-4025-b0bc-4611600a7b9a None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:47.782419 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 295/588] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:47.783726 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb71ae-0ae0-4025-b0bc-4611600a7b9a None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:47.798786 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa2e44-efd5-4a75-8669-9e5325d2c566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:47.799553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa2e44-efd5-4a75-8669-9e5325d2c566 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:47.799968 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa2e44-efd5-4a75-8669-9e5325d2c566 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:47.800519 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa2e44-efd5-4a75-8669-9e5325d2c566 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:47.810359 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa2e44-efd5-4a75-8669-9e5325d2c566 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:47.811919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa2e44-efd5-4a75-8669-9e5325d2c566 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:47.824453 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-cbaa2e44-efd5-4a75-8669-9e5325d2c566 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 17:32:47.824453 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:47.824453 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:47.824453 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:47.824453 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:47.824453 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:47.824453 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:47.824453 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:47.824453 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:47.824453 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:47.824453 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:47.824453 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:47.824453 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:32:47.824453 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:32:47.824453 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:32:47.824453 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:32:47.826699 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:47.826699 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:47.826699 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:32:47.826699 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:32:47.826699 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:32:47.826699 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:32:47.826699 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:47.826699 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:47.826699 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:47.826699 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:47.826699 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:47.826699 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:47.826699 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:47.826699 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:47.826699 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:47.826699 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:47.826699 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:47.826699 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:47.828068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:47.828068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:47.828068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:32:47.828068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:32:47.828068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:32:47.828068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:32:47.828068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:32:47.828068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:32:47.828068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 17:32:47.828068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:47.828068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 294/589] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:32:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:47.828068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa2e44-efd5-4a75-8669-9e5325d2c566 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:47.900910 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:47.912665 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb71ae-0ae0-4025-b0bc-4611600a7b9a None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:47.943678 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa2e44-efd5-4a75-8669-9e5325d2c566 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:47.956307 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decafe3a-9580-4abf-bbd9-4617f10a5221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:47.956940 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decafe3a-9580-4abf-bbd9-4617f10a5221 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:47.957253 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decafe3a-9580-4abf-bbd9-4617f10a5221 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:47.958086 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decafe3a-9580-4abf-bbd9-4617f10a5221 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:47.972123 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decafe3a-9580-4abf-bbd9-4617f10a5221 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:47.974223 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decafe3a-9580-4abf-bbd9-4617f10a5221 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:47.980979 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a98a75-7728-41be-88f1-4fd5104eba29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:47.981746 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a98a75-7728-41be-88f1-4fd5104eba29 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:47.982122 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a98a75-7728-41be-88f1-4fd5104eba29 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:47.982488 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a98a75-7728-41be-88f1-4fd5104eba29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:47.991353 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a98a75-7728-41be-88f1-4fd5104eba29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:47.991679 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-decafe3a-9580-4abf-bbd9-4617f10a5221 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:47.991679 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:47.991679 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:47.991679 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:47.991679 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:47.991679 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:47.991679 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:47.991679 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:47.991679 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:47.991679 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:47.991679 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:47.991679 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:47.991679 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:47.991679 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:47.991679 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:47.991679 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:47.993526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:47.993526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:47.993526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:47.993526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:47.993526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:47.993526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:47.993526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:47.993526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:47.993526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:47.993526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:47.993526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:47.993526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:47.993526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:47.993526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:47.993526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:47.993526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:47.993526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:47.995380 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:47.995380 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:47.995380 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:47.995380 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 296/590] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:47.995380 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decafe3a-9580-4abf-bbd9-4617f10a5221 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:47.995970 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a98a75-7728-41be-88f1-4fd5104eba29 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:48.009118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-22a98a75-7728-41be-88f1-4fd5104eba29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:32:48.009118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:48.009118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:48.009118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:48.009118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:48.009118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:48.009118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:48.009118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:48.009118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:48.009118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:48.009118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:48.009118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:48.009118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:32:48.009118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:32:48.009118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:32:48.010969 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:32:48.010969 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:48.010969 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:48.010969 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:48.010969 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:48.010969 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:48.010969 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:48.010969 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:48.010969 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:48.010969 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:48.010969 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:48.010969 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:48.010969 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:48.010969 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:48.010969 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:48.010969 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:48.010969 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:48.012775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:32:48.012775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:32:48.012775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:32:48.012775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:32:48.012775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:32:48.012775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:32:48.012775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:32:48.012775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:48.012775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 295/591] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:32:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:48.013850 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a98a75-7728-41be-88f1-4fd5104eba29 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:48.015285 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:48.118130 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decafe3a-9580-4abf-bbd9-4617f10a5221 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:48.138641 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a98a75-7728-41be-88f1-4fd5104eba29 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:48.158785 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b09898-6f1e-415c-883d-6a567f925f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:48.159819 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b09898-6f1e-415c-883d-6a567f925f58 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:48.160079 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b09898-6f1e-415c-883d-6a567f925f58 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:48.160448 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b09898-6f1e-415c-883d-6a567f925f58 None admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:48.162052 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b09898-6f1e-415c-883d-6a567f925f58 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:48.162428 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b09898-6f1e-415c-883d-6a567f925f58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:48.164023 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b09898-6f1e-415c-883d-6a567f925f58 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:48.170526 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:48.183424 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10f94a-dde7-4d00-aa69-b40da033b2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:48.184284 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10f94a-dde7-4d00-aa69-b40da033b2cb None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:48.184739 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10f94a-dde7-4d00-aa69-b40da033b2cb None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:48.184949 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 297/592] 10.222.0.70 () {56 vars in 1137 bytes} [Mon Aug 8 17:32:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:48.185388 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10f94a-dde7-4d00-aa69-b40da033b2cb None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:48.186018 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b09898-6f1e-415c-883d-6a567f925f58 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:48.186525 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10f94a-dde7-4d00-aa69-b40da033b2cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:48.187001 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10f94a-dde7-4d00-aa69-b40da033b2cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:48.188552 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10f94a-dde7-4d00-aa69-b40da033b2cb None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:48.204286 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 296/593] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:48.205774 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10f94a-dde7-4d00-aa69-b40da033b2cb None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:48.268444 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:48.291753 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b09898-6f1e-415c-883d-6a567f925f58 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:48.324785 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10f94a-dde7-4d00-aa69-b40da033b2cb None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:48.326355 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda952b-18ca-41a7-9bda-4c6cc44ab704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:48.327126 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda952b-18ca-41a7-9bda-4c6cc44ab704 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:48.327409 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda952b-18ca-41a7-9bda-4c6cc44ab704 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:48.327681 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda952b-18ca-41a7-9bda-4c6cc44ab704 None admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:48.329170 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda952b-18ca-41a7-9bda-4c6cc44ab704 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:48.329484 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda952b-18ca-41a7-9bda-4c6cc44ab704 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:48.330928 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda952b-18ca-41a7-9bda-4c6cc44ab704 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:48.344859 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 298/594] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 8 17:32:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:48.349924 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda952b-18ca-41a7-9bda-4c6cc44ab704 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:48.369571 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197299d-9834-43f2-b904-1c0183375831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:48.370617 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197299d-9834-43f2-b904-1c0183375831 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:48.371125 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197299d-9834-43f2-b904-1c0183375831 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:48.371619 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197299d-9834-43f2-b904-1c0183375831 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:48.383815 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2197299d-9834-43f2-b904-1c0183375831 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:48.385881 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2197299d-9834-43f2-b904-1c0183375831 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:48.411181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-2197299d-9834-43f2-b904-1c0183375831 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:48.411181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:48.411181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:48.411181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:48.411181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:48.411181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:48.411181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:48.411181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:48.411181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:48.411181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:48.411181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:48.411181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:48.411181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:48.411181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:48.411181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:48.411181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:48.412209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:48.412209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:48.412209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:48.412209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:48.412209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:48.412209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:48.412209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:48.412209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:48.412209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:48.412209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:48.412209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:48.412209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:48.412209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:48.412209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:48.412209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:48.412209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:48.412209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:48.417348 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:48.417348 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:48.417348 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:48.417348 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 297/595] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:48.417348 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197299d-9834-43f2-b904-1c0183375831 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:48.460044 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:48.478489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda952b-18ca-41a7-9bda-4c6cc44ab704 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:48.521462 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff08a7b-612f-4e6a-b277-d4d32b35913f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:48.522616 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff08a7b-612f-4e6a-b277-d4d32b35913f None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:48.523107 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff08a7b-612f-4e6a-b277-d4d32b35913f None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:48.523586 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff08a7b-612f-4e6a-b277-d4d32b35913f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:48.527066 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:48.533779 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff08a7b-612f-4e6a-b277-d4d32b35913f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:48.536147 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff08a7b-612f-4e6a-b277-d4d32b35913f None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:48.543706 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197299d-9834-43f2-b904-1c0183375831 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:48.549506 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-aff08a7b-612f-4e6a-b277-d4d32b35913f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 08 17:32:48.549506 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:48.549506 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:48.549506 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:48.549506 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:48.549506 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:48.549506 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:48.549506 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:48.549506 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:48.549506 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:48.549506 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:48.549506 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:48.549506 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:32:48.549506 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:32:48.549506 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:32:48.549506 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:32:48.550495 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:48.550495 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:48.550495 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:32:48.550495 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:32:48.550495 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:32:48.550495 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:32:48.550495 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:48.550495 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:48.550495 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:48.550495 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:48.550495 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:48.550495 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:48.550495 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:48.550495 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:48.550495 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:48.550495 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:48.550495 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:48.550495 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:48.552034 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:48.552034 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:48.552034 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:32:48.552034 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:32:48.552034 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:32:48.552034 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:32:48.552034 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:32:48.552034 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:32:48.552034 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 08 17:32:48.552034 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:48.554784 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 299/596] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 8 17:32:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:48.555899 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff08a7b-612f-4e6a-b277-d4d32b35913f None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:48.589437 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1390a04-be3b-46a5-9990-1f5cd86de414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:48.590349 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1390a04-be3b-46a5-9990-1f5cd86de414 None admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:48.590630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1390a04-be3b-46a5-9990-1f5cd86de414 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:48.590908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1390a04-be3b-46a5-9990-1f5cd86de414 None admin] PATH_INFO: `/v3/projects/047a28b7cd11486da9d330723a384812/users/4fab95367403451b921099425345b3ea/roles/6d5d281c40dd4e69803141f48615b386` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:48.611048 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1390a04-be3b-46a5-9990-1f5cd86de414 None admin] RBAC: Authorizing `identity:create_grant(project_id=047a28b7cd11486da9d330723a384812, user_id=4fab95367403451b921099425345b3ea, role_id=6d5d281c40dd4e69803141f48615b386)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:48.612771 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1390a04-be3b-46a5-9990-1f5cd86de414 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:48.682577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff08a7b-612f-4e6a-b277-d4d32b35913f None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:48.717816 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045318c-8313-4af5-b5f4-17424d187ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:48.718422 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045318c-8313-4af5-b5f4-17424d187ca4 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:48.718793 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045318c-8313-4af5-b5f4-17424d187ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:48.719064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045318c-8313-4af5-b5f4-17424d187ca4 None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:48.719704 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045318c-8313-4af5-b5f4-17424d187ca4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:48.720008 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045318c-8313-4af5-b5f4-17424d187ca4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:48.721463 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045318c-8313-4af5-b5f4-17424d187ca4 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:48.737196 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 300/597] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:48.737196 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045318c-8313-4af5-b5f4-17424d187ca4 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:48.752095 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 298/598] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 8 17:32:48 2022] PUT /identity/v3/projects/047a28b7cd11486da9d330723a384812/users/4fab95367403451b921099425345b3ea/roles/6d5d281c40dd4e69803141f48615b386 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:32:48.753178 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1390a04-be3b-46a5-9990-1f5cd86de414 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:48.829473 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:48.912460 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045318c-8313-4af5-b5f4-17424d187ca4 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:48.949720 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:48.976553 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef4c47-c2bf-4fb4-82d6-79bebb8af2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:48.977247 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef4c47-c2bf-4fb4-82d6-79bebb8af2a4 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:48.977530 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef4c47-c2bf-4fb4-82d6-79bebb8af2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:48.977800 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef4c47-c2bf-4fb4-82d6-79bebb8af2a4 None admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:48.978730 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef4c47-c2bf-4fb4-82d6-79bebb8af2a4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:48.979039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef4c47-c2bf-4fb4-82d6-79bebb8af2a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:48.981229 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef4c47-c2bf-4fb4-82d6-79bebb8af2a4 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:48.982934 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1390a04-be3b-46a5-9990-1f5cd86de414 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:49.005809 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 301/599] 10.222.0.70 () {56 vars in 1139 bytes} [Mon Aug 8 17:32:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:49.014039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef4c47-c2bf-4fb4-82d6-79bebb8af2a4 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:49.033207 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562193ad-84de-4984-92e3-c754bf3082ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:49.033857 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562193ad-84de-4984-92e3-c754bf3082ae None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:49.034114 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562193ad-84de-4984-92e3-c754bf3082ae None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:49.034390 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562193ad-84de-4984-92e3-c754bf3082ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:49.042118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562193ad-84de-4984-92e3-c754bf3082ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:49.043584 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562193ad-84de-4984-92e3-c754bf3082ae None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:49.058620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-562193ad-84de-4984-92e3-c754bf3082ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:32:49.058620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:49.058620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:49.058620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:49.058620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:49.058620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:49.058620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:49.058620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:49.058620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:49.058620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:49.058620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:49.058620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:49.058620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:32:49.058620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:32:49.058620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:32:49.059630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:32:49.059630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:49.059630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:49.059630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:49.059630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:49.059630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:49.059630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:49.059630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:49.059630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:49.059630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:49.059630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:49.059630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:49.059630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:49.059630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:49.059630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:49.059630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:49.059630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:49.060600 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:32:49.060600 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:32:49.060600 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:32:49.060600 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:32:49.060600 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:32:49.060600 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:32:49.060600 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:32:49.060600 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:49.060600 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 299/600] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:32:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:49.068754 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562193ad-84de-4984-92e3-c754bf3082ae None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:49.159835 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef4c47-c2bf-4fb4-82d6-79bebb8af2a4 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:49.181586 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:49.198916 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562193ad-84de-4984-92e3-c754bf3082ae None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:49.202832 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd981762-b4de-4833-8549-f6a032605bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:49.202832 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd981762-b4de-4833-8549-f6a032605bdf None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:49.203182 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd981762-b4de-4833-8549-f6a032605bdf None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:49.203458 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd981762-b4de-4833-8549-f6a032605bdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:49.214183 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd981762-b4de-4833-8549-f6a032605bdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:49.215633 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd981762-b4de-4833-8549-f6a032605bdf None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:49.240368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-fd981762-b4de-4833-8549-f6a032605bdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:49.240368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:49.240368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:49.240368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:49.240368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:49.240368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:49.240368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:49.240368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:49.240368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:49.240368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:49.240368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:49.240368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:49.240368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:49.240368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:49.240368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:49.240368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:49.241442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:49.241442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:49.241442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:49.241442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:49.241442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:49.241442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:49.241442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:49.241442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:49.241442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:49.241442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:49.241442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:49.241442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:49.241442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:49.241442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:49.241442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:49.241442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:49.241442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:49.242357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:49.242357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:49.242357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:49.242357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 302/601] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:49.248570 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd981762-b4de-4833-8549-f6a032605bdf None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:49.255604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6305cf-8fe7-4350-b5fc-70f6db1ba31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:49.256229 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6305cf-8fe7-4350-b5fc-70f6db1ba31e None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:49.256555 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6305cf-8fe7-4350-b5fc-70f6db1ba31e None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:49.256890 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6305cf-8fe7-4350-b5fc-70f6db1ba31e None admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:49.257626 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6305cf-8fe7-4350-b5fc-70f6db1ba31e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:49.257976 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6305cf-8fe7-4350-b5fc-70f6db1ba31e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:49.259485 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6305cf-8fe7-4350-b5fc-70f6db1ba31e None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:49.293092 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 300/602] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 8 17:32:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:49.298872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6305cf-8fe7-4350-b5fc-70f6db1ba31e None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:49.318525 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:49.401737 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd981762-b4de-4833-8549-f6a032605bdf None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:49.468198 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466aa5c9-0b25-4fe8-9986-a1a791617105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:49.468820 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466aa5c9-0b25-4fe8-9986-a1a791617105 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:49.469118 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466aa5c9-0b25-4fe8-9986-a1a791617105 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:49.469391 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466aa5c9-0b25-4fe8-9986-a1a791617105 None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:49.470045 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466aa5c9-0b25-4fe8-9986-a1a791617105 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:49.470348 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466aa5c9-0b25-4fe8-9986-a1a791617105 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:49.471711 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466aa5c9-0b25-4fe8-9986-a1a791617105 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:49.479821 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6305cf-8fe7-4350-b5fc-70f6db1ba31e None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:49.484888 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 303/603] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:49.486163 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e90e5-8e0e-4990-b175-2b6d3eba5c61 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:49.486449 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e90e5-8e0e-4990-b175-2b6d3eba5c61 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:49.486725 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e90e5-8e0e-4990-b175-2b6d3eba5c61 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:49.492929 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 304/604] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:49.493799 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e90e5-8e0e-4990-b175-2b6d3eba5c61 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:49.521354 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41fbb0-3837-4de0-a637-c682f9ae9c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:49.522033 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41fbb0-3837-4de0-a637-c682f9ae9c31 None admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:49.522317 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41fbb0-3837-4de0-a637-c682f9ae9c31 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:49.522636 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:49.523366 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41fbb0-3837-4de0-a637-c682f9ae9c31 None admin] PATH_INFO: `/v3/projects/047a28b7cd11486da9d330723a384812/users/44340c24b5784b58b829e2faa62ac58a/roles/6d5d281c40dd4e69803141f48615b386` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:49.539428 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41fbb0-3837-4de0-a637-c682f9ae9c31 None admin] RBAC: Authorizing `identity:create_grant(project_id=047a28b7cd11486da9d330723a384812, user_id=44340c24b5784b58b829e2faa62ac58a, role_id=6d5d281c40dd4e69803141f48615b386)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:49.541049 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41fbb0-3837-4de0-a637-c682f9ae9c31 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:49.601280 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e90e5-8e0e-4990-b175-2b6d3eba5c61 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:49.639053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f69cd9-a553-4d17-b416-a7d9b802d689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:49.639989 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f69cd9-a553-4d17-b416-a7d9b802d689 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:49.641973 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f69cd9-a553-4d17-b416-a7d9b802d689 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:49.642969 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f69cd9-a553-4d17-b416-a7d9b802d689 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:49.647938 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 301/605] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 8 17:32:49 2022] PUT /identity/v3/projects/047a28b7cd11486da9d330723a384812/users/44340c24b5784b58b829e2faa62ac58a/roles/6d5d281c40dd4e69803141f48615b386 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:32:49.648957 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f2625-4f3f-4b34-a99c-9730a42422b4 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:49.649265 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f2625-4f3f-4b34-a99c-9730a42422b4 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:49.649544 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f2625-4f3f-4b34-a99c-9730a42422b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:49.665996 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f69cd9-a553-4d17-b416-a7d9b802d689 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:49.668570 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f69cd9-a553-4d17-b416-a7d9b802d689 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:49.673746 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-f54f2625-4f3f-4b34-a99c-9730a42422b4 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:49.675157 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-f54f2625-4f3f-4b34-a99c-9730a42422b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:49.686249 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-63f69cd9-a553-4d17-b416-a7d9b802d689 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:32:49.686249 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:49.686249 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:49.686249 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:49.686249 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:49.686249 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:49.686249 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:49.686249 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:49.686249 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:49.686249 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:49.686249 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:49.686249 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:49.686249 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:32:49.686249 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:32:49.686249 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:32:49.687260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:32:49.687260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:49.687260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:49.687260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:49.687260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:49.687260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:49.687260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:49.687260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:49.687260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:49.687260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:49.687260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:49.687260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:49.687260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:49.687260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:49.687260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:49.687260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:49.687260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:49.688171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:32:49.688171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:32:49.688171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:32:49.688171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:32:49.688171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:32:49.688171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:32:49.688171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:32:49.688171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:49.695098 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 305/606] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:32:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:49.698113 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f69cd9-a553-4d17-b416-a7d9b802d689 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:49.753050 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:49.777885 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 302/607] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:49.780231 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73169773-6b69-47cb-8551-e0630a29d90f None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:49.780804 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73169773-6b69-47cb-8551-e0630a29d90f None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:49.781325 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73169773-6b69-47cb-8551-e0630a29d90f None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:49.782942 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 303/608] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:49.792264 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb7264-a222-49de-9425-ad9b07d2d7d0 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:49.792264 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb7264-a222-49de-9425-ad9b07d2d7d0 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:49.792264 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb7264-a222-49de-9425-ad9b07d2d7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:49.812238 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-6ceb7264-a222-49de-9425-ad9b07d2d7d0 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:49.814364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-6ceb7264-a222-49de-9425-ad9b07d2d7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:49.843723 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:49.864742 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f69cd9-a553-4d17-b416-a7d9b802d689 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:49.910834 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 304/609] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 17:32:49.911952 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb7264-a222-49de-9425-ad9b07d2d7d0 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:49.921148 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa8567-2980-4466-8c88-781b33f7ac08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:49.921716 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa8567-2980-4466-8c88-781b33f7ac08 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:49.922001 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa8567-2980-4466-8c88-781b33f7ac08 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:49.922805 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa8567-2980-4466-8c88-781b33f7ac08 None admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:49.923532 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa8567-2980-4466-8c88-781b33f7ac08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:49.923870 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa8567-2980-4466-8c88-781b33f7ac08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:49.926618 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa8567-2980-4466-8c88-781b33f7ac08 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:49.950501 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 306/610] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 8 17:32:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:49.951457 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa8567-2980-4466-8c88-781b33f7ac08 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:50.033976 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb7264-a222-49de-9425-ad9b07d2d7d0 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:50.053533 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:50.074471 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa8567-2980-4466-8c88-781b33f7ac08 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:50.075363 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec7a6f-23cb-40f1-8a5c-5d63ddb5fbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:50.076309 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec7a6f-23cb-40f1-8a5c-5d63ddb5fbf1 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:50.076593 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec7a6f-23cb-40f1-8a5c-5d63ddb5fbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:50.076865 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec7a6f-23cb-40f1-8a5c-5d63ddb5fbf1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:50.093229 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec7a6f-23cb-40f1-8a5c-5d63ddb5fbf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:50.100329 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-3eec7a6f-23cb-40f1-8a5c-5d63ddb5fbf1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:32:50.100329 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:50.100329 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:50.100329 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:50.100329 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:50.100329 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:50.100329 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:50.100329 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:50.100329 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:50.100329 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:50.100329 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:50.100329 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:50.100329 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:50.100329 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:50.100329 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:50.100329 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:50.101341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:50.101341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:50.101341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:50.101341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:50.101341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:50.101341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:50.101341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:50.101341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:50.101341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:50.101341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:50.101341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:50.101341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:50.101341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:50.101341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:50.101341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:50.101341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:50.102194 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:50.102194 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:50.102194 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:50.102194 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:50.102194 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:50.102194 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:50.102194 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:50.102194 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:50.102194 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:50.102194 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:50.102194 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:32:50.102194 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:50.102874 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 305/611] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 8 17:32:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:50.103448 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec7a6f-23cb-40f1-8a5c-5d63ddb5fbf1 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:50.119960 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b921704-8599-4bdb-8c0d-d6a441901290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:50.120785 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b921704-8599-4bdb-8c0d-d6a441901290 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:50.121096 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b921704-8599-4bdb-8c0d-d6a441901290 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:50.121380 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b921704-8599-4bdb-8c0d-d6a441901290 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:50.133955 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b921704-8599-4bdb-8c0d-d6a441901290 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:50.139101 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-5b921704-8599-4bdb-8c0d-d6a441901290 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:32:50.139101 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:50.139101 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:50.139101 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:50.139101 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:50.139101 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:50.139101 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:50.139101 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:50.139101 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:50.139101 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:50.139101 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:50.139101 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:50.139101 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:50.139101 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:50.139101 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:50.139101 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:50.140045 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:50.140045 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:50.140045 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:50.140045 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:50.140045 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:50.140045 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:50.140045 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:50.140045 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:50.140045 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:50.140045 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:50.140045 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:50.140045 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:50.140045 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:50.140045 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:50.140045 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:50.140045 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:50.140885 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:50.140885 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:50.140885 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:50.140885 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:50.140885 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:50.140885 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:50.140885 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:50.140885 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:50.140885 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:50.140885 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:50.140885 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:32:50.140885 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:50.145650 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 307/612] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 8 17:32:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:50.146555 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b921704-8599-4bdb-8c0d-d6a441901290 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:50.156678 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:50.228350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec7a6f-23cb-40f1-8a5c-5d63ddb5fbf1 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:50.264259 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e7037-3abc-48fe-815d-10fac4084147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:50.264938 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e7037-3abc-48fe-815d-10fac4084147 None admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:50.265308 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e7037-3abc-48fe-815d-10fac4084147 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:50.265586 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e7037-3abc-48fe-815d-10fac4084147 None admin] PATH_INFO: `/v3/projects/047a28b7cd11486da9d330723a384812/users/bdb6f0f0cde24b05a34b78d48dc45c0d/roles/6d5d281c40dd4e69803141f48615b386` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:50.278064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b921704-8599-4bdb-8c0d-d6a441901290 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:50.283003 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e7037-3abc-48fe-815d-10fac4084147 None admin] RBAC: Authorizing `identity:create_grant(project_id=047a28b7cd11486da9d330723a384812, user_id=bdb6f0f0cde24b05a34b78d48dc45c0d, role_id=6d5d281c40dd4e69803141f48615b386)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:50.284585 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e7037-3abc-48fe-815d-10fac4084147 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:50.316006 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6be21d-82a4-453b-a8be-c142b5651428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:50.316655 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6be21d-82a4-453b-a8be-c142b5651428 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:50.316939 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6be21d-82a4-453b-a8be-c142b5651428 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:50.317398 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6be21d-82a4-453b-a8be-c142b5651428 None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:50.318069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6be21d-82a4-453b-a8be-c142b5651428 None admin] RBAC: Adding query filter params (name=service) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:50.318405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6be21d-82a4-453b-a8be-c142b5651428 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:50.319793 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6be21d-82a4-453b-a8be-c142b5651428 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:50.328476 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 308/613] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 8 17:32:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:50.329444 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6be21d-82a4-453b-a8be-c142b5651428 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:50.352821 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 306/614] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 8 17:32:50 2022] PUT /identity/v3/projects/047a28b7cd11486da9d330723a384812/users/bdb6f0f0cde24b05a34b78d48dc45c0d/roles/6d5d281c40dd4e69803141f48615b386 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:32:50.354133 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e7037-3abc-48fe-815d-10fac4084147 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:50.391098 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:50.453778 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:50.489740 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e7037-3abc-48fe-815d-10fac4084147 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:50.532635 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc9dac-93bd-4895-81cd-41f10a7a780d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:50.533319 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc9dac-93bd-4895-81cd-41f10a7a780d None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:50.533600 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc9dac-93bd-4895-81cd-41f10a7a780d None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:50.533875 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc9dac-93bd-4895-81cd-41f10a7a780d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:50.546487 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc9dac-93bd-4895-81cd-41f10a7a780d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:50.548018 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc9dac-93bd-4895-81cd-41f10a7a780d None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:50.565902 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-09dc9dac-93bd-4895-81cd-41f10a7a780d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:50.565902 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:50.565902 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:50.565902 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:50.565902 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:50.565902 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:50.565902 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:50.565902 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:50.565902 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:50.565902 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:50.565902 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:50.565902 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:50.565902 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:50.565902 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:50.565902 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:50.565902 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:50.568505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:50.568505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:50.568505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:50.568505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:50.568505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:50.568505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:50.568505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:50.568505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:50.568505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:50.568505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:50.568505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:50.568505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:50.568505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:50.568505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:50.568505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:50.568505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:50.568505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:50.570681 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:50.570681 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:50.570681 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:50.570681 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 307/615] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:50.571193 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6be21d-82a4-453b-a8be-c142b5651428 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:50.574719 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc9dac-93bd-4895-81cd-41f10a7a780d None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:50.629966 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9ec9f-7c04-4e64-9a1d-9d11baf5c7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:50.630584 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9ec9f-7c04-4e64-9a1d-9d11baf5c7f8 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:50.630909 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9ec9f-7c04-4e64-9a1d-9d11baf5c7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:50.631188 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9ec9f-7c04-4e64-9a1d-9d11baf5c7f8 None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:50.631863 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9ec9f-7c04-4e64-9a1d-9d11baf5c7f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:50.632166 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9ec9f-7c04-4e64-9a1d-9d11baf5c7f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:50.635063 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9ec9f-7c04-4e64-9a1d-9d11baf5c7f8 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:50.644185 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 309/616] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 8 17:32:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:50.650691 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9ec9f-7c04-4e64-9a1d-9d11baf5c7f8 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:50.683016 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:50.706635 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc9dac-93bd-4895-81cd-41f10a7a780d None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:50.768454 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263a64d-0247-4fd6-b164-9bdb9199b27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:50.768980 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263a64d-0247-4fd6-b164-9bdb9199b27a None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:50.769288 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263a64d-0247-4fd6-b164-9bdb9199b27a None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:50.769592 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263a64d-0247-4fd6-b164-9bdb9199b27a None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:50.770760 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263a64d-0247-4fd6-b164-9bdb9199b27a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:50.771059 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263a64d-0247-4fd6-b164-9bdb9199b27a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:50.772432 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263a64d-0247-4fd6-b164-9bdb9199b27a None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:50.790462 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9ec9f-7c04-4e64-9a1d-9d11baf5c7f8 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:50.794644 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 308/617] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:32:50.800210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263a64d-0247-4fd6-b164-9bdb9199b27a None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:50.842192 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:50.852698 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ddc50a-ae23-4773-befb-25de9e30baca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:50.854908 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddc50a-ae23-4773-befb-25de9e30baca None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:50.854908 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddc50a-ae23-4773-befb-25de9e30baca None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:50.854908 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddc50a-ae23-4773-befb-25de9e30baca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:50.882463 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ddc50a-ae23-4773-befb-25de9e30baca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:50.883946 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ddc50a-ae23-4773-befb-25de9e30baca None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:50.900021 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-14ddc50a-ae23-4773-befb-25de9e30baca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:50.900021 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:50.900021 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:50.900021 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:50.900021 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:50.900021 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:50.900021 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:50.900021 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:50.900021 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:50.900021 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:50.900021 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:50.900021 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:50.900021 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:50.900021 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:50.900021 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:50.900021 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:50.901093 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:50.901093 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:50.901093 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:50.901093 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:50.901093 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:50.901093 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:50.901093 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:50.901093 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:50.901093 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:50.901093 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:50.901093 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:50.901093 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:50.901093 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:50.901093 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:50.901093 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:50.901093 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:50.901093 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:50.901994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:50.901994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:50.901994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:50.901994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 310/618] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:50.908838 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ddc50a-ae23-4773-befb-25de9e30baca None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:50.924859 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263a64d-0247-4fd6-b164-9bdb9199b27a None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:50.963590 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41b449-54e0-4700-a78c-140949fbf0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:50.964235 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41b449-54e0-4700-a78c-140949fbf0db None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:50.964508 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41b449-54e0-4700-a78c-140949fbf0db None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:50.964777 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41b449-54e0-4700-a78c-140949fbf0db None admin] PATH_INFO: `/v3/users/swift` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:50.981964 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41b449-54e0-4700-a78c-140949fbf0db None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:50.983425 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41b449-54e0-4700-a78c-140949fbf0db None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:50.989543 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:50.999609 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-4f41b449-54e0-4700-a78c-140949fbf0db None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 08 17:32:50.999609 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:50.999609 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:50.999609 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:50.999609 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:50.999609 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:50.999609 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:50.999609 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:50.999609 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:50.999609 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:50.999609 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:50.999609 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:50.999609 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:32:50.999609 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:32:50.999609 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:32:50.999609 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:32:51.004632 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:51.004632 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:51.004632 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:32:51.004632 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:32:51.004632 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:32:51.004632 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:32:51.004632 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:51.004632 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:51.004632 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:51.004632 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:51.004632 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:51.004632 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:51.004632 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:51.004632 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:51.004632 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:51.004632 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:51.004632 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:51.004632 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:51.005912 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:51.005912 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:51.005912 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:32:51.005912 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:32:51.005912 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:32:51.005912 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:32:51.005912 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:32:51.005912 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:32:51.005912 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 08 17:32:51.005912 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:51.005912 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 309/619] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 8 17:32:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:32:51.007565 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41b449-54e0-4700-a78c-140949fbf0db None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:51.116242 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41b449-54e0-4700-a78c-140949fbf0db None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:51.122306 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ddc50a-ae23-4773-befb-25de9e30baca None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:51.164035 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d0fb2f-71f3-4c50-ad99-29d9a79814d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:51.164035 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0fb2f-71f3-4c50-ad99-29d9a79814d4 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:51.164035 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0fb2f-71f3-4c50-ad99-29d9a79814d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:51.164035 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0fb2f-71f3-4c50-ad99-29d9a79814d4 None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:51.164534 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d0fb2f-71f3-4c50-ad99-29d9a79814d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:51.164534 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d0fb2f-71f3-4c50-ad99-29d9a79814d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:51.164534 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d0fb2f-71f3-4c50-ad99-29d9a79814d4 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:51.170388 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ef5a9-7bb5-4de4-94ea-45aeb8b143bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:51.171197 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ef5a9-7bb5-4de4-94ea-45aeb8b143bb None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:51.171732 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ef5a9-7bb5-4de4-94ea-45aeb8b143bb None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:51.172215 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ef5a9-7bb5-4de4-94ea-45aeb8b143bb None admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:51.173111 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ef5a9-7bb5-4de4-94ea-45aeb8b143bb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:51.173556 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ef5a9-7bb5-4de4-94ea-45aeb8b143bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:51.175212 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ef5a9-7bb5-4de4-94ea-45aeb8b143bb None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:51.175350 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 311/620] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:51.177004 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd6099-eb4c-45b4-89d5-d3663214a979 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:51.177319 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd6099-eb4c-45b4-89d5-d3663214a979 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:51.177593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd6099-eb4c-45b4-89d5-d3663214a979 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:51.179051 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 312/621] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:51.181154 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd6099-eb4c-45b4-89d5-d3663214a979 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:51.196865 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 310/622] 10.222.0.70 () {56 vars in 1135 bytes} [Mon Aug 8 17:32:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:51.198463 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f93c5-8e2f-409b-a49b-6e3307a1d76b None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:51.198933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f93c5-8e2f-409b-a49b-6e3307a1d76b None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:51.199384 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f93c5-8e2f-409b-a49b-6e3307a1d76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:51.218450 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-768f93c5-8e2f-409b-a49b-6e3307a1d76b None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:51.219884 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-768f93c5-8e2f-409b-a49b-6e3307a1d76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:51.238167 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:51.282080 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:51.295584 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 311/623] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:51.296433 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f93c5-8e2f-409b-a49b-6e3307a1d76b None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:51.314795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd6099-eb4c-45b4-89d5-d3663214a979 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:51.365387 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59103c19-aef6-49ae-81ce-4c6a82886679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:51.366030 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59103c19-aef6-49ae-81ce-4c6a82886679 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:51.366369 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59103c19-aef6-49ae-81ce-4c6a82886679 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:51.366594 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59103c19-aef6-49ae-81ce-4c6a82886679 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:51.376486 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59103c19-aef6-49ae-81ce-4c6a82886679 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:51.378678 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59103c19-aef6-49ae-81ce-4c6a82886679 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:51.401434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-59103c19-aef6-49ae-81ce-4c6a82886679 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 17:32:51.401434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:51.401434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:51.401434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:51.401434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:51.401434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:51.401434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:51.401434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:51.401434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:51.401434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:51.401434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:51.401434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:51.401434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:32:51.401434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:32:51.401434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:32:51.401434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:32:51.402470 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:51.402470 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:51.402470 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:32:51.402470 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:32:51.402470 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:32:51.402470 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:32:51.402470 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:51.402470 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:51.402470 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:51.402470 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:51.402470 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:51.402470 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:51.402470 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:51.402470 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:51.402470 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:51.402470 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:51.402470 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:51.402470 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:51.404023 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:51.404023 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:51.404023 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:32:51.404023 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:32:51.404023 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:32:51.404023 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:32:51.404023 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:32:51.404023 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:32:51.404023 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 17:32:51.404023 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:51.404023 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 313/624] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Aug 8 17:32:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:51.404023 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59103c19-aef6-49ae-81ce-4c6a82886679 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:51.427577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f93c5-8e2f-409b-a49b-6e3307a1d76b None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:51.473501 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d4cb1-bf15-44a5-bde0-9675e9f909f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:51.474564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d4cb1-bf15-44a5-bde0-9675e9f909f7 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:51.475007 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d4cb1-bf15-44a5-bde0-9675e9f909f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:51.475737 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d4cb1-bf15-44a5-bde0-9675e9f909f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:51.489051 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d4cb1-bf15-44a5-bde0-9675e9f909f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:51.491100 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d4cb1-bf15-44a5-bde0-9675e9f909f7 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:51.509983 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-480d4cb1-bf15-44a5-bde0-9675e9f909f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:51.509983 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:51.509983 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:51.509983 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:51.509983 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:51.509983 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:51.509983 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:51.509983 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:51.509983 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:51.509983 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:51.509983 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:51.509983 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:51.509983 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:51.509983 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:51.509983 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:51.509983 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:51.511210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:51.511210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:51.511210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:51.511210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:51.511210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:51.511210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:51.511210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:51.511210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:51.511210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:51.511210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:51.511210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:51.511210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:51.511210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:51.511210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:51.511210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:51.511210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:51.511210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:51.512352 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:51.512352 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:51.512352 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:51.513344 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 312/625] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:51.514235 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d4cb1-bf15-44a5-bde0-9675e9f909f7 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:51.523538 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59103c19-aef6-49ae-81ce-4c6a82886679 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:51.525850 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:51.558759 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:51.572437 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c93d2-5530-4d2b-a783-8d1501dd1a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:51.573589 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c93d2-5530-4d2b-a783-8d1501dd1a35 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:51.574049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c93d2-5530-4d2b-a783-8d1501dd1a35 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:51.574476 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c93d2-5530-4d2b-a783-8d1501dd1a35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:51.588389 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c93d2-5530-4d2b-a783-8d1501dd1a35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:51.594702 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-3b2c93d2-5530-4d2b-a783-8d1501dd1a35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:32:51.594702 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:51.594702 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:51.594702 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:51.594702 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:51.594702 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:51.594702 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:51.594702 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:51.594702 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:51.594702 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:51.594702 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:51.594702 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:51.594702 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:51.594702 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:51.594702 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:51.594702 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:51.595862 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:51.595862 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:51.595862 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:51.595862 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:51.595862 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:51.595862 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:51.595862 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:51.595862 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:51.595862 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:51.595862 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:51.595862 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:51.595862 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:51.595862 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:51.595862 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:51.595862 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:51.595862 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:51.596937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:51.596937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:51.596937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:51.596937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:51.596937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:51.596937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:51.596937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:51.596937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:51.596937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:51.596937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:51.596937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:32:51.596937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:51.605331 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 314/626] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 8 17:32:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:51.607028 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c93d2-5530-4d2b-a783-8d1501dd1a35 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:51.630978 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d4cb1-bf15-44a5-bde0-9675e9f909f7 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:51.666650 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067721d-c65a-415a-869a-7da8c58f82b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:51.667400 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067721d-c65a-415a-869a-7da8c58f82b3 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:51.667772 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067721d-c65a-415a-869a-7da8c58f82b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:51.668137 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067721d-c65a-415a-869a-7da8c58f82b3 None admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:51.668958 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067721d-c65a-415a-869a-7da8c58f82b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:51.669471 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067721d-c65a-415a-869a-7da8c58f82b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:51.670942 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067721d-c65a-415a-869a-7da8c58f82b3 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:51.689903 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 313/627] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Aug 8 17:32:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:51.691019 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067721d-c65a-415a-869a-7da8c58f82b3 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:51.747090 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c93d2-5530-4d2b-a783-8d1501dd1a35 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:51.792055 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:51.796794 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafb362-c422-44f8-a9ab-58aec9c94f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:51.797644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafb362-c422-44f8-a9ab-58aec9c94f71 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:51.798007 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067721d-c65a-415a-869a-7da8c58f82b3 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:51.798253 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafb362-c422-44f8-a9ab-58aec9c94f71 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:51.798690 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafb362-c422-44f8-a9ab-58aec9c94f71 None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:51.799635 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafb362-c422-44f8-a9ab-58aec9c94f71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:51.801320 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafb362-c422-44f8-a9ab-58aec9c94f71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:51.803304 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafb362-c422-44f8-a9ab-58aec9c94f71 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:51.826171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 315/628] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:51.827756 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafb362-c422-44f8-a9ab-58aec9c94f71 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:51.847728 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a7799-1865-4b6c-a013-06ead11a8fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:51.848897 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a7799-1865-4b6c-a013-06ead11a8fe1 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:51.849203 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a7799-1865-4b6c-a013-06ead11a8fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:51.849467 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a7799-1865-4b6c-a013-06ead11a8fe1 None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:51.850128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a7799-1865-4b6c-a013-06ead11a8fe1 None admin] RBAC: Adding query filter params (name=service) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:51.850422 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a7799-1865-4b6c-a013-06ead11a8fe1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:51.851772 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a7799-1865-4b6c-a013-06ead11a8fe1 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:51.860691 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 314/629] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 8 17:32:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:51.861355 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a7799-1865-4b6c-a013-06ead11a8fe1 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:51.862878 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:51.956742 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafb362-c422-44f8-a9ab-58aec9c94f71 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:51.991839 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a7799-1865-4b6c-a013-06ead11a8fe1 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:51.995393 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff62ad-abb6-4d77-9c9e-34e730bdc884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:51.996095 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff62ad-abb6-4d77-9c9e-34e730bdc884 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:51.996384 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff62ad-abb6-4d77-9c9e-34e730bdc884 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:51.996653 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff62ad-abb6-4d77-9c9e-34e730bdc884 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:52.033446 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00ad2b-a3a1-4339-8ef7-770cb79f993c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:52.034334 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00ad2b-a3a1-4339-8ef7-770cb79f993c None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:52.034821 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00ad2b-a3a1-4339-8ef7-770cb79f993c None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:52.035394 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00ad2b-a3a1-4339-8ef7-770cb79f993c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:52.045497 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00ad2b-a3a1-4339-8ef7-770cb79f993c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:52.047762 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00ad2b-a3a1-4339-8ef7-770cb79f993c None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:52.060554 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-ea00ad2b-a3a1-4339-8ef7-770cb79f993c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:32:52.060554 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:52.060554 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:52.060554 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:52.060554 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:52.060554 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:52.060554 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:52.060554 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:52.060554 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:52.060554 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:52.060554 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:52.060554 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:52.060554 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:32:52.060554 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:32:52.060554 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:32:52.061514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:32:52.061514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:52.061514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:52.061514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:52.061514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:52.061514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:52.061514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:52.061514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:52.061514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:52.061514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:52.061514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:52.061514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:52.061514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:52.061514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:52.061514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:52.061514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:52.061514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:52.062413 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:32:52.062413 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:32:52.062413 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:32:52.062413 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:32:52.062413 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:32:52.062413 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:32:52.062413 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:32:52.062413 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:52.062413 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 315/630] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:32:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:52.062413 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00ad2b-a3a1-4339-8ef7-770cb79f993c None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:52.072650 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff62ad-abb6-4d77-9c9e-34e730bdc884 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:52.074132 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff62ad-abb6-4d77-9c9e-34e730bdc884 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:52.085383 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:52.099503 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:52.174898 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00ad2b-a3a1-4339-8ef7-770cb79f993c None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:52.179032 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 316/631] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:32:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:32:52.180509 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68778abc-f892-4327-8b9f-73d835c1f26f None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:52.180985 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68778abc-f892-4327-8b9f-73d835c1f26f None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:52.181465 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68778abc-f892-4327-8b9f-73d835c1f26f None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:52.182913 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 317/632] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:52.184223 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68778abc-f892-4327-8b9f-73d835c1f26f None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:52.218214 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce96286-a358-4317-9977-ed22099537d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:52.219086 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce96286-a358-4317-9977-ed22099537d5 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:52.219609 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce96286-a358-4317-9977-ed22099537d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:52.219800 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce96286-a358-4317-9977-ed22099537d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:52.231266 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce96286-a358-4317-9977-ed22099537d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:52.233114 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce96286-a358-4317-9977-ed22099537d5 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:52.248977 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-dce96286-a358-4317-9977-ed22099537d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:52.248977 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:52.248977 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:52.248977 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:52.248977 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:52.248977 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:52.248977 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:52.248977 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:52.248977 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:52.248977 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:52.248977 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:52.248977 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:52.248977 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:52.248977 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:52.248977 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:52.248977 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:52.250015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:52.250015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:52.250015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:52.250015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:52.250015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:52.250015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:52.250015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:52.250015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:52.250015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:52.250015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:52.250015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:52.250015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:52.250015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:52.250015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:52.250015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:52.250015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:52.250015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:52.250920 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:52.250920 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:52.250920 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:52.250920 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 316/633] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:52.250920 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce96286-a358-4317-9977-ed22099537d5 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:52.300071 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68778abc-f892-4327-8b9f-73d835c1f26f None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:52.324351 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:52.327017 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:52.335827 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969eeae9-680f-4cf8-ba3c-72fa69b9245a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:52.336437 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969eeae9-680f-4cf8-ba3c-72fa69b9245a None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:52.342777 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969eeae9-680f-4cf8-ba3c-72fa69b9245a None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:52.342777 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969eeae9-680f-4cf8-ba3c-72fa69b9245a None admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:52.342777 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969eeae9-680f-4cf8-ba3c-72fa69b9245a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:52.342777 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969eeae9-680f-4cf8-ba3c-72fa69b9245a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:52.342777 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969eeae9-680f-4cf8-ba3c-72fa69b9245a None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:52.356726 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 318/634] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 8 17:32:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:52.356726 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399fa54-f890-4ec3-b1d1-6fd56fb1615f None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:52.356726 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399fa54-f890-4ec3-b1d1-6fd56fb1615f None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:52.356726 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399fa54-f890-4ec3-b1d1-6fd56fb1615f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:52.364325 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce96286-a358-4317-9977-ed22099537d5 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:52.373152 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-4399fa54-f890-4ec3-b1d1-6fd56fb1615f None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:52.374556 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-4399fa54-f890-4ec3-b1d1-6fd56fb1615f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:52.402011 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a31e9-2ff0-4821-8e09-a9bf94b74bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:52.402641 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a31e9-2ff0-4821-8e09-a9bf94b74bc7 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:52.402921 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a31e9-2ff0-4821-8e09-a9bf94b74bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:52.403196 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a31e9-2ff0-4821-8e09-a9bf94b74bc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:52.415570 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a31e9-2ff0-4821-8e09-a9bf94b74bc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:52.416526 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a31e9-2ff0-4821-8e09-a9bf94b74bc7 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:52.432109 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-569a31e9-2ff0-4821-8e09-a9bf94b74bc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:52.432109 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:52.432109 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:52.432109 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:52.432109 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:52.432109 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:52.432109 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:52.432109 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:52.432109 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:52.432109 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:52.432109 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:52.432109 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:52.432109 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:52.432109 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:52.432109 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:52.432109 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:52.433137 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:52.433137 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:52.433137 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:52.433137 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:52.433137 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:52.433137 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:52.433137 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:52.433137 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:52.433137 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:52.433137 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:52.433137 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:52.433137 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:52.433137 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:52.433137 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:52.433137 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:52.433137 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:52.433137 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:52.434040 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:52.434040 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:52.434040 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:52.434040 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 317/635] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:52.434040 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a31e9-2ff0-4821-8e09-a9bf94b74bc7 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:52.465056 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 319/636] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:52.465056 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399fa54-f890-4ec3-b1d1-6fd56fb1615f None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:52.564070 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a31e9-2ff0-4821-8e09-a9bf94b74bc7 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:52.572460 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399fa54-f890-4ec3-b1d1-6fd56fb1615f None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:52.587847 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:52.588238 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:52.600843 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7cee89-6fe7-4c5d-80e4-3e12dddc8464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:52.601719 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cee89-6fe7-4c5d-80e4-3e12dddc8464 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:52.602002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cee89-6fe7-4c5d-80e4-3e12dddc8464 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:52.602379 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cee89-6fe7-4c5d-80e4-3e12dddc8464 None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:52.603012 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7cee89-6fe7-4c5d-80e4-3e12dddc8464 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:52.603317 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7cee89-6fe7-4c5d-80e4-3e12dddc8464 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:52.604684 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7cee89-6fe7-4c5d-80e4-3e12dddc8464 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:52.611193 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790cd3c-7bb4-4f1e-af8e-9f5a13214fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:52.612069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790cd3c-7bb4-4f1e-af8e-9f5a13214fc2 None admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:52.612552 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790cd3c-7bb4-4f1e-af8e-9f5a13214fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:52.613004 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790cd3c-7bb4-4f1e-af8e-9f5a13214fc2 None admin] PATH_INFO: `/v3/projects/047a28b7cd11486da9d330723a384812/users/67b83ff95ed44f35af2e412a700ca567/roles/6d5d281c40dd4e69803141f48615b386` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:52.616571 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 318/637] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:52.617414 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7cee89-6fe7-4c5d-80e4-3e12dddc8464 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:52.634899 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3790cd3c-7bb4-4f1e-af8e-9f5a13214fc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=047a28b7cd11486da9d330723a384812, user_id=67b83ff95ed44f35af2e412a700ca567, role_id=6d5d281c40dd4e69803141f48615b386)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:52.636734 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3790cd3c-7bb4-4f1e-af8e-9f5a13214fc2 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:52.716113 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 320/638] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 8 17:32:52 2022] PUT /identity/v3/projects/047a28b7cd11486da9d330723a384812/users/67b83ff95ed44f35af2e412a700ca567/roles/6d5d281c40dd4e69803141f48615b386 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:32:52.717157 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790cd3c-7bb4-4f1e-af8e-9f5a13214fc2 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:52.717897 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7cee89-6fe7-4c5d-80e4-3e12dddc8464 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:52.759381 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ea8e6-a08e-462b-b4d8-dfacf5e950b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:52.759992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ea8e6-a08e-462b-b4d8-dfacf5e950b4 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:52.760265 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ea8e6-a08e-462b-b4d8-dfacf5e950b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:52.760528 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ea8e6-a08e-462b-b4d8-dfacf5e950b4 None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:52.761207 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ea8e6-a08e-462b-b4d8-dfacf5e950b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:52.761562 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ea8e6-a08e-462b-b4d8-dfacf5e950b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:52.762949 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ea8e6-a08e-462b-b4d8-dfacf5e950b4 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:52.776593 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 319/639] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:52.777508 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ea8e6-a08e-462b-b4d8-dfacf5e950b4 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:52.825009 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:52.853256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790cd3c-7bb4-4f1e-af8e-9f5a13214fc2 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:52.888778 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ea8e6-a08e-462b-b4d8-dfacf5e950b4 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:52.897969 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e63944-326e-47ee-b8b3-18714436ea8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:52.898604 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e63944-326e-47ee-b8b3-18714436ea8f None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:52.898880 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e63944-326e-47ee-b8b3-18714436ea8f None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:52.899152 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e63944-326e-47ee-b8b3-18714436ea8f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:52.910961 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e63944-326e-47ee-b8b3-18714436ea8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:52.915796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-72e63944-326e-47ee-b8b3-18714436ea8f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:32:52.915796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:52.915796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:52.915796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:52.915796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:52.915796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:52.915796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:52.915796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:52.915796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:52.915796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:52.915796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:52.915796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:52.915796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:52.915796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:52.915796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:52.915796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:52.916926 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:52.916926 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:52.916926 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:52.916926 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:52.916926 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:52.916926 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:52.916926 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:52.916926 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:52.916926 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:52.916926 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:52.916926 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:52.916926 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:52.916926 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:52.916926 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:52.916926 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:52.916926 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:52.918430 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:52.918430 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:52.918430 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:52.918430 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:52.918430 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:52.918430 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:52.918430 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:52.918430 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:52.918430 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:52.918430 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:52.918430 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:32:52.918430 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:52.918430 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 321/640] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 8 17:32:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:52.918430 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e991133-b8b0-42cb-afe5-69875f931691 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:52.919212 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e991133-b8b0-42cb-afe5-69875f931691 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:52.919212 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e991133-b8b0-42cb-afe5-69875f931691 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:52.923945 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 322/641] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:52.923945 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e991133-b8b0-42cb-afe5-69875f931691 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:52.940315 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb01e8-5979-406b-b3d9-b1c92843b772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:52.940941 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb01e8-5979-406b-b3d9-b1c92843b772 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:52.941283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb01e8-5979-406b-b3d9-b1c92843b772 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:52.941560 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb01e8-5979-406b-b3d9-b1c92843b772 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:52.947520 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:52.949839 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb01e8-5979-406b-b3d9-b1c92843b772 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:52.951567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb01e8-5979-406b-b3d9-b1c92843b772 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:52.963180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-f6fb01e8-5979-406b-b3d9-b1c92843b772 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 08 17:32:52.963180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:52.963180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:52.963180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:52.963180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:52.963180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:52.963180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:52.963180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:52.963180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:52.963180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:52.963180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:52.963180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:52.963180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:32:52.963180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:32:52.963180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:32:52.963180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:32:52.964461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:52.964461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:52.964461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:32:52.964461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:32:52.964461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:32:52.964461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:32:52.964461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:52.964461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:52.964461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:52.964461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:52.964461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:52.964461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:52.964461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:52.964461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:52.964461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:52.964461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:52.964461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:52.964461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:52.965521 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:52.965521 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:52.965521 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:32:52.965521 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:32:52.965521 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:32:52.965521 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:32:52.965521 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:32:52.965521 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:32:52.965521 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 08 17:32:52.965521 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:52.965521 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 320/642] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:32:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:52.965521 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb01e8-5979-406b-b3d9-b1c92843b772 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:53.038355 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e991133-b8b0-42cb-afe5-69875f931691 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:53.074412 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb01e8-5979-406b-b3d9-b1c92843b772 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:53.075990 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:53.077651 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42bcd25-986a-4ed5-a745-e28197b06d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:53.078386 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bcd25-986a-4ed5-a745-e28197b06d07 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:53.078673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bcd25-986a-4ed5-a745-e28197b06d07 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:53.088724 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bcd25-986a-4ed5-a745-e28197b06d07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:53.088724 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42bcd25-986a-4ed5-a745-e28197b06d07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:53.088724 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42bcd25-986a-4ed5-a745-e28197b06d07 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:53.101082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-d42bcd25-986a-4ed5-a745-e28197b06d07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:32:53.101082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:53.101082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:53.101082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:53.101082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:53.101082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:53.101082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:53.101082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:53.101082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:53.101082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:53.101082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:53.101082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:53.101082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:32:53.101082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:32:53.101082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:32:53.102201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:32:53.102201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:53.102201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:53.102201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:53.102201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:53.102201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:53.102201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:53.102201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:53.102201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:53.102201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:53.102201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:53.102201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:53.102201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:53.102201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:53.102201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:53.102201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:53.102201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:53.103401 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:32:53.103401 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:32:53.103401 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:32:53.103401 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:32:53.103401 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:32:53.103401 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:32:53.103401 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:32:53.103401 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:53.105199 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 323/643] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:32:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:53.106338 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a944ffd-59bd-4c79-a411-717c5a04f8ff None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:53.106627 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a944ffd-59bd-4c79-a411-717c5a04f8ff None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:53.106902 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a944ffd-59bd-4c79-a411-717c5a04f8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:53.115836 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75a5d2-d7a1-4178-b49f-6e7877e73d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:53.116443 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75a5d2-d7a1-4178-b49f-6e7877e73d8a None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:53.116719 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75a5d2-d7a1-4178-b49f-6e7877e73d8a None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:53.116989 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75a5d2-d7a1-4178-b49f-6e7877e73d8a None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:53.117703 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75a5d2-d7a1-4178-b49f-6e7877e73d8a None admin] RBAC: Adding query filter params (name=service) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:53.118003 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75a5d2-d7a1-4178-b49f-6e7877e73d8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:53.119404 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75a5d2-d7a1-4178-b49f-6e7877e73d8a None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:53.126235 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-1a944ffd-59bd-4c79-a411-717c5a04f8ff None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:53.127579 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-1a944ffd-59bd-4c79-a411-717c5a04f8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:53.133074 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 321/644] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 8 17:32:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:53.133074 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75a5d2-d7a1-4178-b49f-6e7877e73d8a None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:53.209796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 324/645] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:53.210712 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a944ffd-59bd-4c79-a411-717c5a04f8ff None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:53.229097 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:53.234705 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75a5d2-d7a1-4178-b49f-6e7877e73d8a None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:53.270482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544cfd60-29b4-438d-a072-d67752d3473c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:53.271089 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cfd60-29b4-438d-a072-d67752d3473c None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:53.271371 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cfd60-29b4-438d-a072-d67752d3473c None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:53.271647 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cfd60-29b4-438d-a072-d67752d3473c None admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:53.272372 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544cfd60-29b4-438d-a072-d67752d3473c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:53.272676 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544cfd60-29b4-438d-a072-d67752d3473c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:53.274137 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544cfd60-29b4-438d-a072-d67752d3473c None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:53.293076 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 322/646] 10.222.0.70 () {56 vars in 1137 bytes} [Mon Aug 8 17:32:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:53.293901 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544cfd60-29b4-438d-a072-d67752d3473c None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:53.320361 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:53.325401 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a944ffd-59bd-4c79-a411-717c5a04f8ff None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:53.366412 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07547391-a12e-450e-bb45-dccd03cdbfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:53.366937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07547391-a12e-450e-bb45-dccd03cdbfbd None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:53.367217 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07547391-a12e-450e-bb45-dccd03cdbfbd None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:53.367494 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07547391-a12e-450e-bb45-dccd03cdbfbd None admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:53.368185 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07547391-a12e-450e-bb45-dccd03cdbfbd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:53.368491 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07547391-a12e-450e-bb45-dccd03cdbfbd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:53.369945 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07547391-a12e-450e-bb45-dccd03cdbfbd None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:53.387398 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 325/647] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 8 17:32:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:53.387398 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07547391-a12e-450e-bb45-dccd03cdbfbd None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:53.413293 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544cfd60-29b4-438d-a072-d67752d3473c None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:53.451925 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07936117-5da6-45c9-acdd-9b138e017c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:53.452920 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07936117-5da6-45c9-acdd-9b138e017c93 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:53.453375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07936117-5da6-45c9-acdd-9b138e017c93 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:53.453652 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07936117-5da6-45c9-acdd-9b138e017c93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:53.461802 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:53.466107 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07936117-5da6-45c9-acdd-9b138e017c93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:53.472123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07936117-5da6-45c9-acdd-9b138e017c93 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:53.482872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-07936117-5da6-45c9-acdd-9b138e017c93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:53.482872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:53.482872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:53.482872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:53.482872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:53.482872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:53.482872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:53.482872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:53.482872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:53.482872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:53.482872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:53.482872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:53.482872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:53.482872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:53.482872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:53.482872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:53.483908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:53.483908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:53.483908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:53.483908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:53.483908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:53.483908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:53.483908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:53.483908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:53.483908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:53.483908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:53.483908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:53.483908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:53.483908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:53.483908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:53.483908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:53.483908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:53.483908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:53.485523 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:53.485523 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:53.485523 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:53.485523 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 323/648] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:53.485910 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07936117-5da6-45c9-acdd-9b138e017c93 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:53.498657 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07547391-a12e-450e-bb45-dccd03cdbfbd None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:53.541669 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb420b-583c-43d2-bcd3-636873020c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:53.542781 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb420b-583c-43d2-bcd3-636873020c7c None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:53.543487 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb420b-583c-43d2-bcd3-636873020c7c None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:53.544369 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb420b-583c-43d2-bcd3-636873020c7c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:53.557421 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb420b-583c-43d2-bcd3-636873020c7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:53.562511 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-5bdb420b-583c-43d2-bcd3-636873020c7c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:32:53.562511 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:53.562511 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:53.562511 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:53.562511 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:53.562511 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:53.562511 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:53.562511 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:53.562511 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:53.562511 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:53.562511 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:53.562511 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:53.562511 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:53.562511 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:53.562511 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:53.562511 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:53.563457 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:53.563457 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:53.563457 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:53.563457 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:53.563457 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:53.563457 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:53.563457 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:53.563457 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:53.563457 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:53.563457 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:53.563457 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:53.563457 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:53.563457 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:53.563457 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:53.563457 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:53.563457 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:53.564313 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:53.564313 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:53.564313 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:53.564313 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:53.564313 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:53.564313 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:53.564313 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:53.564313 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:53.564313 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:53.564313 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:53.564313 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:32:53.564313 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:53.566444 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:53.568609 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 326/649] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 8 17:32:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:53.569561 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb420b-583c-43d2-bcd3-636873020c7c None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:53.591825 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07936117-5da6-45c9-acdd-9b138e017c93 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:53.626182 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7f2f1-c085-4010-9a6f-93ccb4d10938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:53.626713 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7f2f1-c085-4010-9a6f-93ccb4d10938 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:53.626989 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7f2f1-c085-4010-9a6f-93ccb4d10938 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:53.627280 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7f2f1-c085-4010-9a6f-93ccb4d10938 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:53.677190 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb420b-583c-43d2-bcd3-636873020c7c None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:53.697893 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7f2f1-c085-4010-9a6f-93ccb4d10938 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:53.699343 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7f2f1-c085-4010-9a6f-93ccb4d10938 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:53.710409 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:53.716496 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d029a-1ea2-488e-ac86-614adffd84ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:53.717253 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d029a-1ea2-488e-ac86-614adffd84ab None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:53.717560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d029a-1ea2-488e-ac86-614adffd84ab None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:53.723725 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d029a-1ea2-488e-ac86-614adffd84ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:53.723725 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d029a-1ea2-488e-ac86-614adffd84ab None admin] RBAC: Adding query filter params (role.id=6d5d281c40dd4e69803141f48615b386, scope.project.id=047a28b7cd11486da9d330723a384812, user.id=3973b8fbfbb9475896e4e110ca8aa615) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:53.723725 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d029a-1ea2-488e-ac86-614adffd84ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:53.723725 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d029a-1ea2-488e-ac86-614adffd84ab None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:53.727663 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 327/650] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:32:53 2022] GET /identity/v3/role_assignments?user.id=3973b8fbfbb9475896e4e110ca8aa615&scope.project.id=047a28b7cd11486da9d330723a384812&role.id=6d5d281c40dd4e69803141f48615b386 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:53.728614 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d029a-1ea2-488e-ac86-614adffd84ab None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:53.802330 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:53.835064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 324/651] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:32:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:32:53.836353 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7f2f1-c085-4010-9a6f-93ccb4d10938 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:53.881722 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d029a-1ea2-488e-ac86-614adffd84ab None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:53.924641 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28511e21-1b35-4ca4-9634-65db7707fb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:53.925454 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28511e21-1b35-4ca4-9634-65db7707fb3a None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:53.926302 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28511e21-1b35-4ca4-9634-65db7707fb3a None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:53.926527 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28511e21-1b35-4ca4-9634-65db7707fb3a None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:53.927187 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28511e21-1b35-4ca4-9634-65db7707fb3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:53.927670 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28511e21-1b35-4ca4-9634-65db7707fb3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:53.929221 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28511e21-1b35-4ca4-9634-65db7707fb3a None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:53.949705 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 328/652] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:53.950564 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28511e21-1b35-4ca4-9634-65db7707fb3a None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:53.977543 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7f2f1-c085-4010-9a6f-93ccb4d10938 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:54.017135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:54.020060 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff3a67-8d37-48b7-b3a2-5a32186766b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:54.020761 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff3a67-8d37-48b7-b3a2-5a32186766b5 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:54.021903 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff3a67-8d37-48b7-b3a2-5a32186766b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:54.021903 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff3a67-8d37-48b7-b3a2-5a32186766b5 None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:54.022259 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff3a67-8d37-48b7-b3a2-5a32186766b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:54.022583 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff3a67-8d37-48b7-b3a2-5a32186766b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:54.024426 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff3a67-8d37-48b7-b3a2-5a32186766b5 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:54.033771 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 325/653] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 8 17:32:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:54.034855 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff3a67-8d37-48b7-b3a2-5a32186766b5 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:54.075620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:54.088616 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28511e21-1b35-4ca4-9634-65db7707fb3a None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:54.136433 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9bdd7-4da2-472c-ac58-a21508f85f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:54.137896 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9bdd7-4da2-472c-ac58-a21508f85f16 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:54.138604 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9bdd7-4da2-472c-ac58-a21508f85f16 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:54.139052 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9bdd7-4da2-472c-ac58-a21508f85f16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:54.149622 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff3a67-8d37-48b7-b3a2-5a32186766b5 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:54.154557 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba9bdd7-4da2-472c-ac58-a21508f85f16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:54.156220 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba9bdd7-4da2-472c-ac58-a21508f85f16 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:54.176835 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-2ba9bdd7-4da2-472c-ac58-a21508f85f16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:54.176835 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:54.176835 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:54.176835 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:54.176835 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:54.176835 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:54.176835 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:54.176835 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:54.176835 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:54.176835 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:54.176835 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:54.176835 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:54.176835 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:54.176835 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:54.176835 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:54.176835 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:54.177981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:54.177981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:54.177981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:54.177981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:54.177981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:54.177981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:54.177981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:54.177981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:54.177981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:54.177981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:54.177981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:54.177981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:54.177981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:54.177981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:54.177981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:54.177981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:54.177981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:54.178910 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:54.178910 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:54.178910 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:54.181279 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 329/654] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:54.182329 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9bdd7-4da2-472c-ac58-a21508f85f16 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:54.193132 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6afe5d-9b3b-47a5-b8d5-74df6762a469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:54.193868 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6afe5d-9b3b-47a5-b8d5-74df6762a469 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:54.194483 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6afe5d-9b3b-47a5-b8d5-74df6762a469 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:54.194483 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6afe5d-9b3b-47a5-b8d5-74df6762a469 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:54.204941 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6afe5d-9b3b-47a5-b8d5-74df6762a469 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:54.207592 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6afe5d-9b3b-47a5-b8d5-74df6762a469 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:54.221393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-1b6afe5d-9b3b-47a5-b8d5-74df6762a469 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 17:32:54.221393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:54.221393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:54.221393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:54.221393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:54.221393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:54.221393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:54.221393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:54.221393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:54.221393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:54.221393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:54.221393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:54.221393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:32:54.221393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:32:54.221393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:32:54.221393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:32:54.223199 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:54.223199 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:54.223199 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:32:54.223199 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:32:54.223199 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:32:54.223199 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:32:54.223199 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:54.223199 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:54.223199 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:54.223199 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:54.223199 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:54.223199 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:54.223199 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:54.223199 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:54.223199 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:54.223199 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:54.223199 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:54.223199 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:54.224166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:54.224166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:54.224166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:32:54.224166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:32:54.224166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:32:54.224166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:32:54.224166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:32:54.224166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:32:54.224166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 17:32:54.224166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:54.229237 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 326/655] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:32:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:54.229508 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6afe5d-9b3b-47a5-b8d5-74df6762a469 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:54.318003 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9bdd7-4da2-472c-ac58-a21508f85f16 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:54.331265 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:54.333799 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:54.339687 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6afe5d-9b3b-47a5-b8d5-74df6762a469 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:54.365567 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e6465-47ef-4a45-a26a-e392021a20bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:54.366451 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e6465-47ef-4a45-a26a-e392021a20bb None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:54.367342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e6465-47ef-4a45-a26a-e392021a20bb None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:54.367774 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e6465-47ef-4a45-a26a-e392021a20bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:54.381883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446e116-2cc7-4826-aa5d-cac543b348d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:54.382647 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e6465-47ef-4a45-a26a-e392021a20bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:54.383033 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446e116-2cc7-4826-aa5d-cac543b348d6 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:54.383784 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446e116-2cc7-4826-aa5d-cac543b348d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:54.384523 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446e116-2cc7-4826-aa5d-cac543b348d6 None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:54.385245 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446e116-2cc7-4826-aa5d-cac543b348d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:54.385522 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e6465-47ef-4a45-a26a-e392021a20bb None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:54.385645 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446e116-2cc7-4826-aa5d-cac543b348d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:54.386994 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446e116-2cc7-4826-aa5d-cac543b348d6 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:54.406208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-ad3e6465-47ef-4a45-a26a-e392021a20bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:54.406208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:54.406208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:54.406208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:54.406208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:54.406208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:54.406208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:54.406208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:54.406208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:54.406208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:54.406208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:54.406208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:54.406208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:54.406208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:54.406208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:54.406208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:54.407540 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:54.407540 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:54.407540 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:54.407540 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:54.407540 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:54.407540 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:54.407540 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:54.407540 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:54.407540 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:54.407540 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:54.407540 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:54.407540 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:54.407540 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:54.407540 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:54.407540 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:54.407540 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:54.407540 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:54.408601 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:54.408601 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:54.408601 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:54.408814 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 327/656] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:54.409077 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446e116-2cc7-4826-aa5d-cac543b348d6 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:54.417202 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 330/657] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:54.418266 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e6465-47ef-4a45-a26a-e392021a20bb None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:54.533351 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e6465-47ef-4a45-a26a-e392021a20bb None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:54.541395 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446e116-2cc7-4826-aa5d-cac543b348d6 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:54.579234 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4271bb1-f9f1-41f3-aafc-eca22c27fd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:54.579864 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4271bb1-f9f1-41f3-aafc-eca22c27fd91 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:54.580136 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9f690-f1f9-4968-ab6a-84834a1128e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:54.580270 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4271bb1-f9f1-41f3-aafc-eca22c27fd91 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:54.580409 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4271bb1-f9f1-41f3-aafc-eca22c27fd91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:54.581192 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9f690-f1f9-4968-ab6a-84834a1128e7 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:54.581625 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9f690-f1f9-4968-ab6a-84834a1128e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:54.582439 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9f690-f1f9-4968-ab6a-84834a1128e7 None admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:54.584376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9f690-f1f9-4968-ab6a-84834a1128e7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:54.585205 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9f690-f1f9-4968-ab6a-84834a1128e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:54.586881 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9f690-f1f9-4968-ab6a-84834a1128e7 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:54.587727 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4271bb1-f9f1-41f3-aafc-eca22c27fd91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:54.589470 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4271bb1-f9f1-41f3-aafc-eca22c27fd91 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:54.603981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-f4271bb1-f9f1-41f3-aafc-eca22c27fd91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:32:54.603981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:54.603981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:54.603981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:54.603981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:54.603981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:54.603981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:54.603981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:54.603981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:54.603981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:54.603981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:54.603981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:54.603981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:32:54.603981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:32:54.603981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:32:54.604925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:32:54.604925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:54.604925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:54.604925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:54.604925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:54.604925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:54.604925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:54.604925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:54.604925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:54.604925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:54.604925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:54.604925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:54.604925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:54.604925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:54.604925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:54.604925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:54.604925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:54.605861 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:32:54.605861 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:32:54.605861 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:32:54.605861 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:32:54.605861 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:32:54.605861 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:32:54.605861 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:32:54.605861 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:54.610104 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 331/658] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:32:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:54.610313 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4271bb1-f9f1-41f3-aafc-eca22c27fd91 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:54.615249 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 328/659] 10.222.0.70 () {56 vars in 1137 bytes} [Mon Aug 8 17:32:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:54.620823 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9f690-f1f9-4968-ab6a-84834a1128e7 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:54.635238 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:54.639877 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:54.716097 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4271bb1-f9f1-41f3-aafc-eca22c27fd91 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:54.735115 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9f690-f1f9-4968-ab6a-84834a1128e7 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:54.750957 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd8c2f-8f3e-499c-a68e-cfc1e34dcf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:54.751566 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd8c2f-8f3e-499c-a68e-cfc1e34dcf7a None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:54.751846 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd8c2f-8f3e-499c-a68e-cfc1e34dcf7a None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:54.752115 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd8c2f-8f3e-499c-a68e-cfc1e34dcf7a None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:54.752755 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd8c2f-8f3e-499c-a68e-cfc1e34dcf7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:54.753056 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd8c2f-8f3e-499c-a68e-cfc1e34dcf7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:54.754543 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd8c2f-8f3e-499c-a68e-cfc1e34dcf7a None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:54.772408 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 332/660] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:54.773332 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd8c2f-8f3e-499c-a68e-cfc1e34dcf7a None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:54.776548 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fcce2c-b600-44cf-8e5c-73f391b167b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:54.777520 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcce2c-b600-44cf-8e5c-73f391b167b3 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:54.778190 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcce2c-b600-44cf-8e5c-73f391b167b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:54.778457 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcce2c-b600-44cf-8e5c-73f391b167b3 None admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:54.779171 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fcce2c-b600-44cf-8e5c-73f391b167b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:54.779470 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fcce2c-b600-44cf-8e5c-73f391b167b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:54.780895 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fcce2c-b600-44cf-8e5c-73f391b167b3 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:54.794519 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 329/661] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 8 17:32:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:54.797235 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fcce2c-b600-44cf-8e5c-73f391b167b3 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:54.855002 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:54.874786 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd8c2f-8f3e-499c-a68e-cfc1e34dcf7a None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:54.875537 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:54.903307 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fcce2c-b600-44cf-8e5c-73f391b167b3 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:54.910998 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9dd392-2c11-4fe8-8df3-fd02889ad3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:54.911666 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9dd392-2c11-4fe8-8df3-fd02889ad3b1 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:54.911950 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9dd392-2c11-4fe8-8df3-fd02889ad3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:54.912324 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9dd392-2c11-4fe8-8df3-fd02889ad3b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:54.942469 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472fdd4-b000-4746-b4fc-33a89d4abb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:54.943368 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472fdd4-b000-4746-b4fc-33a89d4abb62 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:54.943651 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472fdd4-b000-4746-b4fc-33a89d4abb62 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:54.944085 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472fdd4-b000-4746-b4fc-33a89d4abb62 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:54.953150 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472fdd4-b000-4746-b4fc-33a89d4abb62 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:54.954608 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472fdd4-b000-4746-b4fc-33a89d4abb62 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:54.968547 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-7472fdd4-b000-4746-b4fc-33a89d4abb62 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 08 17:32:54.968547 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:54.968547 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:54.968547 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:54.968547 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:54.968547 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:54.968547 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:54.968547 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:54.968547 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:54.968547 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:54.968547 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:54.968547 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:54.968547 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:32:54.968547 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:32:54.968547 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:32:54.968547 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:32:54.969842 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:54.969842 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:54.969842 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:32:54.969842 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:32:54.969842 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:32:54.969842 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:32:54.969842 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:54.969842 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:54.969842 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:54.969842 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:54.969842 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:54.969842 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:54.969842 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:54.969842 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:54.969842 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:54.969842 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:54.969842 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:54.969842 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:54.976426 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:54.976426 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:54.976426 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:32:54.976426 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:32:54.976426 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:32:54.976426 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:32:54.976426 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:32:54.976426 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:32:54.976426 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 08 17:32:54.976426 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:54.976426 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 330/662] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 8 17:32:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:54.976426 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f347e-2953-49d9-912c-28b0cbbc50ad None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:54.976426 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f347e-2953-49d9-912c-28b0cbbc50ad None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:54.977325 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f347e-2953-49d9-912c-28b0cbbc50ad None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:54.977325 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 331/663] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:54.977923 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f347e-2953-49d9-912c-28b0cbbc50ad None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:54.991987 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9dd392-2c11-4fe8-8df3-fd02889ad3b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:54.993808 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9dd392-2c11-4fe8-8df3-fd02889ad3b1 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:55.082957 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:55.107734 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 333/664] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:32:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:32:55.107955 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f347e-2953-49d9-912c-28b0cbbc50ad None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:55.108068 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9dd392-2c11-4fe8-8df3-fd02889ad3b1 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:55.143814 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d5a5c-abc7-49a7-b6b9-12b06a90a0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:55.145116 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d5a5c-abc7-49a7-b6b9-12b06a90a0ba None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:55.145540 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d5a5c-abc7-49a7-b6b9-12b06a90a0ba None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:55.145733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d5a5c-abc7-49a7-b6b9-12b06a90a0ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:55.146419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d5a5c-abc7-49a7-b6b9-12b06a90a0ba None admin] RBAC: Adding query filter params (role.id=6d5d281c40dd4e69803141f48615b386, scope.project.id=047a28b7cd11486da9d330723a384812, user.id=4fab95367403451b921099425345b3ea) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:55.146722 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d5a5c-abc7-49a7-b6b9-12b06a90a0ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:55.148204 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d5a5c-abc7-49a7-b6b9-12b06a90a0ba None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:55.149984 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:55.154356 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 332/665] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:32:54 2022] GET /identity/v3/role_assignments?user.id=4fab95367403451b921099425345b3ea&scope.project.id=047a28b7cd11486da9d330723a384812&role.id=6d5d281c40dd4e69803141f48615b386 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:55.155429 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc4a96-b940-4434-b542-ab9ea938cba0 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:55.155760 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc4a96-b940-4434-b542-ab9ea938cba0 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:55.156028 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc4a96-b940-4434-b542-ab9ea938cba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:55.175230 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-c5dc4a96-b940-4434-b542-ab9ea938cba0 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:55.176495 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-c5dc4a96-b940-4434-b542-ab9ea938cba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:55.244991 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9dd392-2c11-4fe8-8df3-fd02889ad3b1 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:55.256035 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 333/666] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:55.257004 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc4a96-b940-4434-b542-ab9ea938cba0 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:55.285744 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ee181-35b2-492d-b83d-e57a06134458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:55.286753 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ee181-35b2-492d-b83d-e57a06134458 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:55.287263 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ee181-35b2-492d-b83d-e57a06134458 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:55.287748 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ee181-35b2-492d-b83d-e57a06134458 None admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:55.288765 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ee181-35b2-492d-b83d-e57a06134458 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:55.289299 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ee181-35b2-492d-b83d-e57a06134458 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:55.291164 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ee181-35b2-492d-b83d-e57a06134458 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:55.315212 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 334/667] 10.222.0.70 () {56 vars in 1139 bytes} [Mon Aug 8 17:32:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:55.317256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ee181-35b2-492d-b83d-e57a06134458 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:55.362643 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:55.390022 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc4a96-b940-4434-b542-ab9ea938cba0 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:55.432433 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:55.443546 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e738404-3d22-49c7-bc2f-1631e5baeeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:55.444514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e738404-3d22-49c7-bc2f-1631e5baeeb3 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:55.445581 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e738404-3d22-49c7-bc2f-1631e5baeeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:55.445861 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e738404-3d22-49c7-bc2f-1631e5baeeb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:55.448054 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ee181-35b2-492d-b83d-e57a06134458 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:55.459159 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e738404-3d22-49c7-bc2f-1631e5baeeb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:55.460843 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e738404-3d22-49c7-bc2f-1631e5baeeb3 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:55.481604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-9e738404-3d22-49c7-bc2f-1631e5baeeb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:55.481604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:55.481604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:55.481604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:55.481604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:55.481604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:55.481604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:55.481604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:55.481604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:55.481604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:55.481604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:55.481604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:55.481604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:55.481604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:55.481604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:55.481604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:55.482820 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:55.482820 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:55.482820 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:55.482820 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:55.482820 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:55.482820 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:55.482820 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:55.482820 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:55.482820 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:55.482820 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:55.482820 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:55.482820 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:55.482820 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:55.482820 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:55.482820 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:55.482820 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:55.482820 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:55.483869 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:55.483869 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:55.483869 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:55.483869 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 334/668] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:55.483869 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e738404-3d22-49c7-bc2f-1631e5baeeb3 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:55.496129 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576f87e-71e5-44c5-ba73-f2438b8e4a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:55.496761 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576f87e-71e5-44c5-ba73-f2438b8e4a44 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:55.497062 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576f87e-71e5-44c5-ba73-f2438b8e4a44 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:55.497350 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576f87e-71e5-44c5-ba73-f2438b8e4a44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:55.512040 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7576f87e-71e5-44c5-ba73-f2438b8e4a44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:55.517197 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-7576f87e-71e5-44c5-ba73-f2438b8e4a44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:32:55.517197 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:55.517197 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:55.517197 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:55.517197 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:55.517197 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:55.517197 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:55.517197 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:55.517197 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:55.517197 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:55.517197 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:55.517197 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:55.517197 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:55.517197 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:55.517197 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:55.517197 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:55.518342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:55.518342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:55.518342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:55.518342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:55.518342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:55.518342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:55.518342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:55.518342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:55.518342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:55.518342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:55.518342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:55.518342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:55.518342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:55.518342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:55.518342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:55.518342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:55.519920 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:55.519920 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:55.519920 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:55.519920 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:55.519920 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:55.519920 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:55.519920 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:55.519920 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:55.519920 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:55.519920 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:55.519920 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:32:55.519920 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:55.519920 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 335/669] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 8 17:32:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:55.520863 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576f87e-71e5-44c5-ba73-f2438b8e4a44 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:55.598205 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e738404-3d22-49c7-bc2f-1631e5baeeb3 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:55.632882 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:55.633726 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c5ed26-d6a5-49fe-9339-1afbc1c2fed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:55.634172 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5ed26-d6a5-49fe-9339-1afbc1c2fed7 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:55.634455 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5ed26-d6a5-49fe-9339-1afbc1c2fed7 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:55.634732 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5ed26-d6a5-49fe-9339-1afbc1c2fed7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:55.638697 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576f87e-71e5-44c5-ba73-f2438b8e4a44 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:55.678394 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb06a6-ce1f-470f-a62b-17d77334539b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:55.679249 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb06a6-ce1f-470f-a62b-17d77334539b None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:55.679693 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb06a6-ce1f-470f-a62b-17d77334539b None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:55.680113 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb06a6-ce1f-470f-a62b-17d77334539b None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:55.680915 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb06a6-ce1f-470f-a62b-17d77334539b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:55.681401 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb06a6-ce1f-470f-a62b-17d77334539b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:55.683072 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb06a6-ce1f-470f-a62b-17d77334539b None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:55.694588 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:55.697823 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 336/670] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:55.698956 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb06a6-ce1f-470f-a62b-17d77334539b None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:55.724489 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c5ed26-d6a5-49fe-9339-1afbc1c2fed7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:55.726504 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c5ed26-d6a5-49fe-9339-1afbc1c2fed7 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:55.810951 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb06a6-ce1f-470f-a62b-17d77334539b None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:55.850777 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e7a04-1ed2-41ca-8896-ab9e20a667ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:55.852190 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e7a04-1ed2-41ca-8896-ab9e20a667ea None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:55.852956 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e7a04-1ed2-41ca-8896-ab9e20a667ea None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:55.853500 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e7a04-1ed2-41ca-8896-ab9e20a667ea None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:55.854912 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5e7a04-1ed2-41ca-8896-ab9e20a667ea None admin] RBAC: Adding query filter params (name=service) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:55.855712 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5e7a04-1ed2-41ca-8896-ab9e20a667ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:55.857315 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5e7a04-1ed2-41ca-8896-ab9e20a667ea None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:55.858326 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 335/671] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:32:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:32:55.859678 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c5ed26-d6a5-49fe-9339-1afbc1c2fed7 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:55.869817 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 337/672] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 8 17:32:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:55.870988 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e7a04-1ed2-41ca-8896-ab9e20a667ea None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:55.899296 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:55.985411 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:55.994656 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e7a04-1ed2-41ca-8896-ab9e20a667ea None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:55.998660 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c5ed26-d6a5-49fe-9339-1afbc1c2fed7 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:56.034290 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7872b6-de43-4b7b-985c-dfd897f0528d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:56.035470 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7872b6-de43-4b7b-985c-dfd897f0528d None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:56.035753 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7872b6-de43-4b7b-985c-dfd897f0528d None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:56.036027 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7872b6-de43-4b7b-985c-dfd897f0528d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:56.047014 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7872b6-de43-4b7b-985c-dfd897f0528d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:56.048452 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7872b6-de43-4b7b-985c-dfd897f0528d None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:56.048944 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5601ac-cffc-4742-bcab-e87e39ecc08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:56.049826 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5601ac-cffc-4742-bcab-e87e39ecc08b None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:56.051149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5601ac-cffc-4742-bcab-e87e39ecc08b None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:56.052032 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5601ac-cffc-4742-bcab-e87e39ecc08b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:56.060594 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5601ac-cffc-4742-bcab-e87e39ecc08b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:56.062320 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5601ac-cffc-4742-bcab-e87e39ecc08b None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:56.063454 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-6f7872b6-de43-4b7b-985c-dfd897f0528d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:56.063454 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:56.063454 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:56.063454 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:56.063454 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:56.063454 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:56.063454 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:56.063454 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:56.063454 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:56.063454 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:56.063454 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:56.063454 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:56.063454 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:56.063454 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:56.063454 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:56.063454 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:56.064438 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:56.064438 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:56.064438 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:56.064438 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:56.064438 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:56.064438 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:56.064438 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:56.064438 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:56.064438 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:56.064438 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:56.064438 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:56.064438 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:56.064438 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:56.064438 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:56.064438 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:56.064438 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:56.064438 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:56.065382 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:56.065382 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:56.065382 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:56.065382 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 338/673] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:56.065382 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7872b6-de43-4b7b-985c-dfd897f0528d None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:56.081060 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-9d5601ac-cffc-4742-bcab-e87e39ecc08b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:32:56.081060 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:56.081060 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:56.081060 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:56.081060 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:56.081060 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:56.081060 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:56.081060 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:56.081060 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:56.081060 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:56.081060 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:56.081060 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:56.081060 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:32:56.081060 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:32:56.081060 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:32:56.088765 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:32:56.088765 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:56.088765 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:56.088765 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:56.088765 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:56.088765 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:56.088765 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:56.088765 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:56.088765 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:56.088765 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:56.088765 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:56.088765 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:56.088765 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:56.088765 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:56.088765 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:56.088765 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:56.088765 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:56.090009 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:32:56.090009 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:32:56.090009 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:32:56.090009 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:32:56.090009 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:32:56.090009 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:32:56.090009 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:32:56.090009 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:56.090009 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 336/674] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:32:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:56.091471 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae545c-fa13-4179-965e-3be6eb579b87 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:56.091753 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae545c-fa13-4179-965e-3be6eb579b87 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:56.092029 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae545c-fa13-4179-965e-3be6eb579b87 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:56.097081 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 337/675] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:56.097081 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae545c-fa13-4179-965e-3be6eb579b87 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:56.146676 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:56.177558 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7872b6-de43-4b7b-985c-dfd897f0528d None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:56.203662 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae545c-fa13-4179-965e-3be6eb579b87 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:56.213351 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44566e59-9f5a-49c5-a951-15191b9a2917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:56.213977 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44566e59-9f5a-49c5-a951-15191b9a2917 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:56.214258 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44566e59-9f5a-49c5-a951-15191b9a2917 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:56.214594 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44566e59-9f5a-49c5-a951-15191b9a2917 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:56.225944 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44566e59-9f5a-49c5-a951-15191b9a2917 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:56.227601 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44566e59-9f5a-49c5-a951-15191b9a2917 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:56.242288 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9bae4-2b9d-4647-8199-500659773491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:56.243106 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9bae4-2b9d-4647-8199-500659773491 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:56.243229 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-44566e59-9f5a-49c5-a951-15191b9a2917 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:56.243229 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:56.243229 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:56.243229 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:56.243229 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:56.243229 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:56.243229 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:56.243229 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:56.243229 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:56.243229 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:56.243229 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:56.243229 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:56.243229 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:56.243229 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:56.243229 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:56.243229 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:56.244117 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:56.244117 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:56.244117 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:56.244117 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:56.244117 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:56.244117 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:56.244117 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:56.244117 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:56.244117 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:56.244117 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:56.244117 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:56.244117 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:56.244117 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:56.244117 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:56.244117 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:56.244117 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:56.244117 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:56.245050 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:56.245050 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:56.245050 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:56.245050 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 339/676] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:56.245050 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44566e59-9f5a-49c5-a951-15191b9a2917 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:56.245960 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9bae4-2b9d-4647-8199-500659773491 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:56.246242 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9bae4-2b9d-4647-8199-500659773491 None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:56.246886 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e9bae4-2b9d-4647-8199-500659773491 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:56.247190 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e9bae4-2b9d-4647-8199-500659773491 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:56.248572 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e9bae4-2b9d-4647-8199-500659773491 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:56.259008 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:56.266481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 338/677] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:56.266481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb7046-9d78-4172-a7d7-9cccbc2489b0 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:56.266481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb7046-9d78-4172-a7d7-9cccbc2489b0 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:56.266481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb7046-9d78-4172-a7d7-9cccbc2489b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:56.283314 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-eecb7046-9d78-4172-a7d7-9cccbc2489b0 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:56.285230 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-eecb7046-9d78-4172-a7d7-9cccbc2489b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:56.357217 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44566e59-9f5a-49c5-a951-15191b9a2917 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:56.368573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 339/678] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:56.369264 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb7046-9d78-4172-a7d7-9cccbc2489b0 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:56.395821 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:56.408041 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67debbf-80c0-4bcc-9440-a7b88ab26d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:56.409126 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67debbf-80c0-4bcc-9440-a7b88ab26d20 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:56.409126 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67debbf-80c0-4bcc-9440-a7b88ab26d20 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:56.409365 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67debbf-80c0-4bcc-9440-a7b88ab26d20 None admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:56.410703 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67debbf-80c0-4bcc-9440-a7b88ab26d20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:56.411013 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67debbf-80c0-4bcc-9440-a7b88ab26d20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:56.412464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67debbf-80c0-4bcc-9440-a7b88ab26d20 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:56.426187 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 340/679] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 8 17:32:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:56.427034 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67debbf-80c0-4bcc-9440-a7b88ab26d20 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:56.492377 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb7046-9d78-4172-a7d7-9cccbc2489b0 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:56.523275 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:56.529525 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd7336-4cf0-44f2-ab37-d8020581d094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:56.534925 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd7336-4cf0-44f2-ab37-d8020581d094 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:56.534925 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd7336-4cf0-44f2-ab37-d8020581d094 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:56.534925 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd7336-4cf0-44f2-ab37-d8020581d094 None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:56.534925 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd7336-4cf0-44f2-ab37-d8020581d094 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:56.534925 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd7336-4cf0-44f2-ab37-d8020581d094 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:56.534925 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd7336-4cf0-44f2-ab37-d8020581d094 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:56.535447 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67debbf-80c0-4bcc-9440-a7b88ab26d20 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:56.549141 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 340/680] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:56.549141 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd7336-4cf0-44f2-ab37-d8020581d094 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:56.576766 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a60595-7db9-4f48-9725-c5136e8e45a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:56.577422 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a60595-7db9-4f48-9725-c5136e8e45a4 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:56.577700 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a60595-7db9-4f48-9725-c5136e8e45a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:56.578032 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a60595-7db9-4f48-9725-c5136e8e45a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:56.585878 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a60595-7db9-4f48-9725-c5136e8e45a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:56.587339 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a60595-7db9-4f48-9725-c5136e8e45a4 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:56.600156 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-f1a60595-7db9-4f48-9725-c5136e8e45a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:32:56.600156 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:56.600156 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:56.600156 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:56.600156 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:56.600156 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:56.600156 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:56.600156 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:56.600156 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:56.600156 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:56.600156 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:56.600156 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:56.600156 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:32:56.600156 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:32:56.600156 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:32:56.601695 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:32:56.601695 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:56.601695 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:56.601695 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:56.601695 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:56.601695 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:56.601695 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:56.601695 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:56.601695 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:56.601695 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:56.601695 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:56.601695 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:56.601695 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:56.601695 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:56.601695 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:56.601695 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:56.601695 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:56.602691 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:32:56.602691 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:32:56.602691 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:32:56.602691 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:32:56.602691 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:32:56.602691 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:32:56.602691 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:32:56.602691 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:56.602691 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 341/681] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:32:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:56.602691 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a60595-7db9-4f48-9725-c5136e8e45a4 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:56.647965 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:56.660573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd7336-4cf0-44f2-ab37-d8020581d094 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:56.697052 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06d8cb-f5dc-412a-988c-d0f7acc03acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:56.697682 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06d8cb-f5dc-412a-988c-d0f7acc03acf None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:56.697957 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06d8cb-f5dc-412a-988c-d0f7acc03acf None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:56.698227 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06d8cb-f5dc-412a-988c-d0f7acc03acf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:56.707091 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a60595-7db9-4f48-9725-c5136e8e45a4 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:56.708476 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06d8cb-f5dc-412a-988c-d0f7acc03acf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:32:56.713550 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-7f06d8cb-f5dc-412a-988c-d0f7acc03acf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:32:56.713550 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:56.713550 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:56.713550 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:56.713550 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:56.713550 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:56.713550 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:56.713550 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:56.713550 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:56.713550 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:56.713550 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:56.713550 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:56.713550 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:32:56.713550 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:32:56.713550 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:32:56.713550 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:32:56.714579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:32:56.714579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:32:56.714579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:32:56.714579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:32:56.714579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:56.714579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:56.714579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:56.714579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:56.714579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:56.714579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:56.714579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:56.714579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:56.714579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:56.714579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:56.714579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:56.714579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:56.715483 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:56.715483 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:56.715483 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:56.715483 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:56.715483 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:32:56.715483 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:32:56.715483 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:32:56.715483 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:32:56.715483 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:32:56.715483 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:32:56.715483 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:32:56.715483 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:56.719710 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 341/682] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 8 17:32:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:56.720548 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06d8cb-f5dc-412a-988c-d0f7acc03acf None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:56.747906 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549583eb-45d5-4ea5-a817-4856eb353e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:56.748484 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549583eb-45d5-4ea5-a817-4856eb353e15 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:56.748716 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549583eb-45d5-4ea5-a817-4856eb353e15 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:56.748989 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549583eb-45d5-4ea5-a817-4856eb353e15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:56.749742 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549583eb-45d5-4ea5-a817-4856eb353e15 None admin] RBAC: Adding query filter params (role.id=6d5d281c40dd4e69803141f48615b386, scope.project.id=047a28b7cd11486da9d330723a384812, user.id=44340c24b5784b58b829e2faa62ac58a) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:56.750112 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549583eb-45d5-4ea5-a817-4856eb353e15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:56.751568 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549583eb-45d5-4ea5-a817-4856eb353e15 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:56.765093 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 342/683] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:32:56 2022] GET /identity/v3/role_assignments?user.id=44340c24b5784b58b829e2faa62ac58a&scope.project.id=047a28b7cd11486da9d330723a384812&role.id=6d5d281c40dd4e69803141f48615b386 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:56.765093 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549583eb-45d5-4ea5-a817-4856eb353e15 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:56.792359 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:56.858411 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06d8cb-f5dc-412a-988c-d0f7acc03acf None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:56.898424 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8ddec-6f76-4fe6-a826-35b01d839eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:56.899073 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8ddec-6f76-4fe6-a826-35b01d839eba None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:56.899351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8ddec-6f76-4fe6-a826-35b01d839eba None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:56.899620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8ddec-6f76-4fe6-a826-35b01d839eba None admin] PATH_INFO: `/v3/users/swift` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:56.906342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549583eb-45d5-4ea5-a817-4856eb353e15 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:56.910977 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8ddec-6f76-4fe6-a826-35b01d839eba None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:56.912451 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8ddec-6f76-4fe6-a826-35b01d839eba None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:56.918103 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:56.927419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-6fc8ddec-6f76-4fe6-a826-35b01d839eba None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 08 17:32:56.927419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:56.927419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:56.927419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:56.927419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:56.927419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:56.927419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:56.927419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:56.927419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:56.927419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:56.927419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:56.927419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:56.927419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:32:56.927419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:32:56.927419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:32:56.927419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:32:56.929981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:56.929981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:56.929981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:32:56.929981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:32:56.929981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:32:56.929981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:32:56.929981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:56.929981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:56.929981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:56.929981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:56.929981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:56.929981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:56.929981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:56.929981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:56.929981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:56.929981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:56.929981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:56.929981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:56.930982 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:56.930982 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:56.930982 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:32:56.930982 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:32:56.930982 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:32:56.930982 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:32:56.930982 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:32:56.930982 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:32:56.930982 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 08 17:32:56.930982 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:56.930982 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 342/684] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 8 17:32:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:56.930982 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8ddec-6f76-4fe6-a826-35b01d839eba None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:56.952748 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21dbcb-aded-4e23-8f25-2be4af129aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:56.953417 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21dbcb-aded-4e23-8f25-2be4af129aa4 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:56.953701 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21dbcb-aded-4e23-8f25-2be4af129aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:56.953978 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21dbcb-aded-4e23-8f25-2be4af129aa4 None admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:56.954680 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e21dbcb-aded-4e23-8f25-2be4af129aa4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:56.954987 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e21dbcb-aded-4e23-8f25-2be4af129aa4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:56.956426 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e21dbcb-aded-4e23-8f25-2be4af129aa4 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:56.970657 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 343/685] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 8 17:32:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:56.971512 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21dbcb-aded-4e23-8f25-2be4af129aa4 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:57.042791 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8ddec-6f76-4fe6-a826-35b01d839eba None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:57.054168 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:57.076533 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21dbcb-aded-4e23-8f25-2be4af129aa4 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:57.078782 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b0638-9dd8-4609-a446-a9fd3e28e80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:57.079387 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b0638-9dd8-4609-a446-a9fd3e28e80d None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:57.079667 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b0638-9dd8-4609-a446-a9fd3e28e80d None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:57.079937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b0638-9dd8-4609-a446-a9fd3e28e80d None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:57.080605 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b0638-9dd8-4609-a446-a9fd3e28e80d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:57.080907 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b0638-9dd8-4609-a446-a9fd3e28e80d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:57.082899 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b0638-9dd8-4609-a446-a9fd3e28e80d None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:57.097388 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 343/686] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:32:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:57.098318 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b0638-9dd8-4609-a446-a9fd3e28e80d None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:57.115182 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9dd2d-e4b4-4f26-ae12-d983e99a9cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:57.115806 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9dd2d-e4b4-4f26-ae12-d983e99a9cd3 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:57.116087 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9dd2d-e4b4-4f26-ae12-d983e99a9cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:57.116361 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9dd2d-e4b4-4f26-ae12-d983e99a9cd3 None admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:57.117114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9dd2d-e4b4-4f26-ae12-d983e99a9cd3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:57.117424 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9dd2d-e4b4-4f26-ae12-d983e99a9cd3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:57.118897 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9dd2d-e4b4-4f26-ae12-d983e99a9cd3 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:57.137942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 344/687] 10.222.0.70 () {56 vars in 1135 bytes} [Mon Aug 8 17:32:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:57.138809 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9dd2d-e4b4-4f26-ae12-d983e99a9cd3 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:57.167298 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:57.204151 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b0638-9dd8-4609-a446-a9fd3e28e80d None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:57.241009 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18a9d5-72b4-425d-ad5a-206d146702ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:57.241646 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18a9d5-72b4-425d-ad5a-206d146702ea None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:57.241926 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18a9d5-72b4-425d-ad5a-206d146702ea None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:57.242197 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18a9d5-72b4-425d-ad5a-206d146702ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:57.242916 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18a9d5-72b4-425d-ad5a-206d146702ea None admin] RBAC: Adding query filter params (role.id=6d5d281c40dd4e69803141f48615b386, scope.project.id=047a28b7cd11486da9d330723a384812, user.id=bdb6f0f0cde24b05a34b78d48dc45c0d) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:57.243225 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18a9d5-72b4-425d-ad5a-206d146702ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:57.244721 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18a9d5-72b4-425d-ad5a-206d146702ea None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:57.246934 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9dd2d-e4b4-4f26-ae12-d983e99a9cd3 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:57.257191 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 344/688] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:32:57 2022] GET /identity/v3/role_assignments?user.id=bdb6f0f0cde24b05a34b78d48dc45c0d&scope.project.id=047a28b7cd11486da9d330723a384812&role.id=6d5d281c40dd4e69803141f48615b386 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:57.258193 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18a9d5-72b4-425d-ad5a-206d146702ea None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:57.286944 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093866b-b431-463c-a2e8-7d5afb839b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:57.287846 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093866b-b431-463c-a2e8-7d5afb839b7e None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:57.288313 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093866b-b431-463c-a2e8-7d5afb839b7e None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:57.288738 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093866b-b431-463c-a2e8-7d5afb839b7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:57.300202 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093866b-b431-463c-a2e8-7d5afb839b7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:57.301992 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093866b-b431-463c-a2e8-7d5afb839b7e None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:57.319253 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-e093866b-b431-463c-a2e8-7d5afb839b7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:57.319253 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:57.319253 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:57.319253 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:57.319253 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:57.319253 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:57.319253 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:57.319253 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:57.319253 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:57.319253 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:57.319253 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:57.319253 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:57.319253 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:57.319253 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:57.319253 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:57.319253 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:57.320497 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:57.320497 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:57.320497 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:57.320497 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:57.320497 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:57.320497 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:57.320497 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:57.320497 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:57.320497 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:57.320497 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:57.320497 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:57.320497 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:57.320497 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:57.320497 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:57.320497 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:57.320497 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:57.320497 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:57.321637 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:57.321637 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:57.321637 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:57.323412 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 345/689] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:57.329166 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093866b-b431-463c-a2e8-7d5afb839b7e None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:57.329301 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:57.427537 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18a9d5-72b4-425d-ad5a-206d146702ea None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:57.439705 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:57.468596 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093866b-b431-463c-a2e8-7d5afb839b7e None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:57.479246 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8098d-5a85-4645-bbc5-b6cd885ea68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:57.479872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8098d-5a85-4645-bbc5-b6cd885ea68f None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:57.480151 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8098d-5a85-4645-bbc5-b6cd885ea68f None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:57.480421 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8098d-5a85-4645-bbc5-b6cd885ea68f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:57.509488 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f170c-849c-4e4a-9e63-64b1df6aa160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:57.510438 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f170c-849c-4e4a-9e63-64b1df6aa160 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:57.510943 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f170c-849c-4e4a-9e63-64b1df6aa160 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:57.511480 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f170c-849c-4e4a-9e63-64b1df6aa160 None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:57.512449 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f170c-849c-4e4a-9e63-64b1df6aa160 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:57.512990 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f170c-849c-4e4a-9e63-64b1df6aa160 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:57.514620 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f170c-849c-4e4a-9e63-64b1df6aa160 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:57.527857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 346/690] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:32:57.530173 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a47bc-c44b-4fc2-8b6c-1bff7dc63c27 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:57.530459 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a47bc-c44b-4fc2-8b6c-1bff7dc63c27 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:57.530731 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a47bc-c44b-4fc2-8b6c-1bff7dc63c27 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:57.532478 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 347/691] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:57.535364 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a47bc-c44b-4fc2-8b6c-1bff7dc63c27 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:57.564146 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea8098d-5a85-4645-bbc5-b6cd885ea68f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:57.567075 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea8098d-5a85-4645-bbc5-b6cd885ea68f None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:57.606728 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:57.673847 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a47bc-c44b-4fc2-8b6c-1bff7dc63c27 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:57.701114 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 345/692] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:32:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:32:57.702728 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5bec02-e84b-47e3-ad82-21cd5117376f None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:57.703206 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5bec02-e84b-47e3-ad82-21cd5117376f None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:57.703708 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5bec02-e84b-47e3-ad82-21cd5117376f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:57.721965 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-eb5bec02-e84b-47e3-ad82-21cd5117376f None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:57.723495 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-eb5bec02-e84b-47e3-ad82-21cd5117376f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:57.725752 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f515b453-ae76-4b4e-a746-111e4fca0372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:57.726304 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515b453-ae76-4b4e-a746-111e4fca0372 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:57.726581 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515b453-ae76-4b4e-a746-111e4fca0372 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:57.726858 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515b453-ae76-4b4e-a746-111e4fca0372 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:57.735029 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515b453-ae76-4b4e-a746-111e4fca0372 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:57.736607 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515b453-ae76-4b4e-a746-111e4fca0372 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:57.739615 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:57.751374 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-f515b453-ae76-4b4e-a746-111e4fca0372 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 17:32:57.751374 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:57.751374 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:57.751374 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:57.751374 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:57.751374 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:57.751374 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:57.751374 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:57.751374 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:57.751374 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:57.751374 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:57.751374 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:57.751374 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:32:57.751374 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:32:57.751374 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:32:57.751374 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:32:57.760927 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:57.760927 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:57.760927 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:32:57.760927 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:32:57.760927 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:32:57.760927 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:32:57.760927 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:57.760927 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:57.760927 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:57.760927 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:57.760927 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:57.760927 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:57.760927 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:57.760927 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:57.760927 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:57.760927 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:57.760927 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:57.760927 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:57.761983 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:57.761983 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:57.761983 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:32:57.761983 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:32:57.761983 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:32:57.761983 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:32:57.761983 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:32:57.761983 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:32:57.761983 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 17:32:57.761983 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:57.761983 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 348/693] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Aug 8 17:32:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:32:57.761983 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f515b453-ae76-4b4e-a746-111e4fca0372 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:57.805164 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 346/694] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:57.806369 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5bec02-e84b-47e3-ad82-21cd5117376f None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:57.869954 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f515b453-ae76-4b4e-a746-111e4fca0372 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:57.898706 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:57.908258 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c68fe-4a8a-41ca-af8f-3451dead2371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:57.908882 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c68fe-4a8a-41ca-af8f-3451dead2371 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:57.915388 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c68fe-4a8a-41ca-af8f-3451dead2371 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:57.915388 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c68fe-4a8a-41ca-af8f-3451dead2371 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:57.921913 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c68fe-4a8a-41ca-af8f-3451dead2371 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:57.923418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c68fe-4a8a-41ca-af8f-3451dead2371 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:57.940536 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-259c68fe-4a8a-41ca-af8f-3451dead2371 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:57.940536 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:57.940536 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:57.940536 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:57.940536 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:57.940536 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:57.940536 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:57.940536 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:57.940536 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:57.940536 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:57.940536 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:57.940536 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:57.940536 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:57.940536 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:57.940536 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:57.940536 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:57.941787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:57.941787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:57.941787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:57.941787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:57.941787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:57.941787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:57.941787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:57.941787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:57.941787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:57.941787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:57.941787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:57.941787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:57.941787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:57.941787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:57.941787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:57.941787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:57.941787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:57.942674 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:57.942674 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:57.942674 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:57.944848 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5bec02-e84b-47e3-ad82-21cd5117376f None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:57.947245 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 349/695] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:57.948137 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c68fe-4a8a-41ca-af8f-3451dead2371 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:58.002900 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc1c9d-817c-47c4-8a3f-62339a6e8c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:58.004938 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc1c9d-817c-47c4-8a3f-62339a6e8c43 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:58.005259 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc1c9d-817c-47c4-8a3f-62339a6e8c43 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:58.005528 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc1c9d-817c-47c4-8a3f-62339a6e8c43 None admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:58.006279 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc1c9d-817c-47c4-8a3f-62339a6e8c43 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:58.007074 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc1c9d-817c-47c4-8a3f-62339a6e8c43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:58.008986 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc1c9d-817c-47c4-8a3f-62339a6e8c43 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:58.016510 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:58.036612 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 347/696] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Aug 8 17:32:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:58.038053 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc1c9d-817c-47c4-8a3f-62339a6e8c43 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:58.082625 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c68fe-4a8a-41ca-af8f-3451dead2371 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:58.125967 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b627bf-a5a6-4d77-82b8-e622eb62c1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:58.126848 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b627bf-a5a6-4d77-82b8-e622eb62c1ba None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:58.127286 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b627bf-a5a6-4d77-82b8-e622eb62c1ba None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:58.127648 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b627bf-a5a6-4d77-82b8-e622eb62c1ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:58.140934 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b627bf-a5a6-4d77-82b8-e622eb62c1ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:58.142766 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b627bf-a5a6-4d77-82b8-e622eb62c1ba None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:58.158467 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-d6b627bf-a5a6-4d77-82b8-e622eb62c1ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:58.158467 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:58.158467 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:58.158467 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:58.158467 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:58.158467 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:58.158467 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:58.158467 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:58.158467 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:58.158467 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:58.158467 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:58.158467 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:58.158467 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:58.158467 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:58.158467 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:58.158467 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:58.159434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:58.159434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:58.159434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:58.159434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:58.159434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:58.159434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:58.159434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:58.159434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:58.159434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:58.159434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:58.159434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:58.159434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:58.159434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:58.159434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:58.159434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:58.159434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:58.159434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:58.160906 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:58.160906 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:58.160906 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:58.160906 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 350/697] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:58.162516 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b627bf-a5a6-4d77-82b8-e622eb62c1ba None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:58.168535 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc1c9d-817c-47c4-8a3f-62339a6e8c43 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:58.205322 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:58.222255 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3d62d-73c0-4c02-b987-fc367e73a3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:58.223130 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3d62d-73c0-4c02-b987-fc367e73a3cc None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:58.223596 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3d62d-73c0-4c02-b987-fc367e73a3cc None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:58.224052 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3d62d-73c0-4c02-b987-fc367e73a3cc None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:58.225745 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3d62d-73c0-4c02-b987-fc367e73a3cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:58.226235 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3d62d-73c0-4c02-b987-fc367e73a3cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:58.229744 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3d62d-73c0-4c02-b987-fc367e73a3cc None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:58.251210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 348/698] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:58.251210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3d62d-73c0-4c02-b987-fc367e73a3cc None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:58.288152 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b627bf-a5a6-4d77-82b8-e622eb62c1ba None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:58.291424 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:58.336927 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600ca99-d1a5-47f8-bee0-1bc73f31935a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:58.337933 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600ca99-d1a5-47f8-bee0-1bc73f31935a None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:58.338825 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600ca99-d1a5-47f8-bee0-1bc73f31935a None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:58.339350 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600ca99-d1a5-47f8-bee0-1bc73f31935a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:58.373184 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3d62d-73c0-4c02-b987-fc367e73a3cc None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:58.418191 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3afa2a2-23fe-48ee-9816-bb0803eabde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:58.418912 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afa2a2-23fe-48ee-9816-bb0803eabde8 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:58.419288 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afa2a2-23fe-48ee-9816-bb0803eabde8 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:58.419663 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afa2a2-23fe-48ee-9816-bb0803eabde8 None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:58.420407 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3afa2a2-23fe-48ee-9816-bb0803eabde8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:58.420924 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3afa2a2-23fe-48ee-9816-bb0803eabde8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:58.422357 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3afa2a2-23fe-48ee-9816-bb0803eabde8 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:58.429136 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600ca99-d1a5-47f8-bee0-1bc73f31935a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:58.431266 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600ca99-d1a5-47f8-bee0-1bc73f31935a None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:58.437464 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 349/699] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:58.437864 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3afa2a2-23fe-48ee-9816-bb0803eabde8 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:58.486275 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:58.556046 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 351/700] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:32:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:32:58.556914 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600ca99-d1a5-47f8-bee0-1bc73f31935a None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:58.559614 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:58.567703 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3afa2a2-23fe-48ee-9816-bb0803eabde8 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:58.615192 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1b65f-fd1b-4e98-b7fc-12f8e36f82a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:58.616252 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1b65f-fd1b-4e98-b7fc-12f8e36f82a2 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:58.616696 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1b65f-fd1b-4e98-b7fc-12f8e36f82a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:58.617479 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1b65f-fd1b-4e98-b7fc-12f8e36f82a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:58.626377 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e1b65f-fd1b-4e98-b7fc-12f8e36f82a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:58.627824 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e1b65f-fd1b-4e98-b7fc-12f8e36f82a2 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:58.639333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-d1e1b65f-fd1b-4e98-b7fc-12f8e36f82a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:32:58.639333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:58.639333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:58.639333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:58.639333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:58.639333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:58.639333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:58.639333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:58.639333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:58.639333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:58.639333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:58.639333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:58.639333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:32:58.639333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:32:58.639333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:32:58.640472 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:32:58.640472 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:58.640472 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:58.640472 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:58.640472 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:58.640472 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:58.640472 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:58.640472 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:58.640472 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:58.640472 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:58.640472 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:58.640472 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:58.640472 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:58.640472 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:58.640472 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:58.640472 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:58.640472 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:58.641668 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:32:58.641668 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:32:58.641668 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:32:58.641668 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:32:58.641668 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:32:58.641668 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:32:58.641668 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:32:58.641668 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:58.641668 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 350/701] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:32:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:58.642183 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1b65f-fd1b-4e98-b7fc-12f8e36f82a2 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:58.680420 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600ca99-d1a5-47f8-bee0-1bc73f31935a None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:58.727305 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8672a-7f87-4442-97c7-47a21ca3b4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:58.728616 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8672a-7f87-4442-97c7-47a21ca3b4a1 None admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:58.729354 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8672a-7f87-4442-97c7-47a21ca3b4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:58.729929 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8672a-7f87-4442-97c7-47a21ca3b4a1 None admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:58.730955 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8672a-7f87-4442-97c7-47a21ca3b4a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:58.732889 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8672a-7f87-4442-97c7-47a21ca3b4a1 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:58.753141 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1b65f-fd1b-4e98-b7fc-12f8e36f82a2 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:58.756608 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:58.787429 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6904f11-8506-4225-8e31-07fbe8857fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:58.788057 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6904f11-8506-4225-8e31-07fbe8857fd3 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:58.788334 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6904f11-8506-4225-8e31-07fbe8857fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:58.788659 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6904f11-8506-4225-8e31-07fbe8857fd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:58.798533 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6904f11-8506-4225-8e31-07fbe8857fd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:58.799962 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6904f11-8506-4225-8e31-07fbe8857fd3 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:58.814373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-d6904f11-8506-4225-8e31-07fbe8857fd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:58.814373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:58.814373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:58.814373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:58.814373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:58.814373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:58.814373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:58.814373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:58.814373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:58.814373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:58.814373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:58.814373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:58.814373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:32:58.814373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:32:58.814373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:32:58.814373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:32:58.815310 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:58.815310 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:58.815310 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:58.815310 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:58.815310 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:58.815310 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:58.815310 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:58.815310 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:58.815310 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:58.815310 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:58.815310 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:58.815310 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:58.815310 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:58.815310 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:58.815310 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:58.815310 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:58.815310 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:32:58.817293 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:32:58.817293 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:32:58.817293 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:58.817293 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 351/702] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:32:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:58.817293 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6904f11-8506-4225-8e31-07fbe8857fd3 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:58.828503 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 352/703] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Aug 8 17:32:58 2022] POST /identity/v3/users => generated 254 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:32:58.832986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8672a-7f87-4442-97c7-47a21ca3b4a1 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:58.952399 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:58.992850 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6904f11-8506-4225-8e31-07fbe8857fd3 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:59.002502 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8672a-7f87-4442-97c7-47a21ca3b4a1 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:59.033680 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65173b5b-9b45-4758-8059-267b9a6f53f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:59.034293 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65173b5b-9b45-4758-8059-267b9a6f53f5 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:59.035178 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65173b5b-9b45-4758-8059-267b9a6f53f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:59.035506 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65173b5b-9b45-4758-8059-267b9a6f53f5 None admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:59.036311 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65173b5b-9b45-4758-8059-267b9a6f53f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:59.036615 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65173b5b-9b45-4758-8059-267b9a6f53f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:59.038568 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65173b5b-9b45-4758-8059-267b9a6f53f5 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:59.046296 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f31c27-e55f-41d9-877c-6a7f3a44ced8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:59.046923 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f31c27-e55f-41d9-877c-6a7f3a44ced8 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:59.047207 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f31c27-e55f-41d9-877c-6a7f3a44ced8 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:59.047881 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f31c27-e55f-41d9-877c-6a7f3a44ced8 None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:59.048168 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f31c27-e55f-41d9-877c-6a7f3a44ced8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:59.049070 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f31c27-e55f-41d9-877c-6a7f3a44ced8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:59.050381 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f31c27-e55f-41d9-877c-6a7f3a44ced8 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:59.053984 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 352/704] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 8 17:32:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:59.054978 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44062f6a-560a-4aba-bd60-a9296bacc97f None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:59.055268 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44062f6a-560a-4aba-bd60-a9296bacc97f None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:59.055543 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44062f6a-560a-4aba-bd60-a9296bacc97f None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:59.056890 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 353/705] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:59.061538 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44062f6a-560a-4aba-bd60-a9296bacc97f None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:59.065616 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 353/706] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:59.067722 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf5c76-09bb-4bc0-86b8-d436f6b6fbb6 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:59.068005 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf5c76-09bb-4bc0-86b8-d436f6b6fbb6 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:59.068270 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf5c76-09bb-4bc0-86b8-d436f6b6fbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:59.089777 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-6eaf5c76-09bb-4bc0-86b8-d436f6b6fbb6 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:59.090415 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:59.091350 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-6eaf5c76-09bb-4bc0-86b8-d436f6b6fbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:59.166606 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 354/707] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:32:59.167469 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf5c76-09bb-4bc0-86b8-d436f6b6fbb6 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:59.207563 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44062f6a-560a-4aba-bd60-a9296bacc97f None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:59.251382 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d57de-afc6-4fa0-81ed-3324793ff2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:59.251995 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d57de-afc6-4fa0-81ed-3324793ff2c8 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:59.252274 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d57de-afc6-4fa0-81ed-3324793ff2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:59.253061 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d57de-afc6-4fa0-81ed-3324793ff2c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:59.253872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d57de-afc6-4fa0-81ed-3324793ff2c8 None admin] RBAC: Adding query filter params (role.id=6d5d281c40dd4e69803141f48615b386, scope.project.id=047a28b7cd11486da9d330723a384812, user.id=67b83ff95ed44f35af2e412a700ca567) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:59.254185 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d57de-afc6-4fa0-81ed-3324793ff2c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:59.254672 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:59.256001 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d57de-afc6-4fa0-81ed-3324793ff2c8 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:59.263532 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 354/708] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:32:59 2022] GET /identity/v3/role_assignments?user.id=67b83ff95ed44f35af2e412a700ca567&scope.project.id=047a28b7cd11486da9d330723a384812&role.id=6d5d281c40dd4e69803141f48615b386 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:59.264859 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d57de-afc6-4fa0-81ed-3324793ff2c8 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:59.303897 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf5c76-09bb-4bc0-86b8-d436f6b6fbb6 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:59.348657 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018feda-e89b-4c61-82dc-3d6cb8f4125f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:59.349568 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018feda-e89b-4c61-82dc-3d6cb8f4125f None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:59.349977 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018feda-e89b-4c61-82dc-3d6cb8f4125f None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:59.350379 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018feda-e89b-4c61-82dc-3d6cb8f4125f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:59.357769 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a018feda-e89b-4c61-82dc-3d6cb8f4125f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:59.359526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a018feda-e89b-4c61-82dc-3d6cb8f4125f None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:59.367788 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:59.373063 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-a018feda-e89b-4c61-82dc-3d6cb8f4125f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:32:59.373063 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:59.373063 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:59.373063 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:59.373063 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:59.373063 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:59.373063 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:59.373063 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:59.373063 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:59.373063 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:59.373063 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:59.373063 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:59.373063 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:32:59.373063 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:32:59.373063 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:32:59.374443 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:32:59.374443 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:59.374443 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:59.374443 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:59.374443 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:59.374443 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:59.374443 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:59.374443 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:59.374443 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:59.374443 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:59.374443 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:59.374443 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:59.374443 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:59.374443 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:59.374443 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:59.374443 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:59.374443 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:59.375537 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:32:59.375537 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:32:59.375537 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:32:59.375537 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:32:59.375537 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:32:59.375537 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:32:59.375537 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:32:59.375537 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:32:59.377767 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 355/709] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:32:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:59.384328 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018feda-e89b-4c61-82dc-3d6cb8f4125f None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:59.417432 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d57de-afc6-4fa0-81ed-3324793ff2c8 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:59.479640 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c9cad-a1ff-4438-9978-fc6c2e2e2d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:59.480610 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c9cad-a1ff-4438-9978-fc6c2e2e2d93 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:59.480983 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c9cad-a1ff-4438-9978-fc6c2e2e2d93 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:59.481377 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c9cad-a1ff-4438-9978-fc6c2e2e2d93 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:59.482304 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c9cad-a1ff-4438-9978-fc6c2e2e2d93 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:59.484614 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c9cad-a1ff-4438-9978-fc6c2e2e2d93 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:59.500438 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-533c9cad-a1ff-4438-9978-fc6c2e2e2d93 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 17:32:59.500438 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:59.500438 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 17:32:59.500438 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 17:32:59.500438 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 17:32:59.500438 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 17:32:59.500438 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 17:32:59.500438 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:32:59.500438 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 17:32:59.500438 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:59.500438 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 17:32:59.500438 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:59.500438 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:32:59.500438 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:32:59.500438 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:32:59.500438 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:32:59.500438 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:32:59.501763 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:32:59.501763 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:32:59.501763 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:32:59.501763 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:32:59.501763 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:32:59.501763 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:32:59.501763 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 17:32:59.501763 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 17:32:59.501763 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 17:32:59.501763 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 17:32:59.501763 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:32:59.501763 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:32:59.501763 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:32:59.501763 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:32:59.501763 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:32:59.501763 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:32:59.502832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:32:59.502832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:32:59.502832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:32:59.502832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:32:59.502832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:32:59.502832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:32:59.502832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:32:59.502832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:32:59.502832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:32:59.502832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:32:59.502832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 17:32:59.502832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:32:59.502832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 17:32:59.502832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:32:59.502832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 355/710] 10.222.0.70 () {56 vars in 1129 bytes} [Mon Aug 8 17:32:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:32:59.507315 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c9cad-a1ff-4438-9978-fc6c2e2e2d93 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:59.539251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018feda-e89b-4c61-82dc-3d6cb8f4125f None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:59.550036 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:59.578569 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba847d1-f1f8-4f4b-a6fb-0d5784b8ad0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:59.579886 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba847d1-f1f8-4f4b-a6fb-0d5784b8ad0d None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:59.580347 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba847d1-f1f8-4f4b-a6fb-0d5784b8ad0d None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:59.581014 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba847d1-f1f8-4f4b-a6fb-0d5784b8ad0d None admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:59.582726 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba847d1-f1f8-4f4b-a6fb-0d5784b8ad0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:59.583185 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba847d1-f1f8-4f4b-a6fb-0d5784b8ad0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:59.586059 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba847d1-f1f8-4f4b-a6fb-0d5784b8ad0d None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:59.602914 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 356/711] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 8 17:32:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:32:59.609824 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba847d1-f1f8-4f4b-a6fb-0d5784b8ad0d None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:59.628267 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c9cad-a1ff-4438-9978-fc6c2e2e2d93 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:59.664069 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2da0c-d4dd-4868-9c1a-f931d9a9a9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:59.664851 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2da0c-d4dd-4868-9c1a-f931d9a9a9b5 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:59.665272 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2da0c-d4dd-4868-9c1a-f931d9a9a9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:59.665646 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2da0c-d4dd-4868-9c1a-f931d9a9a9b5 None admin] PATH_INFO: `/v3/services` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:59.666391 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2da0c-d4dd-4868-9c1a-f931d9a9a9b5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:59.666796 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2da0c-d4dd-4868-9c1a-f931d9a9a9b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:59.668261 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2da0c-d4dd-4868-9c1a-f931d9a9a9b5 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:59.673793 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 356/712] 10.222.0.70 () {56 vars in 1124 bytes} [Mon Aug 8 17:32:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:32:59.675707 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc177f3-c1fb-4547-8a57-ada32fe1df46 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:59.679826 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc177f3-c1fb-4547-8a57-ada32fe1df46 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:59.679826 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc177f3-c1fb-4547-8a57-ada32fe1df46 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:59.679826 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 357/713] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:32:59.683989 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78c7af-60b6-44fc-966d-41290b624f70 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:59.684346 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78c7af-60b6-44fc-966d-41290b624f70 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:59.684686 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78c7af-60b6-44fc-966d-41290b624f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:59.704372 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-ac78c7af-60b6-44fc-966d-41290b624f70 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:32:59.705652 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-ac78c7af-60b6-44fc-966d-41290b624f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:32:59.708060 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:59.728009 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba847d1-f1f8-4f4b-a6fb-0d5784b8ad0d None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:59.773094 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ec4eb-e6dc-4948-aacc-cb1faa15bf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:59.774066 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ec4eb-e6dc-4948-aacc-cb1faa15bf9c None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:59.774805 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ec4eb-e6dc-4948-aacc-cb1faa15bf9c None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:59.775232 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ec4eb-e6dc-4948-aacc-cb1faa15bf9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:59.776218 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ec4eb-e6dc-4948-aacc-cb1faa15bf9c None admin] RBAC: Adding query filter params (role.id=5c25aa917ab34baabb795c54dd8a4d02, scope.project.id=047a28b7cd11486da9d330723a384812, user.id=3973b8fbfbb9475896e4e110ca8aa615) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:59.776691 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ec4eb-e6dc-4948-aacc-cb1faa15bf9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:59.778296 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ec4eb-e6dc-4948-aacc-cb1faa15bf9c None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:59.788177 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 357/714] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:32:59 2022] GET /identity/v3/role_assignments?user.id=3973b8fbfbb9475896e4e110ca8aa615&scope.project.id=047a28b7cd11486da9d330723a384812&role.id=5c25aa917ab34baabb795c54dd8a4d02 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:32:59.789849 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ec4eb-e6dc-4948-aacc-cb1faa15bf9c None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:59.798331 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 358/715] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 17:32:59.827120 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:32:59.832602 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78c7af-60b6-44fc-966d-41290b624f70 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:32:59.910373 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ec4eb-e6dc-4948-aacc-cb1faa15bf9c None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:32:59.952413 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fe281-c9e7-4ba5-9079-5fd8fab6235c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:32:59.953422 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fe281-c9e7-4ba5-9079-5fd8fab6235c None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:32:59.953853 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fe281-c9e7-4ba5-9079-5fd8fab6235c None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:32:59.954270 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fe281-c9e7-4ba5-9079-5fd8fab6235c None admin] PATH_INFO: `/v3/services` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:32:59.955095 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4fe281-c9e7-4ba5-9079-5fd8fab6235c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:32:59.955546 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4fe281-c9e7-4ba5-9079-5fd8fab6235c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:32:59.957714 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4fe281-c9e7-4ba5-9079-5fd8fab6235c None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:32:59.965390 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 358/716] 10.222.0.70 () {56 vars in 1124 bytes} [Mon Aug 8 17:32:59 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:00.075162 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78c7af-60b6-44fc-966d-41290b624f70 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:00.130429 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55594de2-01a0-4a63-a125-95a01dad6ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:00.131077 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55594de2-01a0-4a63-a125-95a01dad6ec0 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:00.131445 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55594de2-01a0-4a63-a125-95a01dad6ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:00.131724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55594de2-01a0-4a63-a125-95a01dad6ec0 None admin] PATH_INFO: `/v3/services/network` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:00.132310 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55594de2-01a0-4a63-a125-95a01dad6ec0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:00.133812 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55594de2-01a0-4a63-a125-95a01dad6ec0 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:00.146813 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-55594de2-01a0-4a63-a125-95a01dad6ec0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 17:33:00.146813 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:00.146813 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 17:33:00.146813 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 17:33:00.146813 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 17:33:00.146813 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 17:33:00.146813 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 17:33:00.146813 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:00.146813 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 17:33:00.146813 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:00.146813 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 17:33:00.146813 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:00.146813 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:00.146813 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:00.146813 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:00.146813 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:00.146813 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:00.153731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:00.153731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:00.153731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:00.153731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:00.153731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:00.153731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:00.153731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 17:33:00.153731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 17:33:00.153731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 17:33:00.153731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 17:33:00.153731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:00.153731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:00.153731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:00.153731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:00.153731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:00.153731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:00.154636 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:00.154636 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:00.154636 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:00.154636 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:00.154636 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:00.154636 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:00.154636 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:00.154636 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:00.154636 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:00.154636 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:00.154636 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 17:33:00.154636 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:00.154636 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 17:33:00.154636 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:00.154636 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 359/717] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:32:59 2022] GET /identity/v3/services/network => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:00.157462 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fe281-c9e7-4ba5-9079-5fd8fab6235c None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:00.297511 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fe281-c9e7-4ba5-9079-5fd8fab6235c None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:00.301336 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:00.334889 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d95372-0862-47fb-a15b-c76fbb01f157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:00.335418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d95372-0862-47fb-a15b-c76fbb01f157 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:00.335695 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d95372-0862-47fb-a15b-c76fbb01f157 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:00.335963 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d95372-0862-47fb-a15b-c76fbb01f157 None admin] PATH_INFO: `/v3/services` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:00.336675 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d95372-0862-47fb-a15b-c76fbb01f157 None admin] RBAC: Adding query filter params (name=network) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:00.336980 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d95372-0862-47fb-a15b-c76fbb01f157 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:00.338380 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d95372-0862-47fb-a15b-c76fbb01f157 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:00.344893 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 359/718] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Aug 8 17:33:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:00.352906 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55594de2-01a0-4a63-a125-95a01dad6ec0 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:00.356725 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:00.483481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55594de2-01a0-4a63-a125-95a01dad6ec0 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:00.519627 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c67981-c9af-411d-85a5-960195c19fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:00.520585 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c67981-c9af-411d-85a5-960195c19fff None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:00.521140 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c67981-c9af-411d-85a5-960195c19fff None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:00.521632 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c67981-c9af-411d-85a5-960195c19fff None admin] PATH_INFO: `/v3/services` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:00.522476 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c67981-c9af-411d-85a5-960195c19fff None admin] RBAC: Adding query filter params (type=network) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:00.522981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c67981-c9af-411d-85a5-960195c19fff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:00.524565 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c67981-c9af-411d-85a5-960195c19fff None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:00.530699 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 360/719] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Aug 8 17:33:00 2022] GET /identity/v3/services?type=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:01.379038 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868aeae2-fc3b-4bb1-862b-acebb1bada27 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:01.379567 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868aeae2-fc3b-4bb1-862b-acebb1bada27 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:01.379567 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868aeae2-fc3b-4bb1-862b-acebb1bada27 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:01.381189 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 360/720] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:01.386262 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bc27e-6927-4826-bf4b-4c8ee2ae1e07 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:01.386664 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bc27e-6927-4826-bf4b-4c8ee2ae1e07 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:01.386853 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bc27e-6927-4826-bf4b-4c8ee2ae1e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:01.536708 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-462bc27e-6927-4826-bf4b-4c8ee2ae1e07 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:01.537928 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-462bc27e-6927-4826-bf4b-4c8ee2ae1e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:01.624202 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:01.632836 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 361/721] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:33:01.671995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868aeae2-fc3b-4bb1-862b-acebb1bada27 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:01.801938 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868aeae2-fc3b-4bb1-862b-acebb1bada27 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:01.837410 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230be9d-2ccf-49c1-8cf5-4656db9a32e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:01.838037 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230be9d-2ccf-49c1-8cf5-4656db9a32e1 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:01.838316 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230be9d-2ccf-49c1-8cf5-4656db9a32e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:01.838583 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230be9d-2ccf-49c1-8cf5-4656db9a32e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:01.849963 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230be9d-2ccf-49c1-8cf5-4656db9a32e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:33:01.855644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-2230be9d-2ccf-49c1-8cf5-4656db9a32e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:33:01.855644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:01.855644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:01.855644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:01.855644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:01.855644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:01.855644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:01.855644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:01.855644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:01.855644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:01.855644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:01.855644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:01.855644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:33:01.855644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:33:01.855644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:33:01.855644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:33:01.856604 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:33:01.856604 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:33:01.856604 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:33:01.856604 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:33:01.856604 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:01.856604 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:01.856604 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:01.856604 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:01.856604 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:01.856604 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:01.856604 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:01.856604 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:01.856604 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:01.856604 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:01.856604 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:01.856604 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:01.857513 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:01.857513 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:01.857513 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:01.857513 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:01.857513 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:33:01.857513 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:33:01.857513 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:33:01.857513 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:33:01.857513 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:33:01.857513 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:33:01.857513 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:33:01.857513 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:01.857513 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 361/722] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 8 17:33:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:01.864093 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462bc27e-6927-4826-bf4b-4c8ee2ae1e07 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:01.976430 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462bc27e-6927-4826-bf4b-4c8ee2ae1e07 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:02.012021 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe896cc-5e9a-4734-816e-dbe95f43c84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:02.012688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe896cc-5e9a-4734-816e-dbe95f43c84f None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:02.012967 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe896cc-5e9a-4734-816e-dbe95f43c84f None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:02.013263 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe896cc-5e9a-4734-816e-dbe95f43c84f None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:02.013924 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe896cc-5e9a-4734-816e-dbe95f43c84f None admin] RBAC: Adding query filter params (name=service) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:02.014218 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe896cc-5e9a-4734-816e-dbe95f43c84f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:02.015566 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe896cc-5e9a-4734-816e-dbe95f43c84f None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:02.028353 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 362/723] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 8 17:33:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:02.035850 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230be9d-2ccf-49c1-8cf5-4656db9a32e1 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:02.068500 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:02.181870 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230be9d-2ccf-49c1-8cf5-4656db9a32e1 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:02.218954 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd456c40-02a8-4fa1-8b88-9f3f721a9faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:02.219582 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd456c40-02a8-4fa1-8b88-9f3f721a9faf None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:02.219858 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd456c40-02a8-4fa1-8b88-9f3f721a9faf None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:02.220124 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd456c40-02a8-4fa1-8b88-9f3f721a9faf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:02.232486 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd456c40-02a8-4fa1-8b88-9f3f721a9faf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:02.234141 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd456c40-02a8-4fa1-8b88-9f3f721a9faf None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:02.250459 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-cd456c40-02a8-4fa1-8b88-9f3f721a9faf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:02.250459 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:02.250459 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:02.250459 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:02.250459 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:02.250459 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:02.250459 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:02.250459 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:02.250459 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:02.250459 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:02.250459 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:02.250459 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:02.250459 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:33:02.250459 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:33:02.250459 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:33:02.250459 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:33:02.251453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:02.251453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:02.251453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:02.251453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:02.251453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:02.251453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:02.251453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:02.251453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:02.251453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:02.251453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:02.251453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:02.251453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:02.251453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:02.251453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:02.251453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:02.251453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:02.251453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:33:02.252450 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:33:02.252450 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:02.252450 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:02.252450 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 362/724] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:02.252692 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3dbbc-b46a-4e36-8762-8815038ddd34 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:02.252692 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3dbbc-b46a-4e36-8762-8815038ddd34 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:02.252825 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3dbbc-b46a-4e36-8762-8815038ddd34 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:02.257065 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 363/725] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:02.259002 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd456c40-02a8-4fa1-8b88-9f3f721a9faf None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:02.260854 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5405fea-6daf-47b3-a0ea-ea9a1b064c3e None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:02.261168 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5405fea-6daf-47b3-a0ea-ea9a1b064c3e None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:02.261448 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5405fea-6daf-47b3-a0ea-ea9a1b064c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:02.281808 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-d5405fea-6daf-47b3-a0ea-ea9a1b064c3e None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:02.283169 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-d5405fea-6daf-47b3-a0ea-ea9a1b064c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:02.334634 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:02.366140 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd456c40-02a8-4fa1-8b88-9f3f721a9faf None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:02.367389 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:02.371002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 364/726] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:33:02.378931 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab75e7-18cf-48de-ba1e-f675b7c080cf None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:02.379275 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab75e7-18cf-48de-ba1e-f675b7c080cf None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:02.379555 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab75e7-18cf-48de-ba1e-f675b7c080cf None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:02.381002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 365/727] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:02.386747 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331db5df-fea4-4551-af9e-bbacd1b65703 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:02.387621 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331db5df-fea4-4551-af9e-bbacd1b65703 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:02.388073 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331db5df-fea4-4551-af9e-bbacd1b65703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:02.413186 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054adac-5709-48dd-a51f-2b82f2923e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:02.413590 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054adac-5709-48dd-a51f-2b82f2923e7b None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:02.413868 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054adac-5709-48dd-a51f-2b82f2923e7b None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:02.414211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054adac-5709-48dd-a51f-2b82f2923e7b None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:02.416022 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f054adac-5709-48dd-a51f-2b82f2923e7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:02.416022 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f054adac-5709-48dd-a51f-2b82f2923e7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:02.416710 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f054adac-5709-48dd-a51f-2b82f2923e7b None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:02.432088 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 363/728] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:02.433024 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054adac-5709-48dd-a51f-2b82f2923e7b None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:02.433403 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-331db5df-fea4-4551-af9e-bbacd1b65703 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:02.434911 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-331db5df-fea4-4551-af9e-bbacd1b65703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:02.522109 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 366/729] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 17:33:02.523286 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331db5df-fea4-4551-af9e-bbacd1b65703 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:02.585858 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054adac-5709-48dd-a51f-2b82f2923e7b None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:02.652417 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331db5df-fea4-4551-af9e-bbacd1b65703 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:02.672222 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:02.691597 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b683ff-4a38-4a60-a935-afa820cf6796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:02.692259 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b683ff-4a38-4a60-a935-afa820cf6796 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:02.692537 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b683ff-4a38-4a60-a935-afa820cf6796 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:02.692810 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b683ff-4a38-4a60-a935-afa820cf6796 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:02.700840 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b683ff-4a38-4a60-a935-afa820cf6796 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:02.702321 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b683ff-4a38-4a60-a935-afa820cf6796 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:02.715971 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-09b683ff-4a38-4a60-a935-afa820cf6796 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 17:33:02.715971 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:02.715971 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:02.715971 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:02.715971 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:02.715971 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:02.715971 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:02.715971 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:02.715971 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:02.715971 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:02.715971 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:02.715971 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:02.715971 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:33:02.715971 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:33:02.715971 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:33:02.715971 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:33:02.717062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:02.717062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:02.717062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:33:02.717062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:33:02.717062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:33:02.717062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:33:02.717062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:02.717062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:02.717062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:02.717062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:02.717062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:02.717062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:02.717062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:02.717062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:02.717062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:02.717062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:02.717062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:02.717062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:02.718035 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:02.718035 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:02.718035 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:33:02.718035 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:33:02.718035 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:33:02.718035 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:33:02.718035 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:33:02.718035 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:33:02.718035 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 17:33:02.718035 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:02.718035 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 367/730] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Aug 8 17:33:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:02.718035 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b683ff-4a38-4a60-a935-afa820cf6796 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:02.753207 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:02.760487 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9edb39-4227-45c7-85ea-9a2a140753dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:02.761633 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9edb39-4227-45c7-85ea-9a2a140753dd None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:02.762098 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9edb39-4227-45c7-85ea-9a2a140753dd None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:02.762558 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9edb39-4227-45c7-85ea-9a2a140753dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:02.779327 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9edb39-4227-45c7-85ea-9a2a140753dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:33:02.788499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-0d9edb39-4227-45c7-85ea-9a2a140753dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:33:02.788499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:02.788499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:02.788499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:02.788499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:02.788499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:02.788499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:02.788499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:02.788499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:02.788499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:02.788499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:02.788499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:02.788499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:33:02.788499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:33:02.788499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:33:02.788499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:33:02.789507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:33:02.789507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:33:02.789507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:33:02.789507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:33:02.789507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:02.789507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:02.789507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:02.789507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:02.789507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:02.789507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:02.789507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:02.789507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:02.789507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:02.789507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:02.789507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:02.789507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:02.790363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:02.790363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:02.790363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:02.790363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:02.790363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:33:02.790363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:33:02.790363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:33:02.790363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:33:02.790363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:33:02.790363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:33:02.790363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:33:02.790363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:02.790363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 364/731] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 8 17:33:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:02.791874 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73b13f-faa1-4304-af12-404e2269d375 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:02.792358 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73b13f-faa1-4304-af12-404e2269d375 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:02.792828 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73b13f-faa1-4304-af12-404e2269d375 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:02.799342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 365/732] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:02.799342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f73b13f-faa1-4304-af12-404e2269d375 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:02.867255 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b683ff-4a38-4a60-a935-afa820cf6796 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:02.902445 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cfe913-4162-4de1-bd31-e756f0dd10ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:02.903201 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cfe913-4162-4de1-bd31-e756f0dd10ba None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:02.903476 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cfe913-4162-4de1-bd31-e756f0dd10ba None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:02.903740 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cfe913-4162-4de1-bd31-e756f0dd10ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:02.914802 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f73b13f-faa1-4304-af12-404e2269d375 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:02.915787 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cfe913-4162-4de1-bd31-e756f0dd10ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:33:02.922241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-77cfe913-4162-4de1-bd31-e756f0dd10ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:33:02.922241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:02.922241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:02.922241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:02.922241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:02.922241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:02.922241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:02.922241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:02.922241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:02.922241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:02.922241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:02.922241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:02.922241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:33:02.922241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:33:02.922241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:33:02.922241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:33:02.923180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:33:02.923180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:33:02.923180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:33:02.923180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:33:02.923180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:02.923180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:02.923180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:02.923180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:02.923180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:02.923180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:02.923180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:02.923180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:02.923180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:02.923180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:02.923180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:02.923180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:02.924046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:02.924046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:02.924046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:02.924046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:02.924046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:33:02.924046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:33:02.924046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:33:02.924046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:33:02.924046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:33:02.924046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:33:02.924046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:33:02.924046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:02.928903 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 368/733] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 8 17:33:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:02.929540 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cfe913-4162-4de1-bd31-e756f0dd10ba None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:02.951473 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e79236-f0e8-4086-a0ca-a71ddbc528fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:02.952226 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e79236-f0e8-4086-a0ca-a71ddbc528fd None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:02.952602 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e79236-f0e8-4086-a0ca-a71ddbc528fd None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:02.952967 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e79236-f0e8-4086-a0ca-a71ddbc528fd None admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:02.954190 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e79236-f0e8-4086-a0ca-a71ddbc528fd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:02.954501 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e79236-f0e8-4086-a0ca-a71ddbc528fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:02.956665 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e79236-f0e8-4086-a0ca-a71ddbc528fd None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:02.973541 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:02.975495 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 366/734] 10.222.0.70 () {56 vars in 1149 bytes} [Mon Aug 8 17:33:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:02.977200 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20c388-f8b6-4674-9c15-5c04abe3f6af None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:02.977492 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20c388-f8b6-4674-9c15-5c04abe3f6af None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:02.977767 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20c388-f8b6-4674-9c15-5c04abe3f6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:02.996582 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-4c20c388-f8b6-4674-9c15-5c04abe3f6af None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:02.997938 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-4c20c388-f8b6-4674-9c15-5c04abe3f6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:03.042936 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cfe913-4162-4de1-bd31-e756f0dd10ba None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:03.047823 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:03.070768 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 367/735] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:33:03.071923 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20c388-f8b6-4674-9c15-5c04abe3f6af None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:03.086100 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213900d4-d64f-4cf7-ae38-b327ee8bd34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:03.087085 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213900d4-d64f-4cf7-ae38-b327ee8bd34a None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:03.087772 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213900d4-d64f-4cf7-ae38-b327ee8bd34a None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:03.088336 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213900d4-d64f-4cf7-ae38-b327ee8bd34a None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:03.089687 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213900d4-d64f-4cf7-ae38-b327ee8bd34a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:03.090190 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213900d4-d64f-4cf7-ae38-b327ee8bd34a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:03.091570 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213900d4-d64f-4cf7-ae38-b327ee8bd34a None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:03.100688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 369/736] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:33:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:03.103979 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213900d4-d64f-4cf7-ae38-b327ee8bd34a None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:03.178430 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20c388-f8b6-4674-9c15-5c04abe3f6af None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:03.198415 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:03.201194 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213900d4-d64f-4cf7-ae38-b327ee8bd34a None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:03.212654 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c609b16-9a80-4733-89dc-9a84348d95ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:03.213258 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c609b16-9a80-4733-89dc-9a84348d95ee None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:03.213545 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c609b16-9a80-4733-89dc-9a84348d95ee None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:03.213820 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c609b16-9a80-4733-89dc-9a84348d95ee None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:03.214480 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c609b16-9a80-4733-89dc-9a84348d95ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:03.214785 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c609b16-9a80-4733-89dc-9a84348d95ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:03.216151 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c609b16-9a80-4733-89dc-9a84348d95ee None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:03.224631 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 368/737] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:33:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:03.225828 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb039ff-ab51-4c04-a0fb-72a121b5d0ca None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:03.226114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb039ff-ab51-4c04-a0fb-72a121b5d0ca None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:03.226425 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb039ff-ab51-4c04-a0fb-72a121b5d0ca None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:03.231634 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 369/738] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:03.232376 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb039ff-ab51-4c04-a0fb-72a121b5d0ca None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:03.235825 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f75526-b36e-4524-8fbe-ba5d857b1616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:03.236435 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f75526-b36e-4524-8fbe-ba5d857b1616 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:03.236719 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f75526-b36e-4524-8fbe-ba5d857b1616 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:03.236993 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f75526-b36e-4524-8fbe-ba5d857b1616 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:03.275460 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:03.303805 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f75526-b36e-4524-8fbe-ba5d857b1616 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:03.305317 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f75526-b36e-4524-8fbe-ba5d857b1616 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:03.333049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb039ff-ab51-4c04-a0fb-72a121b5d0ca None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:03.366880 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4f7e9-6d4f-4ba4-8237-cb6b8f30cb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:03.367478 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4f7e9-6d4f-4ba4-8237-cb6b8f30cb2e None admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:03.367761 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4f7e9-6d4f-4ba4-8237-cb6b8f30cb2e None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:03.368037 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4f7e9-6d4f-4ba4-8237-cb6b8f30cb2e None admin] PATH_INFO: `/v3/services` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:03.368672 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4f7e9-6d4f-4ba4-8237-cb6b8f30cb2e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:03.370083 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4f7e9-6d4f-4ba4-8237-cb6b8f30cb2e None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:03.401851 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:03.405360 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 370/739] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:33:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 17:33:03.406161 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f75526-b36e-4524-8fbe-ba5d857b1616 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:03.473849 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 370/740] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Aug 8 17:33:03 2022] POST /identity/v3/services => generated 251 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:33:03.474690 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4f7e9-6d4f-4ba4-8237-cb6b8f30cb2e None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:03.510018 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f75526-b36e-4524-8fbe-ba5d857b1616 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:03.556637 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8b4e1-3ac3-4540-aeae-71e33fbbb28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:03.557213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8b4e1-3ac3-4540-aeae-71e33fbbb28a None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:03.557488 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8b4e1-3ac3-4540-aeae-71e33fbbb28a None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:03.557757 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8b4e1-3ac3-4540-aeae-71e33fbbb28a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:03.571089 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8b4e1-3ac3-4540-aeae-71e33fbbb28a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:03.572559 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8b4e1-3ac3-4540-aeae-71e33fbbb28a None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:03.590039 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-a4a8b4e1-3ac3-4540-aeae-71e33fbbb28a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:03.590039 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:03.590039 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:03.590039 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:03.590039 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:03.590039 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:03.590039 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:03.590039 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:03.590039 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:03.590039 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:03.590039 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:03.590039 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:03.590039 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:33:03.590039 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:33:03.590039 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:33:03.590039 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:33:03.591140 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:03.591140 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:03.591140 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:03.591140 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:03.591140 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:03.591140 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:03.591140 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:03.591140 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:03.591140 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:03.591140 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:03.591140 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:03.591140 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:03.591140 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:03.591140 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:03.591140 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:03.591140 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:03.591140 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:33:03.592078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:33:03.592078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:03.592078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:03.592078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 371/741] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:03.592757 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17c317-f581-4acf-93f2-5e204b79b0ad None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:03.592859 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17c317-f581-4acf-93f2-5e204b79b0ad None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:03.593157 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17c317-f581-4acf-93f2-5e204b79b0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:03.614113 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-0a17c317-f581-4acf-93f2-5e204b79b0ad None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:03.614850 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4f7e9-6d4f-4ba4-8237-cb6b8f30cb2e None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:03.615335 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-0a17c317-f581-4acf-93f2-5e204b79b0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:03.616611 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:03.657217 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fbe70-39ff-42ee-8009-813891cee2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:03.657862 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fbe70-39ff-42ee-8009-813891cee2f7 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:03.658143 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fbe70-39ff-42ee-8009-813891cee2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:03.658415 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fbe70-39ff-42ee-8009-813891cee2f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:03.668971 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:03.672504 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fbe70-39ff-42ee-8009-813891cee2f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:03.673991 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fbe70-39ff-42ee-8009-813891cee2f7 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:03.691811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-491fbe70-39ff-42ee-8009-813891cee2f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:03.691811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:03.691811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:03.691811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:03.691811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:03.691811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:03.691811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:03.691811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:03.691811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:03.691811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:03.691811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:03.691811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:03.691811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:33:03.691811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:33:03.691811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:33:03.691811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:33:03.692839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:03.692839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:03.692839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:03.692839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:03.692839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:03.692839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:03.692839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:03.692839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:03.692839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:03.692839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:03.692839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:03.692839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:03.692839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:03.692839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:03.692839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:03.692839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:03.692839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:33:03.694129 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:33:03.694129 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:03.694129 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:03.697103 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 371/742] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:03.697875 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 372/743] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:03 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 17:33:03.698596 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17c317-f581-4acf-93f2-5e204b79b0ad None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:03.698713 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fbe70-39ff-42ee-8009-813891cee2f7 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:03.811372 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fbe70-39ff-42ee-8009-813891cee2f7 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:03.815494 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17c317-f581-4acf-93f2-5e204b79b0ad None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:03.848294 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283ed38-d89b-448c-b395-27157b0e95c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:03.848925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283ed38-d89b-448c-b395-27157b0e95c6 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:03.849238 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283ed38-d89b-448c-b395-27157b0e95c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:03.849512 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283ed38-d89b-448c-b395-27157b0e95c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:03.851706 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb1c92-7940-4642-b98e-ef2a54df3dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:03.852313 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb1c92-7940-4642-b98e-ef2a54df3dad None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:03.852592 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb1c92-7940-4642-b98e-ef2a54df3dad None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:03.852868 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb1c92-7940-4642-b98e-ef2a54df3dad None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:03.853540 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb1c92-7940-4642-b98e-ef2a54df3dad None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:03.853844 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb1c92-7940-4642-b98e-ef2a54df3dad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:03.855213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb1c92-7940-4642-b98e-ef2a54df3dad None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:03.861078 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283ed38-d89b-448c-b395-27157b0e95c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:03.863170 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283ed38-d89b-448c-b395-27157b0e95c6 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:03.872358 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 373/744] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:03.872358 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb1c92-7940-4642-b98e-ef2a54df3dad None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:03.883829 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-f283ed38-d89b-448c-b395-27157b0e95c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:03.883829 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:03.883829 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:03.883829 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:03.883829 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:03.883829 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:03.883829 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:03.883829 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:03.883829 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:03.883829 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:03.883829 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:03.883829 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:03.883829 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:33:03.883829 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:33:03.883829 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:33:03.883829 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:33:03.884879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:03.884879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:03.884879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:03.884879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:03.884879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:03.884879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:03.884879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:03.884879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:03.884879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:03.884879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:03.884879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:03.884879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:03.884879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:03.884879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:03.884879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:03.884879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:03.884879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:33:03.890689 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:33:03.890689 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:03.890689 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:03.890689 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 372/745] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:03.890689 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283ed38-d89b-448c-b395-27157b0e95c6 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:03.899990 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:03.915973 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:03.985546 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb1c92-7940-4642-b98e-ef2a54df3dad None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:03.999239 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283ed38-d89b-448c-b395-27157b0e95c6 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:04.024917 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096af0f5-2ea3-4be8-8f14-8fb95bce81f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:04.025465 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096af0f5-2ea3-4be8-8f14-8fb95bce81f0 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:04.025745 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096af0f5-2ea3-4be8-8f14-8fb95bce81f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:04.026016 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096af0f5-2ea3-4be8-8f14-8fb95bce81f0 None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:04.026654 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096af0f5-2ea3-4be8-8f14-8fb95bce81f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:04.026954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096af0f5-2ea3-4be8-8f14-8fb95bce81f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:04.028343 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096af0f5-2ea3-4be8-8f14-8fb95bce81f0 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:04.035842 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca692848-7d14-4eb2-8500-d9fc2b2dae36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:04.036464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca692848-7d14-4eb2-8500-d9fc2b2dae36 None admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:04.036746 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca692848-7d14-4eb2-8500-d9fc2b2dae36 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:04.037021 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca692848-7d14-4eb2-8500-d9fc2b2dae36 None admin] PATH_INFO: `/v3/services` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:04.037691 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca692848-7d14-4eb2-8500-d9fc2b2dae36 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:04.039063 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca692848-7d14-4eb2-8500-d9fc2b2dae36 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:04.046038 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 374/746] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:04.046038 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096af0f5-2ea3-4be8-8f14-8fb95bce81f0 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:04.141638 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:04.152506 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 373/747] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Aug 8 17:33:03 2022] POST /identity/v3/services => generated 240 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:33:04.152506 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca692848-7d14-4eb2-8500-d9fc2b2dae36 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:04.152801 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096af0f5-2ea3-4be8-8f14-8fb95bce81f0 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:04.197648 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d6024-d8f8-4d49-af9f-fe50ba26c6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:04.198316 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d6024-d8f8-4d49-af9f-fe50ba26c6d0 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:04.198671 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d6024-d8f8-4d49-af9f-fe50ba26c6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:04.198949 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d6024-d8f8-4d49-af9f-fe50ba26c6d0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:04.208856 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d6024-d8f8-4d49-af9f-fe50ba26c6d0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:04.210556 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d6024-d8f8-4d49-af9f-fe50ba26c6d0 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:04.224017 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-013d6024-d8f8-4d49-af9f-fe50ba26c6d0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 08 17:33:04.224017 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:04.224017 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:04.224017 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:04.224017 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:04.224017 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:04.224017 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:04.224017 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:04.224017 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:04.224017 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:04.224017 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:04.224017 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:04.224017 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:33:04.224017 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:33:04.224017 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:33:04.224017 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:33:04.225210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:04.225210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:04.225210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:33:04.225210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:33:04.225210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:33:04.225210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:33:04.225210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:04.225210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:04.225210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:04.225210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:04.225210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:04.225210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:04.225210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:04.225210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:04.225210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:04.225210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:04.225210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:04.225210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:04.226160 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:04.226160 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:04.226160 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:33:04.226160 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:33:04.226160 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:33:04.226160 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:33:04.226160 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:33:04.226160 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:33:04.226160 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 08 17:33:04.226160 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:04.230302 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 375/748] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 8 17:33:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:04.231158 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d6024-d8f8-4d49-af9f-fe50ba26c6d0 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:04.251209 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:04.302719 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca692848-7d14-4eb2-8500-d9fc2b2dae36 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:04.347557 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f613d-1c8a-4036-94f5-6d49193de1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:04.348261 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f613d-1c8a-4036-94f5-6d49193de1f9 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:04.348545 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f613d-1c8a-4036-94f5-6d49193de1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:04.349024 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f613d-1c8a-4036-94f5-6d49193de1f9 None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:04.349508 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f613d-1c8a-4036-94f5-6d49193de1f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:04.349812 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f613d-1c8a-4036-94f5-6d49193de1f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:04.351184 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f613d-1c8a-4036-94f5-6d49193de1f9 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:04.359754 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d6024-d8f8-4d49-af9f-fe50ba26c6d0 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:04.364857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 374/749] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:04.365714 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f613d-1c8a-4036-94f5-6d49193de1f9 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:04.418638 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fee36d-f874-4cdd-b57c-654509db4fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:04.420218 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fee36d-f874-4cdd-b57c-654509db4fb7 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:04.420984 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fee36d-f874-4cdd-b57c-654509db4fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:04.421491 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fee36d-f874-4cdd-b57c-654509db4fb7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:04.432228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fee36d-f874-4cdd-b57c-654509db4fb7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:04.434919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fee36d-f874-4cdd-b57c-654509db4fb7 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:04.453837 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-32fee36d-f874-4cdd-b57c-654509db4fb7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 17:33:04.453837 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:04.453837 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:04.453837 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:04.453837 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:04.453837 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:04.453837 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:04.453837 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:04.453837 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:04.453837 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:04.453837 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:04.453837 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:04.453837 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:33:04.453837 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:33:04.453837 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:33:04.453837 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:33:04.454834 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:04.454834 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:04.454834 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:33:04.454834 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:33:04.454834 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:33:04.454834 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:33:04.454834 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:04.454834 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:04.454834 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:04.454834 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:04.454834 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:04.454834 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:04.454834 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:04.454834 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:04.454834 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:04.454834 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:04.454834 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:04.454834 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:04.455863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:04.455863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:04.455863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:33:04.455863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:33:04.455863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:33:04.455863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:33:04.455863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:33:04.455863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:33:04.455863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 17:33:04.455863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:04.458515 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 376/750] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Aug 8 17:33:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:04.460156 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fee36d-f874-4cdd-b57c-654509db4fb7 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:04.481290 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:04.487894 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f613d-1c8a-4036-94f5-6d49193de1f9 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:04.516915 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:04.526595 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418927fc-7b44-4817-8aca-4c669be7050d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:04.527200 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418927fc-7b44-4817-8aca-4c669be7050d None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:04.527949 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418927fc-7b44-4817-8aca-4c669be7050d None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:04.527949 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418927fc-7b44-4817-8aca-4c669be7050d None admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:04.528586 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418927fc-7b44-4817-8aca-4c669be7050d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:04.528890 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418927fc-7b44-4817-8aca-4c669be7050d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:04.530339 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418927fc-7b44-4817-8aca-4c669be7050d None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:04.547895 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 375/751] 10.222.0.70 () {56 vars in 1135 bytes} [Mon Aug 8 17:33:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:04.554228 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418927fc-7b44-4817-8aca-4c669be7050d None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:04.593097 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fee36d-f874-4cdd-b57c-654509db4fb7 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:04.634545 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a162ed7-e341-4bd9-b996-691949ffc560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:04.635516 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a162ed7-e341-4bd9-b996-691949ffc560 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:04.635971 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a162ed7-e341-4bd9-b996-691949ffc560 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:04.636422 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a162ed7-e341-4bd9-b996-691949ffc560 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:04.645817 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a162ed7-e341-4bd9-b996-691949ffc560 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:04.647689 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a162ed7-e341-4bd9-b996-691949ffc560 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:04.661192 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-2a162ed7-e341-4bd9-b996-691949ffc560 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:33:04.661192 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:04.661192 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:04.661192 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:04.661192 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:04.661192 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:04.661192 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:04.661192 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:04.661192 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:04.661192 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:04.661192 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:04.661192 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:04.661192 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:33:04.661192 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:33:04.661192 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:33:04.662149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:33:04.662149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:04.662149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:04.662149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:04.662149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:04.662149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:04.662149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:04.662149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:04.662149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:04.662149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:04.662149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:04.662149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:04.662149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:04.662149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:04.662149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:04.662149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:04.662149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:04.663113 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:33:04.663113 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:33:04.663113 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:33:04.663113 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:33:04.663113 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:33:04.663113 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:33:04.663113 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:33:04.663113 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:04.665656 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 377/752] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:33:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:04.666717 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a162ed7-e341-4bd9-b996-691949ffc560 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:04.681996 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418927fc-7b44-4817-8aca-4c669be7050d None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:04.729765 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b10a70-b525-46a3-98d8-50527292ec64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:04.730400 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b10a70-b525-46a3-98d8-50527292ec64 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:04.730679 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b10a70-b525-46a3-98d8-50527292ec64 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:04.730961 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b10a70-b525-46a3-98d8-50527292ec64 None admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:04.731690 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b10a70-b525-46a3-98d8-50527292ec64 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:04.731995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b10a70-b525-46a3-98d8-50527292ec64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:04.734137 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b10a70-b525-46a3-98d8-50527292ec64 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:04.761177 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 376/753] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Aug 8 17:33:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:04.761177 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b10a70-b525-46a3-98d8-50527292ec64 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:04.789544 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a162ed7-e341-4bd9-b996-691949ffc560 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:04.813507 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:04.818251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:04.825511 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56d2df-07d2-424e-b30e-7bb96344391d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:04.826390 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56d2df-07d2-424e-b30e-7bb96344391d None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:04.826729 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56d2df-07d2-424e-b30e-7bb96344391d None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:04.827064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56d2df-07d2-424e-b30e-7bb96344391d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:04.890074 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b10a70-b525-46a3-98d8-50527292ec64 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:04.911077 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56d2df-07d2-424e-b30e-7bb96344391d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:04.913207 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56d2df-07d2-424e-b30e-7bb96344391d None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:04.933658 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0bf17-c056-4b46-88b4-8f8a04ce3981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:04.934542 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0bf17-c056-4b46-88b4-8f8a04ce3981 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:04.934828 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0bf17-c056-4b46-88b4-8f8a04ce3981 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:04.935098 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0bf17-c056-4b46-88b4-8f8a04ce3981 None admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:04.935790 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0bf17-c056-4b46-88b4-8f8a04ce3981 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:04.936091 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0bf17-c056-4b46-88b4-8f8a04ce3981 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:04.937606 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0bf17-c056-4b46-88b4-8f8a04ce3981 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:04.960252 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 377/754] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 8 17:33:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:04.960252 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0bf17-c056-4b46-88b4-8f8a04ce3981 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:05.004908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:05.032374 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 378/755] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:33:04 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 17:33:05.033653 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56d2df-07d2-424e-b30e-7bb96344391d None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:05.088418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0bf17-c056-4b46-88b4-8f8a04ce3981 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:05.090172 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:05.133438 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f76ccb-add0-4740-b58c-ec64ee3d7fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:05.134070 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f76ccb-add0-4740-b58c-ec64ee3d7fdf None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:05.134379 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f76ccb-add0-4740-b58c-ec64ee3d7fdf None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:05.134914 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f76ccb-add0-4740-b58c-ec64ee3d7fdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:05.146751 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56d2df-07d2-424e-b30e-7bb96344391d None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:05.148395 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f76ccb-add0-4740-b58c-ec64ee3d7fdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:05.150806 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f76ccb-add0-4740-b58c-ec64ee3d7fdf None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:05.168949 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-65f76ccb-add0-4740-b58c-ec64ee3d7fdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:05.168949 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:05.168949 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:05.168949 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:05.168949 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:05.168949 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:05.168949 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:05.168949 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:05.168949 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:05.168949 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:05.168949 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:05.168949 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:05.168949 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:33:05.168949 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:33:05.168949 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:33:05.168949 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:33:05.170220 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:05.170220 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:05.170220 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:05.170220 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:05.170220 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:05.170220 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:05.170220 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:05.170220 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:05.170220 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:05.170220 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:05.170220 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:05.170220 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:05.170220 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:05.170220 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:05.170220 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:05.170220 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:05.170220 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:33:05.171123 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:33:05.171123 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:05.171123 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:05.171123 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 378/756] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:05.171123 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f76ccb-add0-4740-b58c-ec64ee3d7fdf None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:05.192434 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf1be9-a350-400b-9782-02c63569266b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:05.193754 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf1be9-a350-400b-9782-02c63569266b None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:05.194414 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf1be9-a350-400b-9782-02c63569266b None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:05.194896 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf1be9-a350-400b-9782-02c63569266b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:05.196071 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf1be9-a350-400b-9782-02c63569266b None admin] RBAC: Adding query filter params (role.id=6d5d281c40dd4e69803141f48615b386, scope.project.id=047a28b7cd11486da9d330723a384812, user.id=c880ab908c114c5897d11aad7fb48607) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:05.196578 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf1be9-a350-400b-9782-02c63569266b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:05.198668 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf1be9-a350-400b-9782-02c63569266b None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:05.213148 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 379/757] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:33:05 2022] GET /identity/v3/role_assignments?user.id=c880ab908c114c5897d11aad7fb48607&scope.project.id=047a28b7cd11486da9d330723a384812&role.id=6d5d281c40dd4e69803141f48615b386 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:05.213148 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf1be9-a350-400b-9782-02c63569266b None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:05.271157 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:05.353459 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f76ccb-add0-4740-b58c-ec64ee3d7fdf None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:05.395897 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5385a-966e-4c16-af65-4ef9a269c5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:05.396536 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5385a-966e-4c16-af65-4ef9a269c5c6 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:05.396816 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5385a-966e-4c16-af65-4ef9a269c5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:05.397128 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5385a-966e-4c16-af65-4ef9a269c5c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:05.410000 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf1be9-a350-400b-9782-02c63569266b None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:05.410184 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f5385a-966e-4c16-af65-4ef9a269c5c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:05.411064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f5385a-966e-4c16-af65-4ef9a269c5c6 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:05.426901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-47f5385a-966e-4c16-af65-4ef9a269c5c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:05.426901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:05.426901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:05.426901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:05.426901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:05.426901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:05.426901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:05.426901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:05.426901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:05.426901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:05.426901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:05.426901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:05.426901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:33:05.426901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:33:05.426901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:33:05.426901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:33:05.427898 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:05.427898 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:05.427898 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:05.427898 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:05.427898 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:05.427898 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:05.427898 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:05.427898 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:05.427898 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:05.427898 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:05.427898 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:05.427898 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:05.427898 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:05.427898 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:05.427898 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:05.427898 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:05.427898 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:33:05.429277 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:33:05.429277 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:05.429277 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:05.429277 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 379/758] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:05.435866 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5385a-966e-4c16-af65-4ef9a269c5c6 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:05.453784 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:05.489463 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8294175-50e0-4663-a6b7-5fd7effd3611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:05.490129 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8294175-50e0-4663-a6b7-5fd7effd3611 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:05.490353 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8294175-50e0-4663-a6b7-5fd7effd3611 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:05.490623 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8294175-50e0-4663-a6b7-5fd7effd3611 None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:05.491270 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8294175-50e0-4663-a6b7-5fd7effd3611 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:05.491570 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8294175-50e0-4663-a6b7-5fd7effd3611 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:05.492936 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8294175-50e0-4663-a6b7-5fd7effd3611 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:05.522931 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 380/759] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:05.526065 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8294175-50e0-4663-a6b7-5fd7effd3611 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:05.636614 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5385a-966e-4c16-af65-4ef9a269c5c6 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:05.672607 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbca1ff-c9e7-487c-939b-6c964cdc060d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:05.673230 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbca1ff-c9e7-487c-939b-6c964cdc060d None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:05.673508 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbca1ff-c9e7-487c-939b-6c964cdc060d None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:05.673773 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbca1ff-c9e7-487c-939b-6c964cdc060d None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:05.674410 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbca1ff-c9e7-487c-939b-6c964cdc060d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:05.674913 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbca1ff-c9e7-487c-939b-6c964cdc060d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:05.676720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbca1ff-c9e7-487c-939b-6c964cdc060d None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:05.694956 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 380/760] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:05.694956 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907f731-5a71-4999-98e9-5979ffc01b8a None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:05.694956 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907f731-5a71-4999-98e9-5979ffc01b8a None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:05.694956 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907f731-5a71-4999-98e9-5979ffc01b8a None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:05.694956 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 381/761] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:05.701848 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907f731-5a71-4999-98e9-5979ffc01b8a None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:05.703784 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:05.710906 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8294175-50e0-4663-a6b7-5fd7effd3611 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:05.759463 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32601572-e924-418b-9d60-b76a12c9b3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:05.760883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32601572-e924-418b-9d60-b76a12c9b3ce None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:05.761407 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32601572-e924-418b-9d60-b76a12c9b3ce None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:05.761683 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32601572-e924-418b-9d60-b76a12c9b3ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:05.771896 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32601572-e924-418b-9d60-b76a12c9b3ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:05.774603 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32601572-e924-418b-9d60-b76a12c9b3ce None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:05.781856 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:05.791733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-32601572-e924-418b-9d60-b76a12c9b3ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:33:05.791733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:05.791733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:05.791733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:05.791733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:05.791733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:05.791733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:05.791733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:05.791733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:05.791733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:05.791733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:05.791733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:05.791733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:33:05.791733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:33:05.791733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:33:05.796467 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:33:05.796467 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:05.796467 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:05.796467 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:05.796467 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:05.796467 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:05.796467 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:05.796467 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:05.796467 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:05.796467 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:05.796467 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:05.796467 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:05.796467 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:05.796467 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:05.796467 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:05.796467 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:05.796467 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:05.797463 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:33:05.797463 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:33:05.797463 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:33:05.797463 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:33:05.797463 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:33:05.797463 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:33:05.797463 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:33:05.797463 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:05.797463 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 381/762] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:33:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:05.797463 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d262b2-1eee-490b-bd24-18af4d97068d None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:05.797463 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d262b2-1eee-490b-bd24-18af4d97068d None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:05.798105 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d262b2-1eee-490b-bd24-18af4d97068d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:05.821077 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-13d262b2-1eee-490b-bd24-18af4d97068d None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:05.823031 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-13d262b2-1eee-490b-bd24-18af4d97068d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:05.828474 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907f731-5a71-4999-98e9-5979ffc01b8a None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:05.867292 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f85ee-8726-4680-a7f9-d9c8165db981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:05.868021 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f85ee-8726-4680-a7f9-d9c8165db981 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:05.868360 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f85ee-8726-4680-a7f9-d9c8165db981 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:05.868674 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f85ee-8726-4680-a7f9-d9c8165db981 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:05.875963 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f85ee-8726-4680-a7f9-d9c8165db981 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:05.877530 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f85ee-8726-4680-a7f9-d9c8165db981 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:05.892455 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-e37f85ee-8726-4680-a7f9-d9c8165db981 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:33:05.892455 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:05.892455 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:05.892455 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:05.892455 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:05.892455 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:05.892455 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:05.892455 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:05.892455 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:05.892455 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:05.892455 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:05.892455 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:05.892455 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:33:05.892455 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:33:05.892455 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:33:05.894994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:33:05.894994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:05.894994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:05.894994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:05.894994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:05.894994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:05.894994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:05.894994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:05.894994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:05.894994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:05.894994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:05.894994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:05.894994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:05.894994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:05.894994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:05.894994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:05.894994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:05.896306 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:33:05.896306 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:33:05.896306 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:33:05.896306 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:33:05.896306 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:33:05.896306 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:33:05.896306 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:33:05.896306 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:05.896306 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 382/763] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:33:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:05.905064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f85ee-8726-4680-a7f9-d9c8165db981 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:05.920674 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 382/764] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:33:05.921735 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d262b2-1eee-490b-bd24-18af4d97068d None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:06.032494 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:06.040670 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f85ee-8726-4680-a7f9-d9c8165db981 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:06.045519 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d262b2-1eee-490b-bd24-18af4d97068d None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:06.075133 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:06.084342 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e5cc7-bf5a-4ffa-925a-862913692486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:06.085365 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e5cc7-bf5a-4ffa-925a-862913692486 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:06.085807 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e5cc7-bf5a-4ffa-925a-862913692486 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:06.086213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e5cc7-bf5a-4ffa-925a-862913692486 None admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:06.087101 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e5cc7-bf5a-4ffa-925a-862913692486 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:06.087505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e5cc7-bf5a-4ffa-925a-862913692486 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:06.087895 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6a02b-1a9b-4005-961d-fe232dc36fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:06.088677 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6a02b-1a9b-4005-961d-fe232dc36fc0 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:06.089130 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6a02b-1a9b-4005-961d-fe232dc36fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:06.089477 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e5cc7-bf5a-4ffa-925a-862913692486 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:06.089697 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6a02b-1a9b-4005-961d-fe232dc36fc0 None admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:06.090533 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6a02b-1a9b-4005-961d-fe232dc36fc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:06.091004 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6a02b-1a9b-4005-961d-fe232dc36fc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:06.093488 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6a02b-1a9b-4005-961d-fe232dc36fc0 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:06.104134 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 383/765] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 8 17:33:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:06.107283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e5cc7-bf5a-4ffa-925a-862913692486 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:06.113668 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 383/766] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 8 17:33:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:06.114798 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6a02b-1a9b-4005-961d-fe232dc36fc0 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:06.228887 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6a02b-1a9b-4005-961d-fe232dc36fc0 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:06.235465 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e5cc7-bf5a-4ffa-925a-862913692486 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:06.266989 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0201c-5fa3-411e-b294-d0037e37b02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:06.267618 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0201c-5fa3-411e-b294-d0037e37b02e None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:06.268035 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0201c-5fa3-411e-b294-d0037e37b02e None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:06.268929 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0201c-5fa3-411e-b294-d0037e37b02e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:06.270237 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0201c-5fa3-411e-b294-d0037e37b02e None admin] RBAC: Adding query filter params (role.id=5c25aa917ab34baabb795c54dd8a4d02, scope.project.id=047a28b7cd11486da9d330723a384812, user.id=67b83ff95ed44f35af2e412a700ca567) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:06.270661 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0201c-5fa3-411e-b294-d0037e37b02e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:06.272171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0201c-5fa3-411e-b294-d0037e37b02e None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:06.273400 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cec863-98b3-47d4-9f58-e026bfe45cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:06.274192 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cec863-98b3-47d4-9f58-e026bfe45cc2 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:06.274619 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cec863-98b3-47d4-9f58-e026bfe45cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:06.275036 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cec863-98b3-47d4-9f58-e026bfe45cc2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:06.275761 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cec863-98b3-47d4-9f58-e026bfe45cc2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:06.277287 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cec863-98b3-47d4-9f58-e026bfe45cc2 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:06.283558 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 384/767] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:33:06 2022] GET /identity/v3/role_assignments?user.id=67b83ff95ed44f35af2e412a700ca567&scope.project.id=047a28b7cd11486da9d330723a384812&role.id=5c25aa917ab34baabb795c54dd8a4d02 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:06.285534 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0201c-5fa3-411e-b294-d0037e37b02e None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:06.287376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-13cec863-98b3-47d4-9f58-e026bfe45cc2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 17:33:06.287376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:06.287376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 17:33:06.287376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 17:33:06.287376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 17:33:06.287376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 17:33:06.287376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 17:33:06.287376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:06.287376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 17:33:06.287376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:06.287376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 17:33:06.287376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:06.287376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:06.287376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:06.287376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:06.287376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:06.287376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:06.288375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:06.288375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:06.288375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:06.288375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:06.288375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:06.288375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:06.288375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 17:33:06.288375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 17:33:06.288375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 17:33:06.288375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 17:33:06.288375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:06.288375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:06.288375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:06.288375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:06.288375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:06.288375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:06.289275 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:06.289275 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:06.289275 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:06.289275 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:06.289275 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:06.289275 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:06.289275 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:06.289275 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:06.289275 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:06.289275 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:06.289275 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 17:33:06.289275 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:06.289275 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 17:33:06.289275 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:06.291778 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 384/768] 10.222.0.70 () {56 vars in 1129 bytes} [Mon Aug 8 17:33:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:06.302350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cec863-98b3-47d4-9f58-e026bfe45cc2 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:06.327694 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:06.365137 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:06.443758 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cec863-98b3-47d4-9f58-e026bfe45cc2 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:06.453063 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0201c-5fa3-411e-b294-d0037e37b02e None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:06.490208 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd6b3f-7dd2-4ecb-b6de-8969a240da14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:06.491732 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd6b3f-7dd2-4ecb-b6de-8969a240da14 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:06.492628 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd6b3f-7dd2-4ecb-b6de-8969a240da14 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:06.493353 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd6b3f-7dd2-4ecb-b6de-8969a240da14 None admin] PATH_INFO: `/v3/services` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:06.494392 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dd6b3f-7dd2-4ecb-b6de-8969a240da14 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:06.494967 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dd6b3f-7dd2-4ecb-b6de-8969a240da14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:06.496931 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dd6b3f-7dd2-4ecb-b6de-8969a240da14 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:06.497576 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e37f33-ae77-4811-a205-ab01874bb14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:06.498347 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e37f33-ae77-4811-a205-ab01874bb14f None admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:06.498765 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e37f33-ae77-4811-a205-ab01874bb14f None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:06.499130 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e37f33-ae77-4811-a205-ab01874bb14f None admin] PATH_INFO: `/v3/projects/047a28b7cd11486da9d330723a384812/users/3973b8fbfbb9475896e4e110ca8aa615/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:06.501370 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e37f33-ae77-4811-a205-ab01874bb14f None admin] RBAC: Authorizing `identity:create_grant(project_id=047a28b7cd11486da9d330723a384812, user_id=3973b8fbfbb9475896e4e110ca8aa615, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:06.504200 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e37f33-ae77-4811-a205-ab01874bb14f None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:06.509249 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 385/769] 10.222.0.70 () {56 vars in 1124 bytes} [Mon Aug 8 17:33:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:06.510571 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d55e2a-6d1a-4df6-a4c6-99d13202b81f None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:06.510905 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d55e2a-6d1a-4df6-a4c6-99d13202b81f None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:06.511176 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d55e2a-6d1a-4df6-a4c6-99d13202b81f None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:06.512895 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 386/770] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:06.513700 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d55e2a-6d1a-4df6-a4c6-99d13202b81f None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:06.590116 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 385/771] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 8 17:33:06 2022] PUT /identity/v3/projects/047a28b7cd11486da9d330723a384812/users/3973b8fbfbb9475896e4e110ca8aa615/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:33:06.590116 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09ca75-f382-4464-9229-cb30d70c415e None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:06.590116 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09ca75-f382-4464-9229-cb30d70c415e None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:06.590116 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09ca75-f382-4464-9229-cb30d70c415e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:06.615287 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-3f09ca75-f382-4464-9229-cb30d70c415e None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:06.616633 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-3f09ca75-f382-4464-9229-cb30d70c415e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:06.626002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:06.693401 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d55e2a-6d1a-4df6-a4c6-99d13202b81f None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:06.750713 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 386/772] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:33:06.759484 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dbf44a-86ea-4c19-9098-b9ca51fc5f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:06.760107 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbf44a-86ea-4c19-9098-b9ca51fc5f42 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:06.760369 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbf44a-86ea-4c19-9098-b9ca51fc5f42 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:06.760639 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbf44a-86ea-4c19-9098-b9ca51fc5f42 None admin] PATH_INFO: `/v3/services` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:06.761387 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dbf44a-86ea-4c19-9098-b9ca51fc5f42 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:06.761665 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dbf44a-86ea-4c19-9098-b9ca51fc5f42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:06.763094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dbf44a-86ea-4c19-9098-b9ca51fc5f42 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:06.770256 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 387/773] 10.222.0.70 () {56 vars in 1124 bytes} [Mon Aug 8 17:33:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:06.778035 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09ca75-f382-4464-9229-cb30d70c415e None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:06.789976 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dbf44a-86ea-4c19-9098-b9ca51fc5f42 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:06.851271 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:06.948105 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dbf44a-86ea-4c19-9098-b9ca51fc5f42 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:06.963804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09ca75-f382-4464-9229-cb30d70c415e None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:07.012136 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcefba5-4eb0-4a7d-b2f9-fbef524e7a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:07.013145 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcefba5-4eb0-4a7d-b2f9-fbef524e7a20 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:07.013684 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcefba5-4eb0-4a7d-b2f9-fbef524e7a20 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:07.014160 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcefba5-4eb0-4a7d-b2f9-fbef524e7a20 None admin] PATH_INFO: `/v3/services/network` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:07.014964 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcefba5-4eb0-4a7d-b2f9-fbef524e7a20 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:07.016636 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcefba5-4eb0-4a7d-b2f9-fbef524e7a20 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:07.025961 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63640a34-0a8c-49e1-9ac5-19a5b5c9f7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:07.026568 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63640a34-0a8c-49e1-9ac5-19a5b5c9f7f8 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:07.026853 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63640a34-0a8c-49e1-9ac5-19a5b5c9f7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:07.027124 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63640a34-0a8c-49e1-9ac5-19a5b5c9f7f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:07.027820 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63640a34-0a8c-49e1-9ac5-19a5b5c9f7f8 None admin] RBAC: Adding query filter params (interface=public, service_id=4d5907c87e324ed280dbca38ebbb007e, region_id=RegionOne) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:07.028122 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63640a34-0a8c-49e1-9ac5-19a5b5c9f7f8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:07.034724 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63640a34-0a8c-49e1-9ac5-19a5b5c9f7f8 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:07.038354 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-cfcefba5-4eb0-4a7d-b2f9-fbef524e7a20 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 17:33:07.038354 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:07.038354 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 17:33:07.038354 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 17:33:07.038354 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 17:33:07.038354 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 17:33:07.038354 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 17:33:07.038354 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:07.038354 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 17:33:07.038354 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:07.038354 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 17:33:07.038354 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:07.038354 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:07.038354 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:07.038354 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:07.038354 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:07.038354 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:07.039341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:07.039341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:07.039341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:07.039341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:07.039341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:07.039341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:07.039341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 17:33:07.039341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 17:33:07.039341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 17:33:07.039341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 17:33:07.039341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:07.039341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:07.039341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:07.039341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:07.039341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:07.039341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:07.040577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:07.040577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:07.040577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:07.040577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:07.040577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:07.040577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:07.040577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:07.040577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:07.040577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:07.040577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:07.040577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 17:33:07.040577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:07.040577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 17:33:07.040577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:07.040577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 388/774] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:33:06 2022] GET /identity/v3/services/network => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:07.045394 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcefba5-4eb0-4a7d-b2f9-fbef524e7a20 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:07.047826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 387/775] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Aug 8 17:33:06 2022] GET /identity/v3/endpoints?service_id=4d5907c87e324ed280dbca38ebbb007e&interface=public®ion_id=RegionOne => generated 194 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:07.050257 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:07.054012 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63640a34-0a8c-49e1-9ac5-19a5b5c9f7f8 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:07.162278 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcefba5-4eb0-4a7d-b2f9-fbef524e7a20 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:07.199327 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc6f88-b050-4e60-af61-983c1135c404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:07.200262 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc6f88-b050-4e60-af61-983c1135c404 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:07.200828 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc6f88-b050-4e60-af61-983c1135c404 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:07.201272 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc6f88-b050-4e60-af61-983c1135c404 None admin] PATH_INFO: `/v3/services` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:07.202135 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc6f88-b050-4e60-af61-983c1135c404 None admin] RBAC: Adding query filter params (name=network) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:07.202599 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc6f88-b050-4e60-af61-983c1135c404 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:07.204222 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc6f88-b050-4e60-af61-983c1135c404 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:07.210422 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 389/776] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Aug 8 17:33:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:33:07.216244 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc6f88-b050-4e60-af61-983c1135c404 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:07.280164 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63640a34-0a8c-49e1-9ac5-19a5b5c9f7f8 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:07.288351 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:07.298450 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:07.318153 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ad393-05b9-4678-9594-b80a9692c0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:07.319269 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ad393-05b9-4678-9594-b80a9692c0f0 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:07.319762 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ad393-05b9-4678-9594-b80a9692c0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:07.320242 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ad393-05b9-4678-9594-b80a9692c0f0 None admin] PATH_INFO: `/v3/services` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:07.321596 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ad393-05b9-4678-9594-b80a9692c0f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:07.323682 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ad393-05b9-4678-9594-b80a9692c0f0 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:07.333397 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 388/777] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Aug 8 17:33:07 2022] GET /identity/v3/services => generated 772 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:07.369165 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc6f88-b050-4e60-af61-983c1135c404 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:07.387306 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11588d0a-0b83-4c53-af04-426431dfc4e2 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:07.387977 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11588d0a-0b83-4c53-af04-426431dfc4e2 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:07.388597 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11588d0a-0b83-4c53-af04-426431dfc4e2 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:07.399921 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 389/778] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:07 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:07.406394 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbd02d-9c2c-45f6-aca7-dd4fd9bc2a2d None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:07.417543 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbd02d-9c2c-45f6-aca7-dd4fd9bc2a2d None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:07.417826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbd02d-9c2c-45f6-aca7-dd4fd9bc2a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:07.429246 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6f9b2-2cd3-4f06-9c5a-2f49244b4b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:07.430353 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6f9b2-2cd3-4f06-9c5a-2f49244b4b6b None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:07.430910 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6f9b2-2cd3-4f06-9c5a-2f49244b4b6b None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:07.431491 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6f9b2-2cd3-4f06-9c5a-2f49244b4b6b None admin] PATH_INFO: `/v3/services` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:07.432347 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6f9b2-2cd3-4f06-9c5a-2f49244b4b6b None admin] RBAC: Adding query filter params (type=network) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:07.432865 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6f9b2-2cd3-4f06-9c5a-2f49244b4b6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:07.434566 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6f9b2-2cd3-4f06-9c5a-2f49244b4b6b None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:07.441397 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 390/779] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Aug 8 17:33:07 2022] GET /identity/v3/services?type=network => generated 350 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:33:07.450321 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6f9b2-2cd3-4f06-9c5a-2f49244b4b6b None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:07.467781 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-91bbd02d-9c2c-45f6-aca7-dd4fd9bc2a2d None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:07.471329 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-91bbd02d-9c2c-45f6-aca7-dd4fd9bc2a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:07.617711 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 390/780] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:33:07.620966 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6f9b2-2cd3-4f06-9c5a-2f49244b4b6b None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:07.640719 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbd02d-9c2c-45f6-aca7-dd4fd9bc2a2d None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:07.661312 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:07.683880 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e95019-4846-4f84-ad0b-f83e79b4b2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:07.683880 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e95019-4846-4f84-ad0b-f83e79b4b2a4 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:07.683880 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e95019-4846-4f84-ad0b-f83e79b4b2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:07.683880 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e95019-4846-4f84-ad0b-f83e79b4b2a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:07.684326 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e95019-4846-4f84-ad0b-f83e79b4b2a4 None admin] RBAC: Adding query filter params (interface=public, service_id=49e04943c876468ca31def73cb212bfc, region_id=RegionOne) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:07.684326 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e95019-4846-4f84-ad0b-f83e79b4b2a4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:07.684326 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e95019-4846-4f84-ad0b-f83e79b4b2a4 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:07.707843 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 391/781] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Aug 8 17:33:07 2022] GET /identity/v3/endpoints?service_id=49e04943c876468ca31def73cb212bfc&interface=public®ion_id=RegionOne => generated 194 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:07.713986 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e95019-4846-4f84-ad0b-f83e79b4b2a4 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:07.784291 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:07.788259 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbd02d-9c2c-45f6-aca7-dd4fd9bc2a2d None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:07.863530 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792262fb-911b-49c4-b594-9a929353b7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:07.865795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792262fb-911b-49c4-b594-9a929353b7ab None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:07.867312 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792262fb-911b-49c4-b594-9a929353b7ab None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:07.867768 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792262fb-911b-49c4-b594-9a929353b7ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:07.891494 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792262fb-911b-49c4-b594-9a929353b7ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:33:07.901231 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-792262fb-911b-49c4-b594-9a929353b7ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:33:07.901231 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:07.901231 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:07.901231 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:07.901231 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:07.901231 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:07.901231 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:07.901231 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:07.901231 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:07.901231 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:07.901231 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:07.901231 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:07.901231 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:33:07.901231 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:33:07.901231 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:33:07.901231 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:33:07.907748 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:33:07.907748 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:33:07.907748 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:33:07.907748 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:33:07.907748 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:07.907748 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:07.907748 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:07.907748 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:07.907748 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:07.907748 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:07.907748 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:07.907748 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:07.907748 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:07.907748 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:07.907748 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:07.907748 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:07.908894 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:07.908894 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:07.908894 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:07.908894 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:07.908894 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:33:07.908894 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:33:07.908894 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:33:07.908894 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:33:07.908894 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:33:07.908894 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:33:07.908894 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:33:07.908894 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:07.911299 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 391/782] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 8 17:33:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:33:07.916804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792262fb-911b-49c4-b594-9a929353b7ab None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:07.933171 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e95019-4846-4f84-ad0b-f83e79b4b2a4 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:07.999258 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fff017-88b8-41ca-97e8-c69a5b91899c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:08.000076 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fff017-88b8-41ca-97e8-c69a5b91899c None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:08.000361 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fff017-88b8-41ca-97e8-c69a5b91899c None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:08.000637 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fff017-88b8-41ca-97e8-c69a5b91899c None admin] PATH_INFO: `/v3/services` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:08.001286 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fff017-88b8-41ca-97e8-c69a5b91899c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:08.003608 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fff017-88b8-41ca-97e8-c69a5b91899c None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:08.014278 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 392/783] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Aug 8 17:33:07 2022] GET /identity/v3/services => generated 772 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:08.082107 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792262fb-911b-49c4-b594-9a929353b7ab None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:08.139033 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927b252-094d-4384-bc7a-6c777606e66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:08.139658 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927b252-094d-4384-bc7a-6c777606e66a None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:08.139940 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927b252-094d-4384-bc7a-6c777606e66a None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:08.140211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927b252-094d-4384-bc7a-6c777606e66a None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:08.140899 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927b252-094d-4384-bc7a-6c777606e66a None admin] RBAC: Adding query filter params (name=service) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:08.141280 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927b252-094d-4384-bc7a-6c777606e66a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:08.142680 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927b252-094d-4384-bc7a-6c777606e66a None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:08.157053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 392/784] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 8 17:33:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:33:08.163449 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fff017-88b8-41ca-97e8-c69a5b91899c None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:08.231770 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:08.275256 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fff017-88b8-41ca-97e8-c69a5b91899c None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:08.311463 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0a401-66f6-4032-a21c-feb61a194941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:08.312092 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0a401-66f6-4032-a21c-feb61a194941 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:08.312369 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0a401-66f6-4032-a21c-feb61a194941 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:08.312639 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0a401-66f6-4032-a21c-feb61a194941 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:08.324481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0a401-66f6-4032-a21c-feb61a194941 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:08.325965 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0a401-66f6-4032-a21c-feb61a194941 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:08.340181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-17e0a401-66f6-4032-a21c-feb61a194941 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:08.340181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:08.340181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:08.340181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:08.340181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:08.340181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:08.340181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:08.340181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:08.340181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:08.340181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:08.340181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:08.340181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:08.340181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:33:08.340181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:33:08.340181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:33:08.340181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:33:08.341177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:08.341177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:08.341177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:08.341177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:08.341177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:08.341177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:08.341177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:08.341177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:08.341177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:08.341177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:08.341177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:08.341177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:08.341177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:08.341177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:08.341177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:08.341177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:08.341177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:33:08.342084 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:33:08.342084 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:08.342084 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:08.347241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 393/785] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:08.349211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927b252-094d-4384-bc7a-6c777606e66a None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:08.373568 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:08.463855 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927b252-094d-4384-bc7a-6c777606e66a None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:08.511719 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ae534-f367-4d9e-9b70-a817073d8d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:08.512336 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ae534-f367-4d9e-9b70-a817073d8d5d None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:08.512619 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ae534-f367-4d9e-9b70-a817073d8d5d None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:08.512889 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ae534-f367-4d9e-9b70-a817073d8d5d None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:08.513569 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ae534-f367-4d9e-9b70-a817073d8d5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:08.513868 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ae534-f367-4d9e-9b70-a817073d8d5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:08.515237 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ae534-f367-4d9e-9b70-a817073d8d5d None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:08.532422 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 393/786] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:08.538111 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0a401-66f6-4032-a21c-feb61a194941 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:08.546564 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb43bc2-fe8a-4c42-9f4e-dc7fc440304e None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:08.546847 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb43bc2-fe8a-4c42-9f4e-dc7fc440304e None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:08.547121 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb43bc2-fe8a-4c42-9f4e-dc7fc440304e None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:08.548840 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 394/787] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:08.554540 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838ca94-4ea5-4843-8ff5-a1566b4e5b96 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:08.554825 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838ca94-4ea5-4843-8ff5-a1566b4e5b96 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:08.555106 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838ca94-4ea5-4843-8ff5-a1566b4e5b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:08.576155 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-b838ca94-4ea5-4843-8ff5-a1566b4e5b96 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:08.577404 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-b838ca94-4ea5-4843-8ff5-a1566b4e5b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:08.658813 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 395/788] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 17:33:08.684894 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838ca94-4ea5-4843-8ff5-a1566b4e5b96 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:08.699128 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:08.734095 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0a401-66f6-4032-a21c-feb61a194941 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:08.760549 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:08.793134 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a3cac-f7f1-422a-a01a-bcdb1e5cae40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:08.793134 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a3cac-f7f1-422a-a01a-bcdb1e5cae40 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:08.793134 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a3cac-f7f1-422a-a01a-bcdb1e5cae40 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:08.793134 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a3cac-f7f1-422a-a01a-bcdb1e5cae40 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:08.795583 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a3cac-f7f1-422a-a01a-bcdb1e5cae40 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:08.797261 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a3cac-f7f1-422a-a01a-bcdb1e5cae40 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:08.810078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-cb5a3cac-f7f1-422a-a01a-bcdb1e5cae40 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 17:33:08.810078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:08.810078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:08.810078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:08.810078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:08.810078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:08.810078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:08.810078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:08.810078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:08.810078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:08.810078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:08.810078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:08.810078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:33:08.810078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:33:08.810078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:33:08.810078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:33:08.812540 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:08.812540 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:08.812540 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:33:08.812540 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:33:08.812540 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:33:08.812540 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:33:08.812540 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:08.812540 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:08.812540 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:08.812540 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:08.812540 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:08.812540 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:08.812540 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:08.812540 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:08.812540 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:08.812540 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:08.812540 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:08.812540 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:08.815458 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:08.815458 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:08.815458 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:33:08.815458 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:33:08.815458 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:33:08.815458 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:33:08.815458 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:33:08.815458 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:33:08.815458 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 17:33:08.815458 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:08.815458 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 394/789] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Aug 8 17:33:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:08.823117 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a3cac-f7f1-422a-a01a-bcdb1e5cae40 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:08.831662 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838ca94-4ea5-4843-8ff5-a1566b4e5b96 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:08.883034 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1e2e3-7773-4699-8633-de882872224f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:08.883670 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1e2e3-7773-4699-8633-de882872224f None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:08.883951 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1e2e3-7773-4699-8633-de882872224f None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:08.884221 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1e2e3-7773-4699-8633-de882872224f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:08.905726 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e1e2e3-7773-4699-8633-de882872224f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:33:08.911049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-53e1e2e3-7773-4699-8633-de882872224f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:33:08.911049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:08.911049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:08.911049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:08.911049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:08.911049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:08.911049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:08.911049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:08.911049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:08.911049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:08.911049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:08.911049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:08.911049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:33:08.911049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:33:08.911049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:33:08.911049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:33:08.912173 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:33:08.912173 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:33:08.912173 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:33:08.912173 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:33:08.912173 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:08.912173 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:08.912173 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:08.912173 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:08.912173 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:08.912173 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:08.912173 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:08.912173 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:08.912173 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:08.912173 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:08.912173 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:08.912173 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:08.913688 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:08.913688 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:08.913688 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:08.913688 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:08.913688 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:33:08.913688 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:33:08.913688 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:33:08.913688 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:33:08.913688 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:33:08.913688 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:33:08.913688 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:33:08.913688 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:08.913688 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 396/790] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 8 17:33:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:08.919093 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1e2e3-7773-4699-8633-de882872224f None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:09.045895 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a3cac-f7f1-422a-a01a-bcdb1e5cae40 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:09.060365 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:09.118955 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1e2e3-7773-4699-8633-de882872224f None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:09.120847 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258e836-7988-45b8-87b3-3631cbcaed2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:09.121479 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258e836-7988-45b8-87b3-3631cbcaed2b None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:09.121753 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258e836-7988-45b8-87b3-3631cbcaed2b None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:09.122020 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258e836-7988-45b8-87b3-3631cbcaed2b None admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:09.122751 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258e836-7988-45b8-87b3-3631cbcaed2b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:09.123056 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258e836-7988-45b8-87b3-3631cbcaed2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:09.124593 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258e836-7988-45b8-87b3-3631cbcaed2b None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:09.163785 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 395/791] 10.222.0.70 () {56 vars in 1149 bytes} [Mon Aug 8 17:33:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:09.169289 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258e836-7988-45b8-87b3-3631cbcaed2b None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:09.187680 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c9556-b1c1-4ee7-b204-f2c9055ab309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:09.188297 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c9556-b1c1-4ee7-b204-f2c9055ab309 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:09.188587 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c9556-b1c1-4ee7-b204-f2c9055ab309 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:09.188860 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c9556-b1c1-4ee7-b204-f2c9055ab309 None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:09.189553 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c9556-b1c1-4ee7-b204-f2c9055ab309 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:09.189995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c9556-b1c1-4ee7-b204-f2c9055ab309 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:09.191547 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c9556-b1c1-4ee7-b204-f2c9055ab309 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:09.201782 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 397/792] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:33:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:09.203336 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc066a7-65c0-4752-99b0-72491be86f52 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:09.203807 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc066a7-65c0-4752-99b0-72491be86f52 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:09.204263 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc066a7-65c0-4752-99b0-72491be86f52 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:09.210173 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 398/793] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:09.210963 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc066a7-65c0-4752-99b0-72491be86f52 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:09.216745 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:09.311288 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258e836-7988-45b8-87b3-3631cbcaed2b None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:09.318710 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc066a7-65c0-4752-99b0-72491be86f52 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:09.350037 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:09.355521 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4a652-7c8e-493c-a39e-10d3b7a2ef70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:09.356248 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4a652-7c8e-493c-a39e-10d3b7a2ef70 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:09.356531 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4a652-7c8e-493c-a39e-10d3b7a2ef70 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:09.356830 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4a652-7c8e-493c-a39e-10d3b7a2ef70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:09.359077 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1e764-2181-433e-a90a-2488eb2d0bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:09.360298 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1e764-2181-433e-a90a-2488eb2d0bd9 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:09.360832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1e764-2181-433e-a90a-2488eb2d0bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:09.361325 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1e764-2181-433e-a90a-2488eb2d0bd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:09.368038 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4a652-7c8e-493c-a39e-10d3b7a2ef70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:09.369536 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4a652-7c8e-493c-a39e-10d3b7a2ef70 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:09.374848 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1e764-2181-433e-a90a-2488eb2d0bd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:09.376950 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1e764-2181-433e-a90a-2488eb2d0bd9 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:09.384567 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-5df4a652-7c8e-493c-a39e-10d3b7a2ef70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:09.384567 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:09.384567 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:09.384567 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:09.384567 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:09.384567 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:09.384567 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:09.384567 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:09.384567 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:09.384567 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:09.384567 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:09.384567 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:09.384567 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:33:09.384567 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:33:09.384567 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:33:09.384567 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:33:09.385560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:09.385560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:09.385560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:09.385560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:09.385560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:09.385560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:09.385560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:09.385560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:09.385560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:09.385560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:09.385560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:09.385560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:09.385560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:09.385560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:09.385560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:09.385560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:09.385560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:33:09.386464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:33:09.386464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:09.386464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:09.386464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 399/794] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:09.387348 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c9c57-a3ca-4a97-b6f5-9f162617a671 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:09.387643 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c9c57-a3ca-4a97-b6f5-9f162617a671 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:09.387988 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c9c57-a3ca-4a97-b6f5-9f162617a671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:09.402471 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-47a1e764-2181-433e-a90a-2488eb2d0bd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:09.402471 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:09.402471 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:09.402471 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:09.402471 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:09.402471 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:09.402471 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:09.402471 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:09.402471 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:09.402471 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:09.402471 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:09.402471 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:09.402471 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:33:09.402471 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:33:09.402471 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:33:09.402471 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:33:09.403481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:09.403481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:09.403481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:09.403481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:09.403481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:09.403481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:09.403481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:09.403481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:09.403481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:09.403481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:09.403481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:09.403481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:09.403481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:09.403481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:09.403481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:09.403481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:09.403481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:33:09.404405 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:33:09.404405 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:09.404405 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:09.406878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 396/795] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:33:09.407876 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1e764-2181-433e-a90a-2488eb2d0bd9 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:09.417203 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-b28c9c57-a3ca-4a97-b6f5-9f162617a671 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:09.418527 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-b28c9c57-a3ca-4a97-b6f5-9f162617a671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:09.509174 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 400/796] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:33:09.510251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c9c57-a3ca-4a97-b6f5-9f162617a671 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:09.522510 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:09.544488 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1e764-2181-433e-a90a-2488eb2d0bd9 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:09.596498 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62188941-c860-410a-82f3-941cb60aafd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:09.597504 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62188941-c860-410a-82f3-941cb60aafd8 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:09.598019 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62188941-c860-410a-82f3-941cb60aafd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:09.598472 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62188941-c860-410a-82f3-941cb60aafd8 None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:09.599589 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62188941-c860-410a-82f3-941cb60aafd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:09.600076 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62188941-c860-410a-82f3-941cb60aafd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:09.602640 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62188941-c860-410a-82f3-941cb60aafd8 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:09.619832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 397/797] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:09.621255 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62188941-c860-410a-82f3-941cb60aafd8 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:09.644342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c9c57-a3ca-4a97-b6f5-9f162617a671 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:09.665118 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:09.693975 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5186dc6-3390-4e4e-ba01-350363d3ce79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:09.695175 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5186dc6-3390-4e4e-ba01-350363d3ce79 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:09.695636 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5186dc6-3390-4e4e-ba01-350363d3ce79 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:09.696325 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5186dc6-3390-4e4e-ba01-350363d3ce79 None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:09.698023 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5186dc6-3390-4e4e-ba01-350363d3ce79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:09.698537 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5186dc6-3390-4e4e-ba01-350363d3ce79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:09.700076 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5186dc6-3390-4e4e-ba01-350363d3ce79 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:09.716041 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 401/798] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:09.717166 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5186dc6-3390-4e4e-ba01-350363d3ce79 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:09.732532 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62188941-c860-410a-82f3-941cb60aafd8 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:09.778636 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6321ea4-5234-4b04-8a2d-5baf3fb33e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:09.780061 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6321ea4-5234-4b04-8a2d-5baf3fb33e4f None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:09.781050 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6321ea4-5234-4b04-8a2d-5baf3fb33e4f None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:09.781508 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6321ea4-5234-4b04-8a2d-5baf3fb33e4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:09.797384 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6321ea4-5234-4b04-8a2d-5baf3fb33e4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:33:09.804562 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-a6321ea4-5234-4b04-8a2d-5baf3fb33e4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:33:09.804562 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:09.804562 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:09.804562 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:09.804562 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:09.804562 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:09.804562 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:09.804562 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:09.804562 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:09.804562 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:09.804562 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:09.804562 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:09.804562 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:33:09.804562 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:33:09.804562 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:33:09.804562 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:33:09.805531 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:33:09.805531 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:33:09.805531 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:33:09.805531 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:33:09.805531 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:09.805531 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:09.805531 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:09.805531 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:09.805531 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:09.805531 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:09.805531 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:09.805531 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:09.805531 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:09.805531 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:09.805531 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:09.805531 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:09.806385 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:09.806385 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:09.806385 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:09.806385 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:09.806385 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:33:09.806385 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:33:09.806385 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:33:09.806385 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:33:09.806385 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:33:09.806385 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:33:09.806385 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:33:09.806385 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:09.806385 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 398/799] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 8 17:33:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:09.807087 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6321ea4-5234-4b04-8a2d-5baf3fb33e4f None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:09.811407 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:09.838592 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5186dc6-3390-4e4e-ba01-350363d3ce79 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:09.878946 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e804d35-7da8-453e-92e5-05d62cc20f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:09.879504 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e804d35-7da8-453e-92e5-05d62cc20f31 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:09.879788 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e804d35-7da8-453e-92e5-05d62cc20f31 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:09.880066 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e804d35-7da8-453e-92e5-05d62cc20f31 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:09.889060 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e804d35-7da8-453e-92e5-05d62cc20f31 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:09.890755 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e804d35-7da8-453e-92e5-05d62cc20f31 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:09.904145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-3e804d35-7da8-453e-92e5-05d62cc20f31 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 08 17:33:09.904145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:09.904145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:09.904145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:09.904145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:09.904145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:09.904145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:09.904145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:09.904145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:09.904145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:09.904145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:09.904145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:09.904145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:33:09.904145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:33:09.904145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:33:09.904145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:33:09.905171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:09.905171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:09.905171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:33:09.905171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:33:09.905171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:33:09.905171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:33:09.905171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:09.905171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:09.905171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:09.905171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:09.905171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:09.905171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:09.905171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:09.905171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:09.905171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:09.905171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:09.905171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:09.905171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:09.906122 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:09.906122 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:09.906122 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:33:09.906122 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:33:09.906122 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:33:09.906122 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:33:09.906122 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:33:09.906122 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:33:09.906122 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 08 17:33:09.906122 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:09.906122 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 402/800] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 8 17:33:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:09.906715 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e804d35-7da8-453e-92e5-05d62cc20f31 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:09.946095 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:09.948324 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6321ea4-5234-4b04-8a2d-5baf3fb33e4f None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:09.983762 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba2ed0-bdfc-4245-ae96-ef99fa4144b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:09.984394 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba2ed0-bdfc-4245-ae96-ef99fa4144b4 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:09.984669 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba2ed0-bdfc-4245-ae96-ef99fa4144b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:09.984948 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba2ed0-bdfc-4245-ae96-ef99fa4144b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:09.991955 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba2ed0-bdfc-4245-ae96-ef99fa4144b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:09.993663 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba2ed0-bdfc-4245-ae96-ef99fa4144b4 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:10.006871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-9eba2ed0-bdfc-4245-ae96-ef99fa4144b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:33:10.006871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:10.006871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:10.006871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:10.006871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:10.006871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:10.006871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:10.006871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:10.006871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:10.006871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:10.006871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:10.006871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:10.006871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:33:10.006871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:33:10.006871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:33:10.007821 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:33:10.007821 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:10.007821 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:10.007821 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:10.007821 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:10.007821 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:10.007821 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:10.007821 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:10.007821 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:10.007821 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:10.007821 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:10.007821 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:10.007821 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:10.007821 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:10.007821 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:10.007821 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:10.007821 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:10.008722 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:33:10.008722 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:33:10.008722 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:33:10.008722 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:33:10.008722 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:33:10.008722 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:33:10.008722 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:33:10.008722 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:10.012754 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 399/801] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:33:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:10.013620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba2ed0-bdfc-4245-ae96-ef99fa4144b4 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:10.020953 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e804d35-7da8-453e-92e5-05d62cc20f31 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:10.057823 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d29f2-fa75-4215-b07e-a502b222ff93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:10.058530 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d29f2-fa75-4215-b07e-a502b222ff93 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:10.058719 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d29f2-fa75-4215-b07e-a502b222ff93 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:10.058993 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d29f2-fa75-4215-b07e-a502b222ff93 None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:10.059657 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d29f2-fa75-4215-b07e-a502b222ff93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:10.059960 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d29f2-fa75-4215-b07e-a502b222ff93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:10.061358 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d29f2-fa75-4215-b07e-a502b222ff93 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:10.070332 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 403/802] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:33:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:10.070332 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe9f0f-6138-4083-b239-020eb01caa85 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:10.070332 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe9f0f-6138-4083-b239-020eb01caa85 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:10.070332 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe9f0f-6138-4083-b239-020eb01caa85 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:10.070332 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 404/803] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:10.070332 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe9f0f-6138-4083-b239-020eb01caa85 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:10.086458 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:10.125884 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba2ed0-bdfc-4245-ae96-ef99fa4144b4 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:10.162606 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d124c-ae42-4281-b6bf-777033f77c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:10.163138 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d124c-ae42-4281-b6bf-777033f77c5b None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:10.163416 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d124c-ae42-4281-b6bf-777033f77c5b None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:10.163691 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d124c-ae42-4281-b6bf-777033f77c5b None admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:10.164415 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d124c-ae42-4281-b6bf-777033f77c5b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:10.164719 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d124c-ae42-4281-b6bf-777033f77c5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:10.166176 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d124c-ae42-4281-b6bf-777033f77c5b None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:10.179422 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:10.184351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 400/804] 10.222.0.70 () {56 vars in 1135 bytes} [Mon Aug 8 17:33:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:10.189082 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d124c-ae42-4281-b6bf-777033f77c5b None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:10.190585 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe9f0f-6138-4083-b239-020eb01caa85 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:10.228374 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66832d7-fcda-4fe8-861f-4b328736a08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:10.228989 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66832d7-fcda-4fe8-861f-4b328736a08b None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:10.229301 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66832d7-fcda-4fe8-861f-4b328736a08b None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:10.229585 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66832d7-fcda-4fe8-861f-4b328736a08b None admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:10.230259 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66832d7-fcda-4fe8-861f-4b328736a08b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:10.230588 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66832d7-fcda-4fe8-861f-4b328736a08b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:10.231983 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66832d7-fcda-4fe8-861f-4b328736a08b None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:10.244674 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 405/805] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 8 17:33:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:10.245906 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a022a-08f2-4d0f-866a-f567472018f2 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:10.246199 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a022a-08f2-4d0f-866a-f567472018f2 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:10.246470 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a022a-08f2-4d0f-866a-f567472018f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:10.264432 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-550a022a-08f2-4d0f-866a-f567472018f2 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:10.265649 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-550a022a-08f2-4d0f-866a-f567472018f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:10.302128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d124c-ae42-4281-b6bf-777033f77c5b None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:10.326374 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:10.333398 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 406/806] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:33:10.334271 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a022a-08f2-4d0f-866a-f567472018f2 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:10.352497 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251040a-a6c3-4967-8c42-779905b012c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:10.353648 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251040a-a6c3-4967-8c42-779905b012c0 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:10.354329 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251040a-a6c3-4967-8c42-779905b012c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:10.354896 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251040a-a6c3-4967-8c42-779905b012c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:10.367775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251040a-a6c3-4967-8c42-779905b012c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:10.369246 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251040a-a6c3-4967-8c42-779905b012c0 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:10.384513 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-3251040a-a6c3-4967-8c42-779905b012c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:10.384513 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:10.384513 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:10.384513 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:10.384513 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:10.384513 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:10.384513 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:10.384513 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:10.384513 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:10.384513 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:10.384513 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:10.384513 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:10.384513 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:33:10.384513 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:33:10.384513 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:33:10.384513 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:33:10.385614 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:10.385614 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:10.385614 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:10.385614 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:10.385614 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:10.385614 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:10.385614 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:10.385614 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:10.385614 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:10.385614 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:10.385614 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:10.385614 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:10.385614 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:10.385614 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:10.385614 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:10.385614 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:10.385614 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:33:10.386534 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:33:10.386534 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:10.386534 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:10.386534 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 401/807] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:10.386534 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251040a-a6c3-4967-8c42-779905b012c0 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:10.433819 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:10.447870 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a022a-08f2-4d0f-866a-f567472018f2 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:10.482670 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e7c81-3ae1-4b9c-bd72-918e9c2b6d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:10.483663 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e7c81-3ae1-4b9c-bd72-918e9c2b6d8e None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:10.483980 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e7c81-3ae1-4b9c-bd72-918e9c2b6d8e None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:10.484264 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e7c81-3ae1-4b9c-bd72-918e9c2b6d8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:10.488375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251040a-a6c3-4967-8c42-779905b012c0 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:10.494394 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e7c81-3ae1-4b9c-bd72-918e9c2b6d8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:10.495833 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e7c81-3ae1-4b9c-bd72-918e9c2b6d8e None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:10.510158 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-645e7c81-3ae1-4b9c-bd72-918e9c2b6d8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:10.510158 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:10.510158 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:10.510158 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:10.510158 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:10.510158 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:10.510158 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:10.510158 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:10.510158 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:10.510158 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:10.510158 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:10.510158 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:10.510158 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:33:10.510158 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:33:10.510158 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:33:10.510158 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:33:10.511146 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:10.511146 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:10.511146 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:10.511146 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:10.511146 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:10.511146 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:10.511146 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:10.511146 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:10.511146 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:10.511146 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:10.511146 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:10.511146 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:10.511146 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:10.511146 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:10.511146 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:10.511146 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:10.511146 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:33:10.512051 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:33:10.512051 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:10.512051 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:10.512051 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 407/808] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:10.512051 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e7c81-3ae1-4b9c-bd72-918e9c2b6d8e None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:10.524129 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b9c0a-02d2-4f56-b8c6-40415d29f720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:10.524782 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b9c0a-02d2-4f56-b8c6-40415d29f720 None admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:10.525105 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b9c0a-02d2-4f56-b8c6-40415d29f720 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:10.525350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b9c0a-02d2-4f56-b8c6-40415d29f720 None admin] PATH_INFO: `/v3/projects/047a28b7cd11486da9d330723a384812/users/c880ab908c114c5897d11aad7fb48607/roles/6d5d281c40dd4e69803141f48615b386` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:10.539706 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b9c0a-02d2-4f56-b8c6-40415d29f720 None admin] RBAC: Authorizing `identity:create_grant(project_id=047a28b7cd11486da9d330723a384812, user_id=c880ab908c114c5897d11aad7fb48607, role_id=6d5d281c40dd4e69803141f48615b386)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:10.541159 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b9c0a-02d2-4f56-b8c6-40415d29f720 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:10.610705 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e7c81-3ae1-4b9c-bd72-918e9c2b6d8e None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:10.616479 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 402/809] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 8 17:33:10 2022] PUT /identity/v3/projects/047a28b7cd11486da9d330723a384812/users/c880ab908c114c5897d11aad7fb48607/roles/6d5d281c40dd4e69803141f48615b386 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:33:10.617151 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b9c0a-02d2-4f56-b8c6-40415d29f720 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:10.645762 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:10.660814 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb92c01-fe06-4385-8d79-1fe26112f607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:10.661498 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb92c01-fe06-4385-8d79-1fe26112f607 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:10.661781 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb92c01-fe06-4385-8d79-1fe26112f607 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:10.662056 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb92c01-fe06-4385-8d79-1fe26112f607 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:10.662719 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb92c01-fe06-4385-8d79-1fe26112f607 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:10.664138 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb92c01-fe06-4385-8d79-1fe26112f607 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:10.678145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-dbb92c01-fe06-4385-8d79-1fe26112f607 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 17:33:10.678145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:10.678145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 17:33:10.678145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 17:33:10.678145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 17:33:10.678145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 17:33:10.678145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 17:33:10.678145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:10.678145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 17:33:10.678145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:10.678145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 17:33:10.678145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:10.678145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:10.678145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:10.678145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:10.678145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:10.678145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:10.685400 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:10.685400 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:10.685400 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:10.685400 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:10.685400 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:10.685400 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:10.685400 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 17:33:10.685400 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 17:33:10.685400 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 17:33:10.685400 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 17:33:10.685400 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:10.685400 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:10.685400 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:10.685400 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:10.685400 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:10.685400 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:10.686332 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:10.686332 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:10.686332 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:10.686332 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:10.686332 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:10.686332 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:10.686332 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:10.686332 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:10.686332 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:10.686332 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:10.686332 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 17:33:10.686332 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:10.686332 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 17:33:10.686332 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:10.686332 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 408/810] 10.222.0.70 () {56 vars in 1129 bytes} [Mon Aug 8 17:33:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:10.687150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03313dce-e0ba-4975-985b-a7515b9e2e33 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:10.687150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03313dce-e0ba-4975-985b-a7515b9e2e33 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:10.687150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03313dce-e0ba-4975-985b-a7515b9e2e33 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:10.687150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 409/811] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:10.687150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03313dce-e0ba-4975-985b-a7515b9e2e33 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:10.688630 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:10.745587 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b9c0a-02d2-4f56-b8c6-40415d29f720 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:10.785372 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9827815-4c00-4b92-b3f1-c18d29d96685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:10.786080 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9827815-4c00-4b92-b3f1-c18d29d96685 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:10.786376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9827815-4c00-4b92-b3f1-c18d29d96685 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:10.786634 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9827815-4c00-4b92-b3f1-c18d29d96685 None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:10.787280 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9827815-4c00-4b92-b3f1-c18d29d96685 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:10.787578 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9827815-4c00-4b92-b3f1-c18d29d96685 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:10.789074 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9827815-4c00-4b92-b3f1-c18d29d96685 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:10.800865 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 403/812] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:10.802073 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9827815-4c00-4b92-b3f1-c18d29d96685 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:10.812590 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03313dce-e0ba-4975-985b-a7515b9e2e33 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:10.851999 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69afb4b4-6d3e-4fb4-b8b9-6b97ea7e5656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:10.852652 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69afb4b4-6d3e-4fb4-b8b9-6b97ea7e5656 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:10.852961 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69afb4b4-6d3e-4fb4-b8b9-6b97ea7e5656 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:10.853168 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69afb4b4-6d3e-4fb4-b8b9-6b97ea7e5656 None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:10.854030 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69afb4b4-6d3e-4fb4-b8b9-6b97ea7e5656 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:10.854162 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69afb4b4-6d3e-4fb4-b8b9-6b97ea7e5656 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:10.855466 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69afb4b4-6d3e-4fb4-b8b9-6b97ea7e5656 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:10.867800 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 410/813] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:10.869055 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b237e-92b6-4b1e-bf6f-26236fcaec69 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:10.869350 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b237e-92b6-4b1e-bf6f-26236fcaec69 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:10.869625 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b237e-92b6-4b1e-bf6f-26236fcaec69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:10.888457 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-e98b237e-92b6-4b1e-bf6f-26236fcaec69 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:10.889791 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-e98b237e-92b6-4b1e-bf6f-26236fcaec69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:10.899704 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:10.918691 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9827815-4c00-4b92-b3f1-c18d29d96685 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:10.950828 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:10.957992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb8977-9bb8-4576-b646-40f4b75c4164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:10.958603 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb8977-9bb8-4576-b646-40f4b75c4164 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:10.958880 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb8977-9bb8-4576-b646-40f4b75c4164 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:10.959148 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb8977-9bb8-4576-b646-40f4b75c4164 None admin] PATH_INFO: `/v3/services` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:10.959775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb8977-9bb8-4576-b646-40f4b75c4164 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:10.960352 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb8977-9bb8-4576-b646-40f4b75c4164 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:10.961599 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb8977-9bb8-4576-b646-40f4b75c4164 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:10.962627 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 411/814] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:33:10.963290 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b237e-92b6-4b1e-bf6f-26236fcaec69 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:10.975551 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 404/815] 10.222.0.70 () {56 vars in 1124 bytes} [Mon Aug 8 17:33:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:10.977078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb8977-9bb8-4576-b646-40f4b75c4164 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:11.070214 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b237e-92b6-4b1e-bf6f-26236fcaec69 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:11.088042 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb8977-9bb8-4576-b646-40f4b75c4164 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:11.108177 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129f291-4256-4894-86e2-d4c52aa7a86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:11.109073 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129f291-4256-4894-86e2-d4c52aa7a86e None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:11.109360 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129f291-4256-4894-86e2-d4c52aa7a86e None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:11.109631 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129f291-4256-4894-86e2-d4c52aa7a86e None admin] PATH_INFO: `/v3/users/nova` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:11.117720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129f291-4256-4894-86e2-d4c52aa7a86e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:11.119194 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129f291-4256-4894-86e2-d4c52aa7a86e None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:11.123994 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43234ed1-de98-43b4-8fed-3b9be9dd8563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:11.124673 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43234ed1-de98-43b4-8fed-3b9be9dd8563 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:11.124950 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43234ed1-de98-43b4-8fed-3b9be9dd8563 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:11.125247 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43234ed1-de98-43b4-8fed-3b9be9dd8563 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:11.131251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-b129f291-4256-4894-86e2-d4c52aa7a86e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 17:33:11.131251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:11.131251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:11.131251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:11.131251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:11.131251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:11.131251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:11.131251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:11.131251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:11.131251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:11.131251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:11.131251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:11.131251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:33:11.131251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:33:11.131251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:33:11.131251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:33:11.132198 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:11.132198 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:11.132198 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:33:11.132198 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:33:11.132198 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:33:11.132198 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:33:11.132198 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:11.132198 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:11.132198 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:11.132198 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:11.132198 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:11.132198 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:11.132198 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:11.132198 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:11.132198 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:11.132198 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:11.132198 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:11.132198 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:11.133225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:11.133225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:11.133225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:33:11.133225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:33:11.133225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:33:11.133225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:33:11.133225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:33:11.133225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:33:11.133225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 17:33:11.133225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:11.133225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 412/816] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Aug 8 17:33:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:11.133225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129f291-4256-4894-86e2-d4c52aa7a86e None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:11.137941 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43234ed1-de98-43b4-8fed-3b9be9dd8563 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:11.139392 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43234ed1-de98-43b4-8fed-3b9be9dd8563 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:11.151210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-43234ed1-de98-43b4-8fed-3b9be9dd8563 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:33:11.151210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:11.151210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:11.151210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:11.151210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:11.151210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:11.151210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:11.151210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:11.151210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:11.151210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:11.151210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:11.151210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:11.151210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:33:11.151210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:33:11.151210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:33:11.154119 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:33:11.154119 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:11.154119 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:11.154119 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:11.154119 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:11.154119 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:11.154119 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:11.154119 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:11.154119 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:11.154119 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:11.154119 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:11.154119 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:11.154119 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:11.154119 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:11.154119 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:11.154119 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:11.154119 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:11.155212 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:33:11.155212 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:33:11.155212 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:33:11.155212 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:33:11.155212 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:33:11.155212 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:33:11.155212 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:33:11.155212 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:11.155212 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 405/817] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:33:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:11.155212 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43234ed1-de98-43b4-8fed-3b9be9dd8563 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:11.165557 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:11.195548 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:11.245063 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129f291-4256-4894-86e2-d4c52aa7a86e None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:11.267027 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43234ed1-de98-43b4-8fed-3b9be9dd8563 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:11.280099 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db45eb9-3d7d-4035-92b4-28a2b9628aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:11.280704 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db45eb9-3d7d-4035-92b4-28a2b9628aa4 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:11.280983 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db45eb9-3d7d-4035-92b4-28a2b9628aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:11.281283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db45eb9-3d7d-4035-92b4-28a2b9628aa4 None admin] PATH_INFO: `/v3/services` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:11.281912 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db45eb9-3d7d-4035-92b4-28a2b9628aa4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:11.282211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db45eb9-3d7d-4035-92b4-28a2b9628aa4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:11.284284 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db45eb9-3d7d-4035-92b4-28a2b9628aa4 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:11.289448 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 413/818] 10.222.0.70 () {56 vars in 1124 bytes} [Mon Aug 8 17:33:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:11.290064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db45eb9-3d7d-4035-92b4-28a2b9628aa4 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:11.316923 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c0419-62b7-402e-b6f6-1b1e2277c395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:11.317583 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c0419-62b7-402e-b6f6-1b1e2277c395 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:11.317860 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c0419-62b7-402e-b6f6-1b1e2277c395 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:11.318130 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c0419-62b7-402e-b6f6-1b1e2277c395 None admin] PATH_INFO: `/v3/services/network` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:11.318707 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c0419-62b7-402e-b6f6-1b1e2277c395 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:11.320060 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c0419-62b7-402e-b6f6-1b1e2277c395 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:11.328937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-808c0419-62b7-402e-b6f6-1b1e2277c395 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 17:33:11.328937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:11.328937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 17:33:11.328937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 17:33:11.328937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 17:33:11.328937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 17:33:11.328937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 17:33:11.328937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:11.328937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 17:33:11.328937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:11.328937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 17:33:11.328937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:11.328937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:11.328937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:11.328937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:11.328937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:11.328937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:11.330040 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:11.330040 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:11.330040 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:11.330040 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:11.330040 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:11.330040 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:11.330040 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 17:33:11.330040 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 17:33:11.330040 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 17:33:11.330040 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 17:33:11.330040 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:11.330040 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:11.330040 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:11.330040 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:11.330040 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:11.330040 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:11.331716 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:11.331716 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:11.331716 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:11.331716 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:11.331716 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:11.331716 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:11.331716 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:11.331716 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:11.331716 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:11.331716 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:11.331716 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 17:33:11.331716 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:11.331716 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 17:33:11.331716 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:11.335612 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 406/819] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:33:11 2022] GET /identity/v3/services/network => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:11.336387 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c0419-62b7-402e-b6f6-1b1e2277c395 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:11.403687 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db45eb9-3d7d-4035-92b4-28a2b9628aa4 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:11.410252 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:11.427680 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:11.441066 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c0419-62b7-402e-b6f6-1b1e2277c395 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:11.445267 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc1857-5bec-43c8-8af9-27f7b24593f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:11.445960 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc1857-5bec-43c8-8af9-27f7b24593f8 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:11.446313 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc1857-5bec-43c8-8af9-27f7b24593f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:11.446655 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc1857-5bec-43c8-8af9-27f7b24593f8 None admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:11.447444 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc1857-5bec-43c8-8af9-27f7b24593f8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:11.447824 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc1857-5bec-43c8-8af9-27f7b24593f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:11.449332 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc1857-5bec-43c8-8af9-27f7b24593f8 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:11.467743 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 414/820] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Aug 8 17:33:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:11.468354 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc1857-5bec-43c8-8af9-27f7b24593f8 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:11.481458 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ff460-14eb-4b1d-b027-59112ebb1845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:11.482058 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ff460-14eb-4b1d-b027-59112ebb1845 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:11.482336 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ff460-14eb-4b1d-b027-59112ebb1845 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:11.482605 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ff460-14eb-4b1d-b027-59112ebb1845 None admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:11.483536 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ff460-14eb-4b1d-b027-59112ebb1845 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:11.483840 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ff460-14eb-4b1d-b027-59112ebb1845 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:11.485284 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ff460-14eb-4b1d-b027-59112ebb1845 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:11.503637 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 407/821] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 8 17:33:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:11.503637 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ff460-14eb-4b1d-b027-59112ebb1845 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:11.577262 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc1857-5bec-43c8-8af9-27f7b24593f8 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:11.602387 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ff460-14eb-4b1d-b027-59112ebb1845 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:11.613923 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d33705-ce2e-48d4-b140-9b836efbb91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:11.614547 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d33705-ce2e-48d4-b140-9b836efbb91a None admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:11.614822 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d33705-ce2e-48d4-b140-9b836efbb91a None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:11.615090 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d33705-ce2e-48d4-b140-9b836efbb91a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:11.615741 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d33705-ce2e-48d4-b140-9b836efbb91a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:11.617109 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d33705-ce2e-48d4-b140-9b836efbb91a None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:11.633849 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:11.639483 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973855f-078a-4296-8e44-afbf05fd66e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:11.640086 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973855f-078a-4296-8e44-afbf05fd66e1 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:11.640386 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973855f-078a-4296-8e44-afbf05fd66e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:11.643570 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973855f-078a-4296-8e44-afbf05fd66e1 None admin] PATH_INFO: `/v3/services` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:11.643570 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973855f-078a-4296-8e44-afbf05fd66e1 None admin] RBAC: Adding query filter params (name=network) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:11.643570 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973855f-078a-4296-8e44-afbf05fd66e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:11.643570 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973855f-078a-4296-8e44-afbf05fd66e1 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:11.647726 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 408/822] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Aug 8 17:33:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:11.648496 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973855f-078a-4296-8e44-afbf05fd66e1 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:11.725862 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 415/823] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:33:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:33:11.727018 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d33705-ce2e-48d4-b140-9b836efbb91a None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:11.770915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973855f-078a-4296-8e44-afbf05fd66e1 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:11.771105 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:11.833899 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38715640-4b42-47fb-a5a4-75542f48b84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:11.835411 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38715640-4b42-47fb-a5a4-75542f48b84a None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:11.836323 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38715640-4b42-47fb-a5a4-75542f48b84a None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:11.836759 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38715640-4b42-47fb-a5a4-75542f48b84a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:11.857009 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d33705-ce2e-48d4-b140-9b836efbb91a None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:11.899293 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2078628e-4c5c-406c-ba66-0d0ff4ce2349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:11.900137 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078628e-4c5c-406c-ba66-0d0ff4ce2349 None admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:11.900524 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078628e-4c5c-406c-ba66-0d0ff4ce2349 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:11.900904 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078628e-4c5c-406c-ba66-0d0ff4ce2349 None admin] PATH_INFO: `/v3/projects/047a28b7cd11486da9d330723a384812/users/67b83ff95ed44f35af2e412a700ca567/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:11.903141 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2078628e-4c5c-406c-ba66-0d0ff4ce2349 None admin] RBAC: Authorizing `identity:create_grant(project_id=047a28b7cd11486da9d330723a384812, user_id=67b83ff95ed44f35af2e412a700ca567, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:11.904847 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2078628e-4c5c-406c-ba66-0d0ff4ce2349 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:11.920054 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:11.933072 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38715640-4b42-47fb-a5a4-75542f48b84a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:11.934606 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38715640-4b42-47fb-a5a4-75542f48b84a None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:11.954797 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 416/824] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 8 17:33:11 2022] PUT /identity/v3/projects/047a28b7cd11486da9d330723a384812/users/67b83ff95ed44f35af2e412a700ca567/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:33:11.956982 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2078628e-4c5c-406c-ba66-0d0ff4ce2349 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:12.088651 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 409/825] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:33:11 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 17:33:12.094411 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38715640-4b42-47fb-a5a4-75542f48b84a None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:12.117502 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:12.138642 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2078628e-4c5c-406c-ba66-0d0ff4ce2349 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:12.201653 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2eba57-3872-4b81-bd6f-2a0e8404656d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:12.202866 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2eba57-3872-4b81-bd6f-2a0e8404656d None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:12.203502 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2eba57-3872-4b81-bd6f-2a0e8404656d None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:12.203982 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2eba57-3872-4b81-bd6f-2a0e8404656d None admin] PATH_INFO: `/v3/services` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:12.204827 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2eba57-3872-4b81-bd6f-2a0e8404656d None admin] RBAC: Adding query filter params (type=network) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:12.206038 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2eba57-3872-4b81-bd6f-2a0e8404656d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:12.207741 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2eba57-3872-4b81-bd6f-2a0e8404656d None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:12.213850 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 417/826] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Aug 8 17:33:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:12.226104 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2eba57-3872-4b81-bd6f-2a0e8404656d None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:12.244102 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:12.255930 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38715640-4b42-47fb-a5a4-75542f48b84a None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:12.301496 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41e705-0103-4b11-bb66-ae4ccd39da49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:12.303044 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41e705-0103-4b11-bb66-ae4ccd39da49 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:12.303505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41e705-0103-4b11-bb66-ae4ccd39da49 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:12.303954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41e705-0103-4b11-bb66-ae4ccd39da49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:12.316319 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41e705-0103-4b11-bb66-ae4ccd39da49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:12.318205 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41e705-0103-4b11-bb66-ae4ccd39da49 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:12.335283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-bf41e705-0103-4b11-bb66-ae4ccd39da49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:12.335283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:12.335283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:12.335283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:12.335283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:12.335283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:12.335283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:12.335283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:12.335283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:12.335283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:12.335283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:12.335283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:12.335283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:33:12.335283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:33:12.335283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:33:12.335283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:33:12.336331 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:12.336331 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:12.336331 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:12.336331 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:12.336331 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:12.336331 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:12.336331 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:12.336331 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:12.336331 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:12.336331 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:12.336331 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:12.336331 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:12.336331 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:12.336331 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:12.336331 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:12.336331 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:12.336331 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:33:12.337265 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:33:12.337265 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:12.337265 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:12.338458 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 410/827] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:33:12.346873 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41e705-0103-4b11-bb66-ae4ccd39da49 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:12.416023 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2eba57-3872-4b81-bd6f-2a0e8404656d None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:12.455897 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a56dc-2e13-4d54-888c-ac2cf25cd028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:12.456874 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a56dc-2e13-4d54-888c-ac2cf25cd028 None admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:12.457502 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a56dc-2e13-4d54-888c-ac2cf25cd028 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:12.458012 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a56dc-2e13-4d54-888c-ac2cf25cd028 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:12.458902 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a56dc-2e13-4d54-888c-ac2cf25cd028 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:12.460473 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a56dc-2e13-4d54-888c-ac2cf25cd028 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:12.547269 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41e705-0103-4b11-bb66-ae4ccd39da49 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:12.566032 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 418/828] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:33:12 2022] POST /identity/v3/endpoints => generated 337 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:33:12.606970 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee7bf3-d22f-4b19-9b0d-f86ccf421342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:12.607934 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee7bf3-d22f-4b19-9b0d-f86ccf421342 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:12.608663 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee7bf3-d22f-4b19-9b0d-f86ccf421342 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:12.609189 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee7bf3-d22f-4b19-9b0d-f86ccf421342 None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:12.610134 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee7bf3-d22f-4b19-9b0d-f86ccf421342 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:12.610681 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee7bf3-d22f-4b19-9b0d-f86ccf421342 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:12.613171 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee7bf3-d22f-4b19-9b0d-f86ccf421342 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:12.629080 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:12.632061 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 411/829] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:12.637833 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a56dc-2e13-4d54-888c-ac2cf25cd028 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:12.656816 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:12.783287 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a56dc-2e13-4d54-888c-ac2cf25cd028 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:12.818824 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f8f90-d30d-4a82-a8c4-83d4dca14a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:12.819463 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f8f90-d30d-4a82-a8c4-83d4dca14a8c None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:12.819743 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f8f90-d30d-4a82-a8c4-83d4dca14a8c None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:12.820017 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f8f90-d30d-4a82-a8c4-83d4dca14a8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:12.827087 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f8f90-d30d-4a82-a8c4-83d4dca14a8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:12.828527 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f8f90-d30d-4a82-a8c4-83d4dca14a8c None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:12.832584 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4de57d-e320-4717-8a1b-171bb238edf5 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:12.833148 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4de57d-e320-4717-8a1b-171bb238edf5 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:12.833621 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4de57d-e320-4717-8a1b-171bb238edf5 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:12.835252 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 412/830] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:12.840464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-a42f8f90-d30d-4a82-a8c4-83d4dca14a8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:33:12.840464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:12.840464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:12.840464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:12.840464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:12.840464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:12.840464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:12.840464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:12.840464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:12.840464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:12.840464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:12.840464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:12.840464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:33:12.840464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:33:12.840464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:33:12.841426 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:33:12.841426 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:12.841426 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:12.841426 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:12.841426 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:12.841426 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:12.841426 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:12.841426 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:12.841426 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:12.841426 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:12.841426 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:12.841426 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:12.841426 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:12.841426 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:12.841426 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:12.841426 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:12.841426 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:12.842334 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:33:12.842334 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:33:12.842334 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:33:12.842334 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:33:12.842334 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:33:12.842334 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:33:12.842334 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:33:12.842334 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:12.842334 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 419/831] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:33:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:12.844832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a1d4b-512b-4c00-bc92-666493cf8df5 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:12.845142 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a1d4b-512b-4c00-bc92-666493cf8df5 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:12.845415 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a1d4b-512b-4c00-bc92-666493cf8df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:12.852650 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f8f90-d30d-4a82-a8c4-83d4dca14a8c None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:12.874724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-487a1d4b-512b-4c00-bc92-666493cf8df5 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:12.875847 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-487a1d4b-512b-4c00-bc92-666493cf8df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:12.938980 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:12.971781 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 413/832] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 17:33:12.977820 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f8f90-d30d-4a82-a8c4-83d4dca14a8c None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:12.995685 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a1d4b-512b-4c00-bc92-666493cf8df5 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:13.016713 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fa22c-0466-4239-854d-7640d39e66ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:13.017725 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fa22c-0466-4239-854d-7640d39e66ba None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:13.018220 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fa22c-0466-4239-854d-7640d39e66ba None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:13.018719 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fa22c-0466-4239-854d-7640d39e66ba None admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:13.019622 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6fa22c-0466-4239-854d-7640d39e66ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:13.020129 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6fa22c-0466-4239-854d-7640d39e66ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:13.021795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6fa22c-0466-4239-854d-7640d39e66ba None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:13.035548 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 420/833] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 8 17:33:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:33:13.041088 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fa22c-0466-4239-854d-7640d39e66ba None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:13.103992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a1d4b-512b-4c00-bc92-666493cf8df5 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:13.134097 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:13.142226 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b6f51-8cf1-46d1-bb2b-3f5cb1cdbcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:13.142954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b6f51-8cf1-46d1-bb2b-3f5cb1cdbcc7 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:13.143264 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b6f51-8cf1-46d1-bb2b-3f5cb1cdbcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:13.144076 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b6f51-8cf1-46d1-bb2b-3f5cb1cdbcc7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:13.154239 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b6f51-8cf1-46d1-bb2b-3f5cb1cdbcc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:33:13.159788 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-630b6f51-8cf1-46d1-bb2b-3f5cb1cdbcc7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:33:13.159788 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:13.159788 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:13.159788 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:13.159788 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:13.159788 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:13.159788 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:13.159788 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:13.159788 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:13.159788 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:13.159788 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:13.159788 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:13.159788 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:33:13.159788 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:33:13.159788 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:33:13.159788 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:33:13.160967 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:33:13.160967 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:33:13.160967 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:33:13.160967 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:33:13.160967 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:13.160967 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:13.160967 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:13.160967 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:13.160967 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:13.160967 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:13.160967 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:13.160967 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:13.160967 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:13.160967 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:13.160967 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:13.160967 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:13.162095 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:13.162095 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:13.162095 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:13.162095 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:13.162095 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:33:13.162095 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:33:13.162095 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:33:13.162095 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:33:13.162095 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:33:13.162095 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:33:13.162095 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:33:13.162095 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:13.163132 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fa22c-0466-4239-854d-7640d39e66ba None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:13.166706 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 414/834] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 8 17:33:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:13.166849 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b6f51-8cf1-46d1-bb2b-3f5cb1cdbcc7 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:13.197894 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:13.204134 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dda72d-fb76-4583-a5a9-609dd2cd35e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:13.205127 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dda72d-fb76-4583-a5a9-609dd2cd35e7 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:13.207047 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dda72d-fb76-4583-a5a9-609dd2cd35e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:13.207047 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dda72d-fb76-4583-a5a9-609dd2cd35e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:13.207720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dda72d-fb76-4583-a5a9-609dd2cd35e7 None admin] RBAC: Adding query filter params (role.id=5c25aa917ab34baabb795c54dd8a4d02, scope.project.id=047a28b7cd11486da9d330723a384812, user.id=3973b8fbfbb9475896e4e110ca8aa615) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:13.208178 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dda72d-fb76-4583-a5a9-609dd2cd35e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:13.209784 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dda72d-fb76-4583-a5a9-609dd2cd35e7 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:13.221360 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 421/835] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:33:13 2022] GET /identity/v3/role_assignments?user.id=3973b8fbfbb9475896e4e110ca8aa615&scope.project.id=047a28b7cd11486da9d330723a384812&role.id=5c25aa917ab34baabb795c54dd8a4d02 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:13.279751 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b6f51-8cf1-46d1-bb2b-3f5cb1cdbcc7 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:13.320211 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2cd83-b6f1-44c0-a84b-51d214d0cec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:13.320840 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2cd83-b6f1-44c0-a84b-51d214d0cec6 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:13.321404 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2cd83-b6f1-44c0-a84b-51d214d0cec6 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:13.321675 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2cd83-b6f1-44c0-a84b-51d214d0cec6 None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:13.322351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b2cd83-b6f1-44c0-a84b-51d214d0cec6 None admin] RBAC: Adding query filter params (name=service) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:13.322651 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b2cd83-b6f1-44c0-a84b-51d214d0cec6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:13.324033 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b2cd83-b6f1-44c0-a84b-51d214d0cec6 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:13.334039 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 415/836] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 8 17:33:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:13.342160 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dda72d-fb76-4583-a5a9-609dd2cd35e7 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:13.463594 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dda72d-fb76-4583-a5a9-609dd2cd35e7 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:13.501183 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7aa1c3-ab3f-4fe5-9f2a-3c0edd850dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:13.501814 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7aa1c3-ab3f-4fe5-9f2a-3c0edd850dfd None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:13.502186 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7aa1c3-ab3f-4fe5-9f2a-3c0edd850dfd None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:13.502464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7aa1c3-ab3f-4fe5-9f2a-3c0edd850dfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:13.514033 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7aa1c3-ab3f-4fe5-9f2a-3c0edd850dfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:13.515483 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7aa1c3-ab3f-4fe5-9f2a-3c0edd850dfd None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:13.530795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-3b7aa1c3-ab3f-4fe5-9f2a-3c0edd850dfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:13.530795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:13.530795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:13.530795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:13.530795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:13.530795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:13.530795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:13.530795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:13.530795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:13.530795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:13.530795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:13.530795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:13.530795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:33:13.530795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:33:13.530795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:33:13.530795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:33:13.531772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:13.531772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:13.531772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:13.531772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:13.531772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:13.531772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:13.531772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:13.531772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:13.531772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:13.531772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:13.531772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:13.531772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:13.531772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:13.531772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:13.531772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:13.531772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:13.531772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:33:13.532689 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:33:13.532689 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:13.532689 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:13.532689 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 422/837] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:13.538790 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2cd83-b6f1-44c0-a84b-51d214d0cec6 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:13.591765 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:13.645009 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2cd83-b6f1-44c0-a84b-51d214d0cec6 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:13.680097 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1552b-4427-4e61-b818-4c579317a399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:13.680672 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1552b-4427-4e61-b818-4c579317a399 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:13.680955 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1552b-4427-4e61-b818-4c579317a399 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:13.681246 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1552b-4427-4e61-b818-4c579317a399 None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:13.681884 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1552b-4427-4e61-b818-4c579317a399 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:13.682182 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1552b-4427-4e61-b818-4c579317a399 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:13.683529 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1552b-4427-4e61-b818-4c579317a399 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:13.696078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 416/838] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:13.701760 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7aa1c3-ab3f-4fe5-9f2a-3c0edd850dfd None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:13.752722 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:13.809420 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7aa1c3-ab3f-4fe5-9f2a-3c0edd850dfd None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:13.844355 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37989604-78d6-4d57-bb9e-1e3c699f053b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:13.845068 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37989604-78d6-4d57-bb9e-1e3c699f053b None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:13.845331 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37989604-78d6-4d57-bb9e-1e3c699f053b None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:13.846121 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37989604-78d6-4d57-bb9e-1e3c699f053b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:13.854240 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37989604-78d6-4d57-bb9e-1e3c699f053b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:13.855678 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37989604-78d6-4d57-bb9e-1e3c699f053b None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:13.867469 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-37989604-78d6-4d57-bb9e-1e3c699f053b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 17:33:13.867469 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:13.867469 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:13.867469 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:13.867469 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:13.867469 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:13.867469 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:13.867469 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:13.867469 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:13.867469 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:13.867469 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:13.867469 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:13.867469 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:33:13.867469 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:33:13.867469 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:33:13.867469 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:33:13.868445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:13.868445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:13.868445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:33:13.868445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:33:13.868445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:33:13.868445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:33:13.868445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:13.868445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:13.868445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:13.868445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:13.868445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:13.868445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:13.868445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:13.868445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:13.868445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:13.868445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:13.868445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:13.868445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:13.869441 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:13.869441 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:13.869441 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:33:13.869441 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:33:13.869441 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:33:13.869441 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:33:13.869441 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:33:13.869441 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:33:13.869441 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 17:33:13.869441 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:13.869441 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 423/839] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Aug 8 17:33:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:33:13.874870 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1552b-4427-4e61-b818-4c579317a399 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:13.987534 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1552b-4427-4e61-b818-4c579317a399 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:13.998598 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:14.022347 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813207f-58ea-4e8e-a842-b6993a3abd8d None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:14.024791 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813207f-58ea-4e8e-a842-b6993a3abd8d None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:14.024791 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813207f-58ea-4e8e-a842-b6993a3abd8d None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:14.025223 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3fb49-7fe7-494f-b71d-e8e36b9b622a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:14.025420 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 424/840] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 17:33:14.025574 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3fb49-7fe7-494f-b71d-e8e36b9b622a None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:14.025574 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3fb49-7fe7-494f-b71d-e8e36b9b622a None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:14.025574 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3fb49-7fe7-494f-b71d-e8e36b9b622a None admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:14.026269 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3fb49-7fe7-494f-b71d-e8e36b9b622a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:14.026583 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3fb49-7fe7-494f-b71d-e8e36b9b622a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:14.028126 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3fb49-7fe7-494f-b71d-e8e36b9b622a None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:14.029671 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3233f3-2ed3-460e-8859-fb8a1a0d2d6f None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:14.029958 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3233f3-2ed3-460e-8859-fb8a1a0d2d6f None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:14.030233 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3233f3-2ed3-460e-8859-fb8a1a0d2d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:14.047158 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 417/841] 10.222.0.70 () {56 vars in 1149 bytes} [Mon Aug 8 17:33:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:14.049840 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-af3233f3-2ed3-460e-8859-fb8a1a0d2d6f None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:14.050739 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-af3233f3-2ed3-460e-8859-fb8a1a0d2d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:14.052758 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3fb49-7fe7-494f-b71d-e8e36b9b622a None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:14.149117 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 425/842] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 17:33:14.166989 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3233f3-2ed3-460e-8859-fb8a1a0d2d6f None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:14.181368 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3fb49-7fe7-494f-b71d-e8e36b9b622a None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:14.208814 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:14.220357 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b78b3-5f91-4344-b4c1-b7d00758ccc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:14.224434 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b78b3-5f91-4344-b4c1-b7d00758ccc3 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:14.224434 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b78b3-5f91-4344-b4c1-b7d00758ccc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:14.224434 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b78b3-5f91-4344-b4c1-b7d00758ccc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:14.261812 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:14.286823 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3233f3-2ed3-460e-8859-fb8a1a0d2d6f None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:14.297731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b78b3-5f91-4344-b4c1-b7d00758ccc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:14.299924 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b78b3-5f91-4344-b4c1-b7d00758ccc3 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:14.326562 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2d0f7-71fc-426d-8a2f-77a04a2cc7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:14.327447 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2d0f7-71fc-426d-8a2f-77a04a2cc7f8 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:14.327930 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2d0f7-71fc-426d-8a2f-77a04a2cc7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:14.328492 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2d0f7-71fc-426d-8a2f-77a04a2cc7f8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:14.329106 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2d0f7-71fc-426d-8a2f-77a04a2cc7f8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:14.330548 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2d0f7-71fc-426d-8a2f-77a04a2cc7f8 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:14.339566 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-d4f2d0f7-71fc-426d-8a2f-77a04a2cc7f8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 17:33:14.339566 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:14.339566 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 17:33:14.339566 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 17:33:14.339566 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 17:33:14.339566 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 17:33:14.339566 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 17:33:14.339566 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:14.339566 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 17:33:14.339566 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:14.339566 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 17:33:14.339566 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:14.339566 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:14.339566 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:14.339566 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:14.339566 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:14.339566 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:14.340577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:14.340577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:14.340577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:14.340577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:14.340577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:14.340577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:14.340577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 17:33:14.340577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 17:33:14.340577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 17:33:14.340577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 17:33:14.340577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:14.340577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:14.340577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:14.340577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:14.340577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:14.340577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:14.341466 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:14.341466 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:14.341466 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:14.341466 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:14.341466 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:14.341466 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:14.341466 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:14.341466 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:14.341466 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:14.341466 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:14.341466 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 17:33:14.341466 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:14.341466 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 17:33:14.341466 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:14.341466 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 426/843] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 8 17:33:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:33:14.342274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573b174-5e0b-423d-9973-42cb5fe6f9e5 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:14.342873 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573b174-5e0b-423d-9973-42cb5fe6f9e5 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:14.342873 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573b174-5e0b-423d-9973-42cb5fe6f9e5 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:14.345081 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 427/844] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:14.346536 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573b174-5e0b-423d-9973-42cb5fe6f9e5 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:14.418908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 418/845] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:33:14 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 08 17:33:14.420341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf4b77-10ef-4349-92a5-c65d8aedb21f None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:14.420623 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf4b77-10ef-4349-92a5-c65d8aedb21f None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:14.420895 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf4b77-10ef-4349-92a5-c65d8aedb21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:14.440414 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-e4cf4b77-10ef-4349-92a5-c65d8aedb21f None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:14.441744 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-e4cf4b77-10ef-4349-92a5-c65d8aedb21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:14.460959 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:14.465201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573b174-5e0b-423d-9973-42cb5fe6f9e5 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:14.508122 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:14.509125 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79766be-2582-4bb8-9ed4-264805a60ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:14.509763 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79766be-2582-4bb8-9ed4-264805a60ca4 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:14.510044 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79766be-2582-4bb8-9ed4-264805a60ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:14.510544 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79766be-2582-4bb8-9ed4-264805a60ca4 None admin] PATH_INFO: `/v3/services` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:14.510937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79766be-2582-4bb8-9ed4-264805a60ca4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:14.511236 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79766be-2582-4bb8-9ed4-264805a60ca4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:14.512652 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79766be-2582-4bb8-9ed4-264805a60ca4 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:14.516974 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 419/846] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:33:14.521160 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf4b77-10ef-4349-92a5-c65d8aedb21f None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:14.522571 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 428/847] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 8 17:33:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:33:14.523526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79766be-2582-4bb8-9ed4-264805a60ca4 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:14.623679 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79766be-2582-4bb8-9ed4-264805a60ca4 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:14.635854 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf4b77-10ef-4349-92a5-c65d8aedb21f None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:14.658543 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d27ed2-ead4-4dc5-aa2b-9899f508195c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:14.659149 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d27ed2-ead4-4dc5-aa2b-9899f508195c None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:14.659453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d27ed2-ead4-4dc5-aa2b-9899f508195c None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:14.659723 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d27ed2-ead4-4dc5-aa2b-9899f508195c None admin] PATH_INFO: `/v3/services` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:14.660347 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d27ed2-ead4-4dc5-aa2b-9899f508195c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:14.660650 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d27ed2-ead4-4dc5-aa2b-9899f508195c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:14.662041 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d27ed2-ead4-4dc5-aa2b-9899f508195c None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:14.675855 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740813de-ced9-476c-b892-7e123f87ca86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:14.676862 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740813de-ced9-476c-b892-7e123f87ca86 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:14.677225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 429/848] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 8 17:33:14 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:14.677634 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740813de-ced9-476c-b892-7e123f87ca86 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:14.678113 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740813de-ced9-476c-b892-7e123f87ca86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:14.678219 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d27ed2-ead4-4dc5-aa2b-9899f508195c None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:14.693275 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740813de-ced9-476c-b892-7e123f87ca86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:14.695356 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740813de-ced9-476c-b892-7e123f87ca86 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:14.713903 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-740813de-ced9-476c-b892-7e123f87ca86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:14.713903 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:14.713903 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:14.713903 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:14.713903 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:14.713903 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:14.713903 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:14.713903 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:14.713903 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:14.713903 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:14.713903 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:14.713903 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:14.713903 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:33:14.713903 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:33:14.713903 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:33:14.713903 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:33:14.715077 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:14.715077 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:14.715077 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:14.715077 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:14.715077 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:14.715077 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:14.715077 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:14.715077 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:14.715077 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:14.715077 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:14.715077 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:14.715077 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:14.715077 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:14.715077 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:14.715077 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:14.715077 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:14.715077 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:33:14.716028 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:33:14.716028 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:14.716028 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:14.717022 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:14.724664 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 420/849] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:14.727282 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740813de-ced9-476c-b892-7e123f87ca86 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:14.789193 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:14.826150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d27ed2-ead4-4dc5-aa2b-9899f508195c None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:14.852835 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740813de-ced9-476c-b892-7e123f87ca86 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:14.876123 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7d2ba-5949-4ec4-9dd6-f8f4d6a5581b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:14.877494 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7d2ba-5949-4ec4-9dd6-f8f4d6a5581b None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:14.878625 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7d2ba-5949-4ec4-9dd6-f8f4d6a5581b None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:14.878968 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7d2ba-5949-4ec4-9dd6-f8f4d6a5581b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:14.891984 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7d2ba-5949-4ec4-9dd6-f8f4d6a5581b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:33:14.895010 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade78152-9e72-42d3-9ee5-1422f8b8d079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:14.895682 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade78152-9e72-42d3-9ee5-1422f8b8d079 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:14.896028 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade78152-9e72-42d3-9ee5-1422f8b8d079 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:14.896368 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade78152-9e72-42d3-9ee5-1422f8b8d079 None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:14.897118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade78152-9e72-42d3-9ee5-1422f8b8d079 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:14.897488 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade78152-9e72-42d3-9ee5-1422f8b8d079 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:14.898912 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade78152-9e72-42d3-9ee5-1422f8b8d079 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:14.899150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-adf7d2ba-5949-4ec4-9dd6-f8f4d6a5581b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:33:14.899150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:14.899150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:14.899150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:14.899150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:14.899150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:14.899150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:14.899150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:14.899150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:14.899150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:14.899150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:14.899150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:14.899150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:33:14.899150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:33:14.899150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:33:14.899150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:33:14.900065 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:33:14.900065 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:33:14.900065 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:33:14.900065 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:33:14.900065 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:14.900065 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:14.900065 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:14.900065 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:14.900065 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:14.900065 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:14.900065 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:14.900065 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:14.900065 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:14.900065 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:14.900065 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:14.900065 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:14.900940 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:14.900940 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:14.900940 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:14.900940 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:14.900940 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:33:14.900940 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:33:14.900940 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:33:14.900940 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:33:14.900940 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:33:14.900940 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:33:14.900940 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:33:14.900940 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:14.903727 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 430/850] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 8 17:33:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:14.910402 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7d2ba-5949-4ec4-9dd6-f8f4d6a5581b None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:14.916325 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 421/851] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:33:14.922505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade78152-9e72-42d3-9ee5-1422f8b8d079 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:15.033686 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:15.053838 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7d2ba-5949-4ec4-9dd6-f8f4d6a5581b None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:15.055778 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade78152-9e72-42d3-9ee5-1422f8b8d079 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:15.069947 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:15.101995 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f39ba1-c882-41e3-89fe-1238abcce9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:15.102205 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68f557-618f-42c1-8b52-d1b66869f7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:15.102730 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68f557-618f-42c1-8b52-d1b66869f7c6 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:15.103013 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68f557-618f-42c1-8b52-d1b66869f7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:15.103281 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68f557-618f-42c1-8b52-d1b66869f7c6 None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:15.103762 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f39ba1-c882-41e3-89fe-1238abcce9e4 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:15.103956 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68f557-618f-42c1-8b52-d1b66869f7c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:15.104239 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68f557-618f-42c1-8b52-d1b66869f7c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:15.104632 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f39ba1-c882-41e3-89fe-1238abcce9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:15.105141 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f39ba1-c882-41e3-89fe-1238abcce9e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:15.105651 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68f557-618f-42c1-8b52-d1b66869f7c6 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:15.115218 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f39ba1-c882-41e3-89fe-1238abcce9e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:15.116953 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f39ba1-c882-41e3-89fe-1238abcce9e4 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:15.121707 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 431/852] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:33:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:33:15.123046 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68f557-618f-42c1-8b52-d1b66869f7c6 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:15.133965 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-07f39ba1-c882-41e3-89fe-1238abcce9e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:33:15.133965 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:15.133965 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:15.133965 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:15.133965 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:15.133965 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:15.133965 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:15.133965 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:15.133965 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:15.133965 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:15.133965 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:15.133965 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:15.133965 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:33:15.133965 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:33:15.133965 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:33:15.134915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:33:15.134915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:15.134915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:15.134915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:15.134915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:15.134915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:15.134915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:15.134915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:15.134915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:15.134915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:15.134915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:15.134915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:15.134915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:15.134915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:15.134915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:15.134915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:15.134915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:15.135827 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:33:15.135827 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:33:15.135827 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:33:15.135827 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:33:15.135827 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:33:15.135827 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:33:15.135827 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:33:15.135827 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:15.143968 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 422/853] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:33:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:15.145809 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f39ba1-c882-41e3-89fe-1238abcce9e4 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:15.252311 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68f557-618f-42c1-8b52-d1b66869f7c6 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:15.274961 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f39ba1-c882-41e3-89fe-1238abcce9e4 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:15.289211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f490a3-2289-4a85-a5ff-4f81cdd6bfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:15.290139 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f490a3-2289-4a85-a5ff-4f81cdd6bfd2 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:15.290671 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f490a3-2289-4a85-a5ff-4f81cdd6bfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:15.291146 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f490a3-2289-4a85-a5ff-4f81cdd6bfd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:15.302573 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f490a3-2289-4a85-a5ff-4f81cdd6bfd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:15.304363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f490a3-2289-4a85-a5ff-4f81cdd6bfd2 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:15.313719 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b91f6-6101-443b-9b4a-6cd3e65477b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:15.315038 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b91f6-6101-443b-9b4a-6cd3e65477b1 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:15.315827 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b91f6-6101-443b-9b4a-6cd3e65477b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:15.316106 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b91f6-6101-443b-9b4a-6cd3e65477b1 None admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:15.316804 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b91f6-6101-443b-9b4a-6cd3e65477b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:15.317128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b91f6-6101-443b-9b4a-6cd3e65477b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:15.318538 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b91f6-6101-443b-9b4a-6cd3e65477b1 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:15.321732 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-a4f490a3-2289-4a85-a5ff-4f81cdd6bfd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:15.321732 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:15.321732 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:15.321732 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:15.321732 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:15.321732 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:15.321732 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:15.321732 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:15.321732 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:15.321732 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:15.321732 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:15.321732 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:15.321732 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:33:15.321732 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:33:15.321732 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:33:15.321732 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:33:15.322693 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:15.322693 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:15.322693 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:15.322693 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:15.322693 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:15.322693 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:15.322693 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:15.322693 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:15.322693 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:15.322693 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:15.322693 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:15.322693 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:15.322693 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:15.322693 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:15.322693 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:15.322693 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:15.322693 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:33:15.323631 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:33:15.323631 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:15.323631 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:15.329412 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 432/854] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:15.332063 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 423/855] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 8 17:33:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:33:15.332530 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f490a3-2289-4a85-a5ff-4f81cdd6bfd2 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:15.338697 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b91f6-6101-443b-9b4a-6cd3e65477b1 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:15.339484 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:15.372983 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:15.450779 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f490a3-2289-4a85-a5ff-4f81cdd6bfd2 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:15.451475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b91f6-6101-443b-9b4a-6cd3e65477b1 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:15.486937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dda9a8-4462-4802-94d4-542ecfda54c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:15.487564 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dda9a8-4462-4802-94d4-542ecfda54c4 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:15.487844 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dda9a8-4462-4802-94d4-542ecfda54c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:15.488100 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dda9a8-4462-4802-94d4-542ecfda54c4 None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:15.488749 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dda9a8-4462-4802-94d4-542ecfda54c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:15.489068 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dda9a8-4462-4802-94d4-542ecfda54c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:15.490422 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dda9a8-4462-4802-94d4-542ecfda54c4 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:15.491536 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4fc34-8e7f-4e33-bdb6-f777c00704b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:15.492304 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4fc34-8e7f-4e33-bdb6-f777c00704b3 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:15.493008 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4fc34-8e7f-4e33-bdb6-f777c00704b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:15.493321 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4fc34-8e7f-4e33-bdb6-f777c00704b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:15.494042 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4fc34-8e7f-4e33-bdb6-f777c00704b3 None admin] RBAC: Adding query filter params (role.id=6d5d281c40dd4e69803141f48615b386, scope.project.id=047a28b7cd11486da9d330723a384812, user.id=c880ab908c114c5897d11aad7fb48607) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:15.494354 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4fc34-8e7f-4e33-bdb6-f777c00704b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:15.495792 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4fc34-8e7f-4e33-bdb6-f777c00704b3 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:15.507248 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 433/856] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:33:15.507248 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6ec99-ef3d-40e8-9bc9-b013ce92e84b None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:15.507248 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6ec99-ef3d-40e8-9bc9-b013ce92e84b None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:15.507248 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6ec99-ef3d-40e8-9bc9-b013ce92e84b None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:15.509398 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 424/857] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:33:15 2022] GET /identity/v3/role_assignments?user.id=c880ab908c114c5897d11aad7fb48607&scope.project.id=047a28b7cd11486da9d330723a384812&role.id=6d5d281c40dd4e69803141f48615b386 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:33:15.509986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 434/858] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:15.511140 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4fc34-8e7f-4e33-bdb6-f777c00704b3 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:15.511374 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64fa48-ecf2-4190-b02f-17029840172d None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:15.511665 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64fa48-ecf2-4190-b02f-17029840172d None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:15.511944 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64fa48-ecf2-4190-b02f-17029840172d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:15.538536 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-9d64fa48-ecf2-4190-b02f-17029840172d None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:15.541063 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-9d64fa48-ecf2-4190-b02f-17029840172d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:15.625179 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:15.632203 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4fc34-8e7f-4e33-bdb6-f777c00704b3 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:15.632707 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:15.648135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 435/859] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:15 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:33:15.671583 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64fa48-ecf2-4190-b02f-17029840172d None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:15.672543 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a1c34-eccb-453e-9f21-d974ab00ec93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:15.673445 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a1c34-eccb-453e-9f21-d974ab00ec93 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:15.675161 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a1c34-eccb-453e-9f21-d974ab00ec93 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:15.676543 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a1c34-eccb-453e-9f21-d974ab00ec93 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:15.686859 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a1c34-eccb-453e-9f21-d974ab00ec93 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:15.690017 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a1c34-eccb-453e-9f21-d974ab00ec93 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:15.703919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-f95a1c34-eccb-453e-9f21-d974ab00ec93 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 08 17:33:15.703919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:15.703919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:15.703919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:15.703919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:15.703919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:15.703919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:15.703919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:15.703919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:15.703919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:15.703919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:15.703919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:15.703919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:33:15.703919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:33:15.703919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:33:15.703919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:33:15.706177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:15.706177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:15.706177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:33:15.706177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:33:15.706177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:33:15.706177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:33:15.706177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:15.706177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:15.706177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:15.706177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:15.706177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:15.706177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:15.706177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:15.706177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:15.706177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:15.706177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:15.706177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:15.706177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:15.707440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:15.707440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:15.707440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:33:15.707440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:33:15.707440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:33:15.707440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:33:15.707440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:33:15.707440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:33:15.707440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 08 17:33:15.707440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:15.707440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 425/860] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 8 17:33:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:15.711659 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a1c34-eccb-453e-9f21-d974ab00ec93 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:15.798304 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64fa48-ecf2-4190-b02f-17029840172d None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:15.834278 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a1c34-eccb-453e-9f21-d974ab00ec93 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:15.839435 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efecc3-5e9d-4779-997f-f2e1e792e0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:15.840400 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efecc3-5e9d-4779-997f-f2e1e792e0bd None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:15.840893 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efecc3-5e9d-4779-997f-f2e1e792e0bd None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:15.841397 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efecc3-5e9d-4779-997f-f2e1e792e0bd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:15.842187 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11efecc3-5e9d-4779-997f-f2e1e792e0bd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:15.843785 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11efecc3-5e9d-4779-997f-f2e1e792e0bd None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:15.855723 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-11efecc3-5e9d-4779-997f-f2e1e792e0bd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 17:33:15.855723 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:15.855723 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 17:33:15.855723 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 17:33:15.855723 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 17:33:15.855723 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 17:33:15.855723 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 17:33:15.855723 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:15.855723 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 17:33:15.855723 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:15.855723 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 17:33:15.855723 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:15.855723 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:15.855723 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:15.855723 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:15.855723 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:15.856751 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:15.856751 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:15.856751 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:15.856751 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:15.856751 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:15.856751 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:15.856751 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:15.856751 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 17:33:15.856751 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 17:33:15.856751 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 17:33:15.856751 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 17:33:15.856751 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:15.856751 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:15.856751 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:15.856751 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:15.856751 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:15.856751 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:15.857777 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:15.857777 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:15.857777 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:15.857777 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:15.857777 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:15.857777 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:15.857777 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:15.857777 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:15.857777 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:15.857777 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:15.857777 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 17:33:15.857777 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:15.857777 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 17:33:15.857777 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:15.861119 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 436/861] 10.222.0.70 () {56 vars in 1132 bytes} [Mon Aug 8 17:33:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:33:15.866967 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efecc3-5e9d-4779-997f-f2e1e792e0bd None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:15.879330 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e43088-5eee-46c0-94ed-80ca3d0ed1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:15.880254 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e43088-5eee-46c0-94ed-80ca3d0ed1b8 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:15.880741 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e43088-5eee-46c0-94ed-80ca3d0ed1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:15.881294 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e43088-5eee-46c0-94ed-80ca3d0ed1b8 None admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:15.882234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e43088-5eee-46c0-94ed-80ca3d0ed1b8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:15.882768 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e43088-5eee-46c0-94ed-80ca3d0ed1b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:15.884634 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e43088-5eee-46c0-94ed-80ca3d0ed1b8 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:15.904539 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 426/862] 10.222.0.70 () {56 vars in 1135 bytes} [Mon Aug 8 17:33:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:15.914138 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e43088-5eee-46c0-94ed-80ca3d0ed1b8 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:15.927123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:15.932363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:15.981370 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efecc3-5e9d-4779-997f-f2e1e792e0bd None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:16.016908 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215736a-962d-43b4-b9f5-aac51b70c33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:16.018220 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215736a-962d-43b4-b9f5-aac51b70c33e None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:16.018603 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215736a-962d-43b4-b9f5-aac51b70c33e None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:16.018979 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215736a-962d-43b4-b9f5-aac51b70c33e None admin] PATH_INFO: `/v3/services` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:16.019728 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215736a-962d-43b4-b9f5-aac51b70c33e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:16.020133 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215736a-962d-43b4-b9f5-aac51b70c33e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:16.021655 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215736a-962d-43b4-b9f5-aac51b70c33e None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:16.031133 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 437/863] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Aug 8 17:33:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:33:16.031277 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e43088-5eee-46c0-94ed-80ca3d0ed1b8 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:16.032151 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215736a-962d-43b4-b9f5-aac51b70c33e None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:16.076546 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfbca3-3756-4e7a-9c65-e540cda65531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:16.077433 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfbca3-3756-4e7a-9c65-e540cda65531 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:16.077860 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfbca3-3756-4e7a-9c65-e540cda65531 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:16.078311 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfbca3-3756-4e7a-9c65-e540cda65531 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:16.144963 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215736a-962d-43b4-b9f5-aac51b70c33e None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:16.154505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfbca3-3756-4e7a-9c65-e540cda65531 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:16.156249 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfbca3-3756-4e7a-9c65-e540cda65531 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:16.166308 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:16.173388 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:16.181142 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06841f6-db4e-4f4a-b786-6f378025691a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:16.181866 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06841f6-db4e-4f4a-b786-6f378025691a None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:16.182279 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06841f6-db4e-4f4a-b786-6f378025691a None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:16.182686 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06841f6-db4e-4f4a-b786-6f378025691a None admin] PATH_INFO: `/v3/services` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:16.183412 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06841f6-db4e-4f4a-b786-6f378025691a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:16.183815 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06841f6-db4e-4f4a-b786-6f378025691a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:16.185347 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06841f6-db4e-4f4a-b786-6f378025691a None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:16.196732 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 438/864] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Aug 8 17:33:16 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:16.272727 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 427/865] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:33:15 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 17:33:16.282214 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06841f6-db4e-4f4a-b786-6f378025691a None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:16.400950 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06841f6-db4e-4f4a-b786-6f378025691a None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:16.441597 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c6671-7549-4cb5-828c-01387551924d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:16.442472 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c6671-7549-4cb5-828c-01387551924d None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:16.442902 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c6671-7549-4cb5-828c-01387551924d None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:16.443350 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c6671-7549-4cb5-828c-01387551924d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:16.454605 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c6671-7549-4cb5-828c-01387551924d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:16.456695 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c6671-7549-4cb5-828c-01387551924d None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:16.471523 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-1b6c6671-7549-4cb5-828c-01387551924d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:16.471523 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:16.471523 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:16.471523 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:16.471523 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:16.471523 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:16.471523 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:16.471523 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:16.471523 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:16.471523 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:16.471523 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:16.471523 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:16.471523 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:33:16.471523 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:33:16.471523 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:33:16.471523 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:33:16.472708 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:16.472708 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:16.472708 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:16.472708 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:16.472708 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:16.472708 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:16.472708 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:16.472708 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:16.472708 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:16.472708 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:16.472708 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:16.472708 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:16.472708 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:16.472708 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:16.472708 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:16.472708 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:16.472708 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:33:16.473850 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:33:16.473850 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:16.473850 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:16.475531 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 439/866] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:16.481368 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfbca3-3756-4e7a-9c65-e540cda65531 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:16.587938 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfbca3-3756-4e7a-9c65-e540cda65531 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:16.601494 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:16.623855 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9516d1-f245-42b7-82c6-f38eb795abec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:16.624518 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9516d1-f245-42b7-82c6-f38eb795abec None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:16.624799 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9516d1-f245-42b7-82c6-f38eb795abec None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:16.625135 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9516d1-f245-42b7-82c6-f38eb795abec None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:16.625846 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9516d1-f245-42b7-82c6-f38eb795abec None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:16.626152 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9516d1-f245-42b7-82c6-f38eb795abec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:16.627821 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9516d1-f245-42b7-82c6-f38eb795abec None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:16.640587 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 428/867] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:16.647958 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c6671-7549-4cb5-828c-01387551924d None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:16.685086 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:16.755323 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c6671-7549-4cb5-828c-01387551924d None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:16.759602 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c6400-0eef-4281-8619-41a6236362b4 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:16.759891 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c6400-0eef-4281-8619-41a6236362b4 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:16.760170 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c6400-0eef-4281-8619-41a6236362b4 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:16.762989 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 429/868] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 17:33:16.767107 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecee8a-6d20-44d0-b5da-ddc87f969607 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:16.767953 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecee8a-6d20-44d0-b5da-ddc87f969607 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:16.768226 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecee8a-6d20-44d0-b5da-ddc87f969607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:16.788448 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-30ecee8a-6d20-44d0-b5da-ddc87f969607 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:16.789694 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-30ecee8a-6d20-44d0-b5da-ddc87f969607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:16.793352 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9acb87-241c-431a-96ca-41a3164f7fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:16.794225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9acb87-241c-431a-96ca-41a3164f7fdc None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:16.794687 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9acb87-241c-431a-96ca-41a3164f7fdc None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:16.795139 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9acb87-241c-431a-96ca-41a3164f7fdc None admin] PATH_INFO: `/v3/projects/service` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:16.803154 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9acb87-241c-431a-96ca-41a3164f7fdc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:16.804955 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9acb87-241c-431a-96ca-41a3164f7fdc None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:16.817357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-ab9acb87-241c-431a-96ca-41a3164f7fdc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:33:16.817357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:16.817357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:16.817357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:16.817357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:16.817357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:16.817357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:16.817357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:16.817357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:16.817357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:16.817357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:16.817357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:16.817357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:33:16.817357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:33:16.817357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:33:16.818274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:33:16.818274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:16.818274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:16.818274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:16.818274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:16.818274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:16.818274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:16.818274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:16.818274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:16.818274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:16.818274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:16.818274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:16.818274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:16.818274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:16.818274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:16.818274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:16.818274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:16.819193 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:33:16.819193 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:33:16.819193 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:33:16.819193 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:33:16.819193 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:33:16.819193 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:33:16.819193 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:33:16.819193 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:16.821525 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 440/869] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:33:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:16.827293 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9acb87-241c-431a-96ca-41a3164f7fdc None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:16.873154 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 430/870] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 17:33:16.891058 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ecee8a-6d20-44d0-b5da-ddc87f969607 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:16.934396 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:16.941406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9acb87-241c-431a-96ca-41a3164f7fdc None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:16.983615 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3673b-a1cd-4000-b4e5-045ed39d4640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:16.984453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3673b-a1cd-4000-b4e5-045ed39d4640 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:16.984791 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3673b-a1cd-4000-b4e5-045ed39d4640 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:16.985102 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3673b-a1cd-4000-b4e5-045ed39d4640 None admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:16.986209 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3673b-a1cd-4000-b4e5-045ed39d4640 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:16.986999 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3673b-a1cd-4000-b4e5-045ed39d4640 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:16.988750 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3673b-a1cd-4000-b4e5-045ed39d4640 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:17.006660 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ecee8a-6d20-44d0-b5da-ddc87f969607 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:17.007165 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 441/871] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 8 17:33:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:33:17.013208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3673b-a1cd-4000-b4e5-045ed39d4640 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:17.014160 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:17.051597 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fbb0c-538f-44f4-a12e-70e1fbc08b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:17.053019 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fbb0c-538f-44f4-a12e-70e1fbc08b01 None admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:17.053473 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fbb0c-538f-44f4-a12e-70e1fbc08b01 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:17.053918 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fbb0c-538f-44f4-a12e-70e1fbc08b01 None admin] PATH_INFO: `/v3/services` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:17.054721 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8fbb0c-538f-44f4-a12e-70e1fbc08b01 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:17.056246 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8fbb0c-538f-44f4-a12e-70e1fbc08b01 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:17.122124 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 431/872] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Aug 8 17:33:16 2022] POST /identity/v3/services => generated 251 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:33:17.135303 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3673b-a1cd-4000-b4e5-045ed39d4640 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:17.193468 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09708f5e-2aa8-4f65-a951-46ac15e9fbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:17.194791 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09708f5e-2aa8-4f65-a951-46ac15e9fbd5 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:17.195236 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09708f5e-2aa8-4f65-a951-46ac15e9fbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:17.195660 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09708f5e-2aa8-4f65-a951-46ac15e9fbd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:17.196554 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09708f5e-2aa8-4f65-a951-46ac15e9fbd5 None admin] RBAC: Adding query filter params (role.id=5c25aa917ab34baabb795c54dd8a4d02, scope.project.id=047a28b7cd11486da9d330723a384812, user.id=67b83ff95ed44f35af2e412a700ca567) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:17.197389 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09708f5e-2aa8-4f65-a951-46ac15e9fbd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:17.199138 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09708f5e-2aa8-4f65-a951-46ac15e9fbd5 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:17.207610 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 442/873] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:33:17 2022] GET /identity/v3/role_assignments?user.id=67b83ff95ed44f35af2e412a700ca567&scope.project.id=047a28b7cd11486da9d330723a384812&role.id=5c25aa917ab34baabb795c54dd8a4d02 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:33:17.785426 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c397a-d228-4712-b2f7-16403bb30ffe None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:17.785829 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c397a-d228-4712-b2f7-16403bb30ffe None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:17.786025 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c397a-d228-4712-b2f7-16403bb30ffe None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:17.787619 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 432/874] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:17.793058 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f173957-5202-4961-84fe-8334ea303e6e None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:17.793354 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f173957-5202-4961-84fe-8334ea303e6e None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:17.793634 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f173957-5202-4961-84fe-8334ea303e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:17.813804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-9f173957-5202-4961-84fe-8334ea303e6e None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:17.815536 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-9f173957-5202-4961-84fe-8334ea303e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:17.827103 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:17.888956 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 443/875] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:17 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:33:17.913652 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c397a-d228-4712-b2f7-16403bb30ffe None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:18.022103 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c397a-d228-4712-b2f7-16403bb30ffe None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:18.057944 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1daf00-a007-4892-b37c-45d61e00ab2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:18.058492 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1daf00-a007-4892-b37c-45d61e00ab2a None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:18.058775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1daf00-a007-4892-b37c-45d61e00ab2a None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:18.059050 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1daf00-a007-4892-b37c-45d61e00ab2a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:18.070814 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1daf00-a007-4892-b37c-45d61e00ab2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:33:18.075741 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-7c1daf00-a007-4892-b37c-45d61e00ab2a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 17:33:18.075741 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:18.075741 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:18.075741 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:18.075741 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:18.075741 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:18.075741 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:18.075741 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:18.075741 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:18.075741 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:18.075741 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:18.075741 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:18.075741 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:33:18.075741 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:33:18.075741 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:33:18.075741 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:33:18.076683 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:33:18.076683 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:33:18.076683 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:33:18.076683 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:33:18.076683 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:18.076683 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:18.076683 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:18.076683 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:18.076683 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:18.076683 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:18.076683 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:18.076683 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:18.076683 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:18.076683 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:18.076683 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:18.076683 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:18.077604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:18.077604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:18.077604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:18.077604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:18.077604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:33:18.077604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:33:18.077604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:33:18.077604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:33:18.077604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:33:18.077604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:33:18.077604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 17:33:18.077604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:18.077604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 433/876] 10.222.0.70 () {56 vars in 1120 bytes} [Mon Aug 8 17:33:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:18.084205 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f173957-5202-4961-84fe-8334ea303e6e None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:18.191139 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f173957-5202-4961-84fe-8334ea303e6e None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:18.228212 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8741c2-972d-4ad3-9033-3ccde4ebb305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:18.228961 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8741c2-972d-4ad3-9033-3ccde4ebb305 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:18.229143 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8741c2-972d-4ad3-9033-3ccde4ebb305 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:18.229383 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8741c2-972d-4ad3-9033-3ccde4ebb305 None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:18.230052 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8741c2-972d-4ad3-9033-3ccde4ebb305 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:18.230359 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8741c2-972d-4ad3-9033-3ccde4ebb305 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:18.231795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8741c2-972d-4ad3-9033-3ccde4ebb305 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:18.241117 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 444/877] 10.222.0.70 () {56 vars in 1115 bytes} [Mon Aug 8 17:33:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:18.246725 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1daf00-a007-4892-b37c-45d61e00ab2a None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:18.281449 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:18.303621 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95c3a1-3d22-496a-a392-27a75e18967e None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:18.303955 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95c3a1-3d22-496a-a392-27a75e18967e None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:18.304501 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95c3a1-3d22-496a-a392-27a75e18967e None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:18.308502 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 445/878] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:18.313679 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018b345-f258-40f0-b658-ac079bcf3371 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:18.314894 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018b345-f258-40f0-b658-ac079bcf3371 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:18.315573 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018b345-f258-40f0-b658-ac079bcf3371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:18.335064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-a018b345-f258-40f0-b658-ac079bcf3371 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:18.336573 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-a018b345-f258-40f0-b658-ac079bcf3371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:18.339087 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:18.372220 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1daf00-a007-4892-b37c-45d61e00ab2a None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:18.420631 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 446/879] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:18 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 17:33:18.425767 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4daafe0-d0d1-4279-8e53-79f9b7d3de88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:18.426639 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4daafe0-d0d1-4279-8e53-79f9b7d3de88 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:18.427139 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4daafe0-d0d1-4279-8e53-79f9b7d3de88 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:18.427634 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4daafe0-d0d1-4279-8e53-79f9b7d3de88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:18.438485 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4daafe0-d0d1-4279-8e53-79f9b7d3de88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:18.440976 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4daafe0-d0d1-4279-8e53-79f9b7d3de88 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:18.446129 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018b345-f258-40f0-b658-ac079bcf3371 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:18.466775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-d4daafe0-d0d1-4279-8e53-79f9b7d3de88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:18.466775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:18.466775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:18.466775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:18.466775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:18.466775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:18.466775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:18.466775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:18.466775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:18.466775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:18.466775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:18.466775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:18.466775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:33:18.466775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:33:18.466775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:33:18.466775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:33:18.467771 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:18.467771 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:18.467771 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:18.467771 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:18.467771 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:18.467771 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:18.467771 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:18.467771 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:18.467771 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:18.467771 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:18.467771 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:18.467771 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:18.467771 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:18.467771 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:18.467771 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:18.467771 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:18.467771 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:33:18.468684 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:33:18.468684 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:18.468684 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:18.471564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 434/880] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:18.476751 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4daafe0-d0d1-4279-8e53-79f9b7d3de88 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:18.560368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018b345-f258-40f0-b658-ac079bcf3371 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:18.575042 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:18.600641 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a22679-d339-42bb-99f1-db649204562d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:18.601627 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a22679-d339-42bb-99f1-db649204562d None admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:18.602118 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a22679-d339-42bb-99f1-db649204562d None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:18.602592 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a22679-d339-42bb-99f1-db649204562d None admin] PATH_INFO: `/v3/services` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:18.603466 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a22679-d339-42bb-99f1-db649204562d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:18.604460 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4daafe0-d0d1-4279-8e53-79f9b7d3de88 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:18.605303 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a22679-d339-42bb-99f1-db649204562d None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:18.642702 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cafbdf6-5910-4a01-bcaa-ee6249ed341a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:18.643368 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafbdf6-5910-4a01-bcaa-ee6249ed341a None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:18.643653 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafbdf6-5910-4a01-bcaa-ee6249ed341a None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:18.643928 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafbdf6-5910-4a01-bcaa-ee6249ed341a None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:18.644621 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cafbdf6-5910-4a01-bcaa-ee6249ed341a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:18.644945 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cafbdf6-5910-4a01-bcaa-ee6249ed341a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:18.646407 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cafbdf6-5910-4a01-bcaa-ee6249ed341a None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:18.664005 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 435/881] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:33:18.665073 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cafbdf6-5910-4a01-bcaa-ee6249ed341a None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:18.697352 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:18.707014 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 447/882] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Aug 8 17:33:18 2022] POST /identity/v3/services => generated 269 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:33:18.783170 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cafbdf6-5910-4a01-bcaa-ee6249ed341a None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:18.823991 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:18.831361 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e56418-19bc-4278-aaeb-eab96bac33ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:18.832380 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e56418-19bc-4278-aaeb-eab96bac33ca None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:18.832881 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e56418-19bc-4278-aaeb-eab96bac33ca None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:18.833381 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e56418-19bc-4278-aaeb-eab96bac33ca None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:18.841912 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e56418-19bc-4278-aaeb-eab96bac33ca None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:18.843756 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e56418-19bc-4278-aaeb-eab96bac33ca None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:18.857123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-e4e56418-19bc-4278-aaeb-eab96bac33ca None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 17:33:18.857123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:18.857123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:18.857123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:18.857123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:18.857123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:18.857123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:18.857123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:18.857123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:18.857123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:18.857123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:18.857123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:18.857123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:33:18.857123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:33:18.857123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:33:18.857123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:33:18.858428 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:18.858428 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:18.858428 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:33:18.858428 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:33:18.858428 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:33:18.858428 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:33:18.858428 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:18.858428 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:18.858428 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:18.858428 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:18.858428 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:18.858428 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:18.858428 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:18.858428 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:18.858428 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:18.858428 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:18.858428 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:18.858428 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:18.859391 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:18.859391 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:18.859391 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:33:18.859391 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:33:18.859391 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:33:18.859391 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:33:18.859391 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:33:18.859391 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:33:18.859391 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 17:33:18.859391 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:18.862705 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 436/883] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Aug 8 17:33:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:18.868764 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a22679-d339-42bb-99f1-db649204562d None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:18.977725 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a22679-d339-42bb-99f1-db649204562d None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:19.014793 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce63a49-4bcb-450f-a154-3eaf5c5661b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:19.015409 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce63a49-4bcb-450f-a154-3eaf5c5661b5 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:19.015693 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce63a49-4bcb-450f-a154-3eaf5c5661b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:19.015967 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce63a49-4bcb-450f-a154-3eaf5c5661b5 None admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:19.017522 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce63a49-4bcb-450f-a154-3eaf5c5661b5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:19.018367 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce63a49-4bcb-450f-a154-3eaf5c5661b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:19.019872 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce63a49-4bcb-450f-a154-3eaf5c5661b5 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:19.038416 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 448/884] 10.222.0.70 () {56 vars in 1149 bytes} [Mon Aug 8 17:33:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:19.043988 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e56418-19bc-4278-aaeb-eab96bac33ca None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:19.150142 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e56418-19bc-4278-aaeb-eab96bac33ca None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:19.185128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944de9b-2398-43b6-8c88-63d283940562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:19.186108 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944de9b-2398-43b6-8c88-63d283940562 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:19.186589 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944de9b-2398-43b6-8c88-63d283940562 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:19.187092 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944de9b-2398-43b6-8c88-63d283940562 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:19.224896 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99931118-8e5e-41b8-b25f-941c4c7613d3 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:19.225139 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99931118-8e5e-41b8-b25f-941c4c7613d3 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:19.225454 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99931118-8e5e-41b8-b25f-941c4c7613d3 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:19.228036 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 449/885] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 17:33:19.232322 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f91f9-d58f-4eaf-93d2-e22bb81222f1 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:19.233184 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f91f9-d58f-4eaf-93d2-e22bb81222f1 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:19.233184 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f91f9-d58f-4eaf-93d2-e22bb81222f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:19.253756 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-831f91f9-d58f-4eaf-93d2-e22bb81222f1 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:19.255054 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-831f91f9-d58f-4eaf-93d2-e22bb81222f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:19.259504 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:19.263158 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944de9b-2398-43b6-8c88-63d283940562 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:19.264736 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944de9b-2398-43b6-8c88-63d283940562 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:19.313289 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:19.339455 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 450/886] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:19 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 17:33:19.341784 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1090ae-17a8-4e12-b66c-ecd30f6082bf None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:19.342472 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1090ae-17a8-4e12-b66c-ecd30f6082bf None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:19.343196 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1090ae-17a8-4e12-b66c-ecd30f6082bf None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:19.349467 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 451/887] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:19.351177 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886926c9-0d83-48db-b581-36d2dc05f660 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:19.352327 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886926c9-0d83-48db-b581-36d2dc05f660 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:19.352861 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886926c9-0d83-48db-b581-36d2dc05f660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:19.374236 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-886926c9-0d83-48db-b581-36d2dc05f660 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:19.375791 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-886926c9-0d83-48db-b581-36d2dc05f660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:19.384140 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 437/888] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:33:19 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 17:33:19.385368 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944de9b-2398-43b6-8c88-63d283940562 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:19.461082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 452/889] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:19 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:33:19.461465 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886926c9-0d83-48db-b581-36d2dc05f660 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:19.494699 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:19.507166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944de9b-2398-43b6-8c88-63d283940562 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:19.551050 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf2573-02ed-4d53-97d8-4a3a48f8cada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:19.551675 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf2573-02ed-4d53-97d8-4a3a48f8cada None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:19.551952 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf2573-02ed-4d53-97d8-4a3a48f8cada None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:19.552223 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf2573-02ed-4d53-97d8-4a3a48f8cada None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:19.552803 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf2573-02ed-4d53-97d8-4a3a48f8cada None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:19.554189 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf2573-02ed-4d53-97d8-4a3a48f8cada None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:19.562708 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-4bdf2573-02ed-4d53-97d8-4a3a48f8cada None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 17:33:19.562708 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:19.562708 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 17:33:19.562708 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 17:33:19.562708 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 17:33:19.562708 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 17:33:19.562708 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 17:33:19.562708 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:19.562708 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 17:33:19.562708 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:19.562708 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 17:33:19.562708 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:19.562708 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:19.562708 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:19.562708 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:19.562708 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:19.562708 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:19.563888 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:19.563888 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:19.563888 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:19.563888 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:19.563888 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:19.563888 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:19.563888 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 17:33:19.563888 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 17:33:19.563888 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 17:33:19.563888 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 17:33:19.563888 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:19.563888 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:19.563888 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:19.563888 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:19.563888 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:19.563888 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:19.565340 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:19.565340 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:19.565340 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:19.565340 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:19.565340 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:19.565340 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:19.565340 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:19.565340 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:19.565340 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:19.565340 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:19.565340 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 17:33:19.565340 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:19.565340 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 17:33:19.565340 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:19.565340 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 438/890] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 8 17:33:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:19.566241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf2573-02ed-4d53-97d8-4a3a48f8cada None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:19.590810 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886926c9-0d83-48db-b581-36d2dc05f660 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:19.609999 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:19.628779 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0082774-6422-4df9-9aa2-fbb1bbc25e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:19.629441 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0082774-6422-4df9-9aa2-fbb1bbc25e44 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:19.629723 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0082774-6422-4df9-9aa2-fbb1bbc25e44 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:19.629996 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0082774-6422-4df9-9aa2-fbb1bbc25e44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:19.639837 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0082774-6422-4df9-9aa2-fbb1bbc25e44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:19.641330 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0082774-6422-4df9-9aa2-fbb1bbc25e44 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:19.656765 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-d0082774-6422-4df9-9aa2-fbb1bbc25e44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:19.656765 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:19.656765 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:19.656765 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:19.656765 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:19.656765 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:19.656765 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:19.656765 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:19.656765 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:19.656765 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:19.656765 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:19.656765 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:19.656765 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:33:19.656765 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:33:19.656765 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:33:19.656765 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:33:19.658684 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:19.658684 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:19.658684 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:19.658684 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:19.658684 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:19.658684 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:19.658684 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:19.658684 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:19.658684 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:19.658684 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:19.658684 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:19.658684 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:19.658684 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:19.658684 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:19.658684 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:19.658684 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:19.658684 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:33:19.660084 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:33:19.660084 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:19.660084 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:19.660084 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 453/891] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:19.660084 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0082774-6422-4df9-9aa2-fbb1bbc25e44 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:19.680852 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf2573-02ed-4d53-97d8-4a3a48f8cada None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:19.714200 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45ae7e-3a0a-4bf5-8ece-0938a535a07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:19.714818 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45ae7e-3a0a-4bf5-8ece-0938a535a07b None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:19.715093 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45ae7e-3a0a-4bf5-8ece-0938a535a07b None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:19.715371 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45ae7e-3a0a-4bf5-8ece-0938a535a07b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:19.715944 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45ae7e-3a0a-4bf5-8ece-0938a535a07b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:19.717331 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45ae7e-3a0a-4bf5-8ece-0938a535a07b None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:19.726371 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-dd45ae7e-3a0a-4bf5-8ece-0938a535a07b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 17:33:19.726371 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:19.726371 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 17:33:19.726371 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 17:33:19.726371 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 17:33:19.726371 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 17:33:19.726371 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 17:33:19.726371 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:19.726371 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 17:33:19.726371 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:19.726371 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 17:33:19.726371 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:19.726371 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:19.726371 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:19.726371 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:19.726371 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:19.726371 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:19.727376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:19.727376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:19.727376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:19.727376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:19.727376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:19.727376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:19.727376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 17:33:19.727376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 17:33:19.727376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 17:33:19.727376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 17:33:19.727376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:19.727376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:19.727376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:19.727376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:19.727376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:19.727376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:19.728228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:19.728228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:19.728228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:19.728228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:19.728228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:19.728228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:19.728228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:19.728228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:19.728228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:19.728228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:19.728228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 17:33:19.728228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:19.728228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 17:33:19.728228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:19.728228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 439/892] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Aug 8 17:33:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:19.729073 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45ae7e-3a0a-4bf5-8ece-0938a535a07b None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:19.752659 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:19.774950 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0082774-6422-4df9-9aa2-fbb1bbc25e44 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:19.810605 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891e8dd-5b3c-489d-82da-b605498f5314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:19.811709 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891e8dd-5b3c-489d-82da-b605498f5314 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:19.811709 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891e8dd-5b3c-489d-82da-b605498f5314 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:19.811895 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891e8dd-5b3c-489d-82da-b605498f5314 None admin] PATH_INFO: `/v3/services` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:19.812431 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891e8dd-5b3c-489d-82da-b605498f5314 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:19.812731 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891e8dd-5b3c-489d-82da-b605498f5314 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:19.814654 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891e8dd-5b3c-489d-82da-b605498f5314 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:19.819525 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 454/893] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 8 17:33:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:19.820199 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891e8dd-5b3c-489d-82da-b605498f5314 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:19.853131 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45ae7e-3a0a-4bf5-8ece-0938a535a07b None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:19.854111 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:19.889812 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55ec1c-3088-47b9-9acb-b5b8602b9799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:19.890592 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55ec1c-3088-47b9-9acb-b5b8602b9799 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:19.890874 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55ec1c-3088-47b9-9acb-b5b8602b9799 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:19.891640 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55ec1c-3088-47b9-9acb-b5b8602b9799 None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:19.892382 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55ec1c-3088-47b9-9acb-b5b8602b9799 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:19.892906 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55ec1c-3088-47b9-9acb-b5b8602b9799 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:19.894511 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55ec1c-3088-47b9-9acb-b5b8602b9799 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:19.906916 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 440/894] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:19.908170 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55ec1c-3088-47b9-9acb-b5b8602b9799 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:19.934215 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891e8dd-5b3c-489d-82da-b605498f5314 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:19.970849 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85b3e6-2723-4a97-8234-18e17a1b4206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:19.971565 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85b3e6-2723-4a97-8234-18e17a1b4206 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:19.971758 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85b3e6-2723-4a97-8234-18e17a1b4206 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:19.971980 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85b3e6-2723-4a97-8234-18e17a1b4206 None admin] PATH_INFO: `/v3/services` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:19.972609 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85b3e6-2723-4a97-8234-18e17a1b4206 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:19.972913 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85b3e6-2723-4a97-8234-18e17a1b4206 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:19.974447 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85b3e6-2723-4a97-8234-18e17a1b4206 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:19.979176 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 455/895] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Aug 8 17:33:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:19.984659 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85b3e6-2723-4a97-8234-18e17a1b4206 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:20.004377 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:20.026421 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55ec1c-3088-47b9-9acb-b5b8602b9799 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:20.066920 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9811f40-aa95-44d7-9cc8-aadc2719101c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:20.067539 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9811f40-aa95-44d7-9cc8-aadc2719101c None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:20.067803 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9811f40-aa95-44d7-9cc8-aadc2719101c None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:20.068048 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9811f40-aa95-44d7-9cc8-aadc2719101c None admin] PATH_INFO: `/v3/services` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:20.068705 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9811f40-aa95-44d7-9cc8-aadc2719101c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:20.068960 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9811f40-aa95-44d7-9cc8-aadc2719101c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:20.070345 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9811f40-aa95-44d7-9cc8-aadc2719101c None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:20.075803 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 441/896] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 8 17:33:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:20.076924 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9811f40-aa95-44d7-9cc8-aadc2719101c None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:20.094738 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:20.101716 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85b3e6-2723-4a97-8234-18e17a1b4206 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:20.137357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc31b8c-aad1-4ab9-9866-e316a4211251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:20.137984 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc31b8c-aad1-4ab9-9866-e316a4211251 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:20.138267 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc31b8c-aad1-4ab9-9866-e316a4211251 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:20.138541 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc31b8c-aad1-4ab9-9866-e316a4211251 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:20.146183 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc31b8c-aad1-4ab9-9866-e316a4211251 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:20.147611 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc31b8c-aad1-4ab9-9866-e316a4211251 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:20.160110 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-acc31b8c-aad1-4ab9-9866-e316a4211251 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:33:20.160110 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:20.160110 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:20.160110 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:20.160110 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:20.160110 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:20.160110 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:20.160110 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:20.160110 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:20.160110 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:20.160110 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:20.160110 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:20.160110 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:33:20.160110 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:33:20.160110 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:33:20.161211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:33:20.161211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:20.161211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:20.161211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:20.161211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:20.161211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:20.161211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:20.161211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:20.161211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:20.161211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:20.161211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:20.161211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:20.161211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:20.161211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:20.161211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:20.161211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:20.161211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:20.162137 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:33:20.162137 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:33:20.162137 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:33:20.162137 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:33:20.162137 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:33:20.162137 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:33:20.162137 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:33:20.162137 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:20.162137 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 456/897] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:33:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:20.162661 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc31b8c-aad1-4ab9-9866-e316a4211251 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:20.192544 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9811f40-aa95-44d7-9cc8-aadc2719101c None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:20.230102 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8081abf-c4fb-437a-9203-0f1aeda8e0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:20.230943 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8081abf-c4fb-437a-9203-0f1aeda8e0e0 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:20.231378 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8081abf-c4fb-437a-9203-0f1aeda8e0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:20.231820 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8081abf-c4fb-437a-9203-0f1aeda8e0e0 None admin] PATH_INFO: `/v3/services` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:20.232750 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8081abf-c4fb-437a-9203-0f1aeda8e0e0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:20.233502 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8081abf-c4fb-437a-9203-0f1aeda8e0e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:20.234867 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8081abf-c4fb-437a-9203-0f1aeda8e0e0 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:20.249061 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 442/898] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Aug 8 17:33:20 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:20.249061 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8081abf-c4fb-437a-9203-0f1aeda8e0e0 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:20.263722 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:20.279560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc31b8c-aad1-4ab9-9866-e316a4211251 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:20.320394 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec8720-175e-4978-b7a9-b9ba18d42cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:20.321392 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec8720-175e-4978-b7a9-b9ba18d42cd7 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:20.321891 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec8720-175e-4978-b7a9-b9ba18d42cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:20.322381 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec8720-175e-4978-b7a9-b9ba18d42cd7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:20.323270 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec8720-175e-4978-b7a9-b9ba18d42cd7 None admin] RBAC: Adding query filter params (interface=public, service_id=0cab081b5ee147db9272c4e6445cae24, region_id=RegionOne) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:20.323743 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec8720-175e-4978-b7a9-b9ba18d42cd7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:20.325364 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec8720-175e-4978-b7a9-b9ba18d42cd7 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:20.332025 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 457/899] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Aug 8 17:33:20 2022] GET /identity/v3/endpoints?service_id=0cab081b5ee147db9272c4e6445cae24&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:20.338328 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec8720-175e-4978-b7a9-b9ba18d42cd7 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:20.366671 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:20.387400 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8081abf-c4fb-437a-9203-0f1aeda8e0e0 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:20.441419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff808557-7f66-4956-8f58-fbb7b6f199a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:20.442424 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff808557-7f66-4956-8f58-fbb7b6f199a7 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:20.443038 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff808557-7f66-4956-8f58-fbb7b6f199a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:20.443447 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff808557-7f66-4956-8f58-fbb7b6f199a7 None admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:20.444641 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff808557-7f66-4956-8f58-fbb7b6f199a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:20.445623 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff808557-7f66-4956-8f58-fbb7b6f199a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:20.447468 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff808557-7f66-4956-8f58-fbb7b6f199a7 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:20.465356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec8720-175e-4978-b7a9-b9ba18d42cd7 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:20.465608 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 443/900] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 8 17:33:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:20.471392 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff808557-7f66-4956-8f58-fbb7b6f199a7 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:20.515507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afca775-2900-475e-828e-720b1a4a8d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:20.516116 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afca775-2900-475e-828e-720b1a4a8d68 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:20.516394 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afca775-2900-475e-828e-720b1a4a8d68 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:20.516664 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afca775-2900-475e-828e-720b1a4a8d68 None admin] PATH_INFO: `/v3/services` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:20.517891 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afca775-2900-475e-828e-720b1a4a8d68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:20.519831 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afca775-2900-475e-828e-720b1a4a8d68 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:20.528189 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 458/901] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Aug 8 17:33:20 2022] GET /identity/v3/services => generated 1268 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:33:20.553788 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:20.593923 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff808557-7f66-4956-8f58-fbb7b6f199a7 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:20.633782 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87793f2-aad0-44fc-b81f-40f9bb92b877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:20.634489 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87793f2-aad0-44fc-b81f-40f9bb92b877 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:20.634833 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87793f2-aad0-44fc-b81f-40f9bb92b877 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:20.635170 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87793f2-aad0-44fc-b81f-40f9bb92b877 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:20.635985 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87793f2-aad0-44fc-b81f-40f9bb92b877 None admin] RBAC: Adding query filter params (role.id=b0560db9df8a46708b8b37d306895467, scope.project.id=047a28b7cd11486da9d330723a384812, user.id=c880ab908c114c5897d11aad7fb48607) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:20.636361 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87793f2-aad0-44fc-b81f-40f9bb92b877 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:20.637969 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87793f2-aad0-44fc-b81f-40f9bb92b877 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:20.645470 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 444/902] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:33:20 2022] GET /identity/v3/role_assignments?user.id=c880ab908c114c5897d11aad7fb48607&scope.project.id=047a28b7cd11486da9d330723a384812&role.id=b0560db9df8a46708b8b37d306895467 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:20.854483 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aef184-11e4-40ee-81da-0481def62ff7 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:20.854667 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aef184-11e4-40ee-81da-0481def62ff7 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:20.854950 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aef184-11e4-40ee-81da-0481def62ff7 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:20.856535 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 459/903] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:20.862463 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe79fc-9ed0-4a39-88ef-cbea39ea241e None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:20.862747 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe79fc-9ed0-4a39-88ef-cbea39ea241e None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:20.863022 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe79fc-9ed0-4a39-88ef-cbea39ea241e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:20.881915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-d0fe79fc-9ed0-4a39-88ef-cbea39ea241e None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:20.883109 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-d0fe79fc-9ed0-4a39-88ef-cbea39ea241e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:20.953691 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 445/904] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:20 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:33:20.976047 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aef184-11e4-40ee-81da-0481def62ff7 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:21.071133 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:21.088519 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aef184-11e4-40ee-81da-0481def62ff7 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:21.125271 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d4c2a-020f-4573-8bc4-bc0b702b2b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:21.125271 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d4c2a-020f-4573-8bc4-bc0b702b2b8c None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:21.125271 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d4c2a-020f-4573-8bc4-bc0b702b2b8c None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:21.125271 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d4c2a-020f-4573-8bc4-bc0b702b2b8c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:21.125846 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d4c2a-020f-4573-8bc4-bc0b702b2b8c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:21.127815 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d4c2a-020f-4573-8bc4-bc0b702b2b8c None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:21.136477 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-ec7d4c2a-020f-4573-8bc4-bc0b702b2b8c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 17:33:21.136477 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:21.136477 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 17:33:21.136477 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 17:33:21.136477 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 17:33:21.136477 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 17:33:21.136477 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 17:33:21.136477 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:21.136477 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 17:33:21.136477 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:21.136477 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 17:33:21.136477 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:21.136477 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:21.136477 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:21.136477 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:21.136477 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:21.137489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:21.137489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:21.137489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:21.137489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:21.137489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:21.137489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:21.137489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:21.137489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 17:33:21.137489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 17:33:21.137489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 17:33:21.137489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 17:33:21.137489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:21.137489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:21.137489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:21.137489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:21.137489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:21.137489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:21.138385 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:21.138385 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:21.138385 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:21.138385 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:21.138385 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:21.138385 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:21.138385 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:21.138385 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:21.138385 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:21.138385 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:21.138385 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 17:33:21.138385 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:21.138385 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 17:33:21.138385 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:21.138385 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 460/905] 10.222.0.70 () {56 vars in 1132 bytes} [Mon Aug 8 17:33:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:21.144154 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe79fc-9ed0-4a39-88ef-cbea39ea241e None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:21.210461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:21.257774 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe79fc-9ed0-4a39-88ef-cbea39ea241e None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:21.293988 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af6188-1764-4639-a57d-6de53d4884c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:21.294924 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af6188-1764-4639-a57d-6de53d4884c0 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:21.295387 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af6188-1764-4639-a57d-6de53d4884c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:21.295869 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af6188-1764-4639-a57d-6de53d4884c0 None admin] PATH_INFO: `/v3/services` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:21.296730 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29af6188-1764-4639-a57d-6de53d4884c0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:21.297244 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29af6188-1764-4639-a57d-6de53d4884c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:21.299299 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29af6188-1764-4639-a57d-6de53d4884c0 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:21.304749 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 446/906] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Aug 8 17:33:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:21.310229 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d4c2a-020f-4573-8bc4-bc0b702b2b8c None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:21.422161 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d4c2a-020f-4573-8bc4-bc0b702b2b8c None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:21.458235 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0eda1-4d5f-4c75-8277-d4df604e3ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:21.458879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0eda1-4d5f-4c75-8277-d4df604e3ab9 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:21.459158 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0eda1-4d5f-4c75-8277-d4df604e3ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:21.459430 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0eda1-4d5f-4c75-8277-d4df604e3ab9 None admin] PATH_INFO: `/v3/services` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:21.460085 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd0eda1-4d5f-4c75-8277-d4df604e3ab9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:21.460389 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd0eda1-4d5f-4c75-8277-d4df604e3ab9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:21.461845 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd0eda1-4d5f-4c75-8277-d4df604e3ab9 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:21.467786 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 461/907] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Aug 8 17:33:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:21.474031 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af6188-1764-4639-a57d-6de53d4884c0 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:21.579472 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af6188-1764-4639-a57d-6de53d4884c0 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:21.608250 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:21.620029 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d8fbc-532f-4b87-aef1-b25b33debf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:21.620628 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d8fbc-532f-4b87-aef1-b25b33debf1d None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:21.620906 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d8fbc-532f-4b87-aef1-b25b33debf1d None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:21.621201 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d8fbc-532f-4b87-aef1-b25b33debf1d None admin] PATH_INFO: `/v3/endpoints` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:21.621899 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d8fbc-532f-4b87-aef1-b25b33debf1d None admin] RBAC: Adding query filter params (interface=public, service_id=e0b855c1fdc241bb8646207abf47dac6, region_id=RegionOne) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:21.622204 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d8fbc-532f-4b87-aef1-b25b33debf1d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:21.623562 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d8fbc-532f-4b87-aef1-b25b33debf1d None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:21.628838 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 447/908] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Aug 8 17:33:21 2022] GET /identity/v3/endpoints?service_id=e0b855c1fdc241bb8646207abf47dac6&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:21.641191 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0eda1-4d5f-4c75-8277-d4df604e3ab9 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:21.649784 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:21.740779 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0eda1-4d5f-4c75-8277-d4df604e3ab9 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:21.775794 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0776aa-3d3b-454c-a11a-7b9440840d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:21.776402 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0776aa-3d3b-454c-a11a-7b9440840d42 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:21.776686 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0776aa-3d3b-454c-a11a-7b9440840d42 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:21.776961 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0776aa-3d3b-454c-a11a-7b9440840d42 None admin] PATH_INFO: `/v3/services` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:21.777594 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0776aa-3d3b-454c-a11a-7b9440840d42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:21.778965 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0776aa-3d3b-454c-a11a-7b9440840d42 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:21.785667 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 462/909] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Aug 8 17:33:21 2022] GET /identity/v3/services => generated 1268 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:33:22.397122 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504732e-becd-45ca-8055-6bda2bc22b01 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:22.397819 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504732e-becd-45ca-8055-6bda2bc22b01 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:22.397819 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504732e-becd-45ca-8055-6bda2bc22b01 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:22.399234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 448/910] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:22.406421 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04aa27-0560-4269-8c08-572b07fb8a74 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:22.406919 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04aa27-0560-4269-8c08-572b07fb8a74 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:22.407942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04aa27-0560-4269-8c08-572b07fb8a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:22.426820 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-ab04aa27-0560-4269-8c08-572b07fb8a74 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:22.428086 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-ab04aa27-0560-4269-8c08-572b07fb8a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:22.499095 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 463/911] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:22 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:33:22.521869 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504732e-becd-45ca-8055-6bda2bc22b01 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:22.629815 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504732e-becd-45ca-8055-6bda2bc22b01 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:22.654831 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907b95f-3f34-4fd7-8247-6b30cd0b4436 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:22.655433 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907b95f-3f34-4fd7-8247-6b30cd0b4436 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:22.655950 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907b95f-3f34-4fd7-8247-6b30cd0b4436 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:22.661130 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 464/912] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:22.663643 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191196c-4e08-4042-a5f6-86a1006e25e6 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:22.664238 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191196c-4e08-4042-a5f6-86a1006e25e6 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:22.664719 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191196c-4e08-4042-a5f6-86a1006e25e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:22.665977 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860f3d9-8ba9-4e82-80f6-c5610b0b571c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:22.666574 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860f3d9-8ba9-4e82-80f6-c5610b0b571c None admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:22.666848 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860f3d9-8ba9-4e82-80f6-c5610b0b571c None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:22.667120 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860f3d9-8ba9-4e82-80f6-c5610b0b571c None admin] PATH_INFO: `/v3/services` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:22.667814 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860f3d9-8ba9-4e82-80f6-c5610b0b571c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:22.669245 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860f3d9-8ba9-4e82-80f6-c5610b0b571c None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:22.679876 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:22.686034 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-a191196c-4e08-4042-a5f6-86a1006e25e6 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:22.687439 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-a191196c-4e08-4042-a5f6-86a1006e25e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:22.755005 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 449/913] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Aug 8 17:33:22 2022] POST /identity/v3/services => generated 241 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:33:22.770061 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 465/914] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 17:33:22.771421 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c5a29-e441-4d9e-a3c8-193c754b9c42 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:22.771710 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c5a29-e441-4d9e-a3c8-193c754b9c42 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:22.771982 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c5a29-e441-4d9e-a3c8-193c754b9c42 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:22.773674 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 450/915] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 17:33:22.779304 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a4827-94b7-4b44-b14f-0a4a7ff4136f None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:22.779612 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a4827-94b7-4b44-b14f-0a4a7ff4136f None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:22.779871 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a4827-94b7-4b44-b14f-0a4a7ff4136f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:22.795250 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c5a29-e441-4d9e-a3c8-193c754b9c42 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:22.802019 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-833a4827-94b7-4b44-b14f-0a4a7ff4136f None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:22.803240 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-833a4827-94b7-4b44-b14f-0a4a7ff4136f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:22.867484 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:22.889215 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 466/916] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:33:22.910079 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a4827-94b7-4b44-b14f-0a4a7ff4136f None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:22.943468 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c5a29-e441-4d9e-a3c8-193c754b9c42 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:22.985365 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e790d-e913-4b9e-a6b5-69b2c2501bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:22.986144 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e790d-e913-4b9e-a6b5-69b2c2501bb2 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:22.986413 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e790d-e913-4b9e-a6b5-69b2c2501bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:22.986730 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e790d-e913-4b9e-a6b5-69b2c2501bb2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:22.987320 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e790d-e913-4b9e-a6b5-69b2c2501bb2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:22.988677 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e790d-e913-4b9e-a6b5-69b2c2501bb2 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:22.989283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:22.997872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-2e1e790d-e913-4b9e-a6b5-69b2c2501bb2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 17:33:22.997872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:22.997872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 17:33:22.997872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 17:33:22.997872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 17:33:22.997872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 17:33:22.997872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 17:33:22.997872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:22.997872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 17:33:22.997872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:22.997872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 17:33:22.997872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:22.997872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:22.997872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:22.997872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:22.997872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:22.997872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:23.005782 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:23.005782 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:23.005782 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:23.005782 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:23.005782 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:23.005782 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:23.005782 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 17:33:23.005782 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 17:33:23.005782 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 17:33:23.005782 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 17:33:23.005782 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:23.005782 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:23.005782 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:23.005782 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:23.005782 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:23.005782 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:23.006674 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:23.006674 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:23.006674 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:23.006674 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:23.006674 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:23.006674 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:23.006674 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:23.006674 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:23.006674 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:23.006674 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:23.006674 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 17:33:23.006674 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:23.006674 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 17:33:23.006674 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:23.006674 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 451/917] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 8 17:33:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:33:23.010221 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e790d-e913-4b9e-a6b5-69b2c2501bb2 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:23.039549 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a4827-94b7-4b44-b14f-0a4a7ff4136f None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:23.080669 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9298ac5-fc15-493a-b505-7d1afbf70008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:23.081659 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9298ac5-fc15-493a-b505-7d1afbf70008 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:23.082253 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9298ac5-fc15-493a-b505-7d1afbf70008 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:23.082529 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9298ac5-fc15-493a-b505-7d1afbf70008 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:23.094186 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9298ac5-fc15-493a-b505-7d1afbf70008 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:33:23.100135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-d9298ac5-fc15-493a-b505-7d1afbf70008 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 17:33:23.100135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:23.100135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:23.100135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:23.100135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:23.100135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:23.100135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:23.100135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:23.100135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:23.100135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:23.100135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:23.100135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:23.100135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:33:23.100135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:33:23.100135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:33:23.100135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:33:23.101166 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:33:23.101166 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:33:23.101166 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:33:23.101166 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:33:23.101166 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:23.101166 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:23.101166 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:23.101166 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:23.101166 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:23.101166 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:23.101166 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:23.101166 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:23.101166 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:23.101166 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:23.101166 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:23.101166 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:23.102039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:23.102039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:23.102039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:23.102039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:23.102039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:33:23.102039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:33:23.102039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:33:23.102039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:33:23.102039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:33:23.102039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:33:23.102039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 17:33:23.102039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:23.102039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 467/918] 10.222.0.70 () {56 vars in 1120 bytes} [Mon Aug 8 17:33:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:33:23.108686 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9298ac5-fc15-493a-b505-7d1afbf70008 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:23.141215 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e790d-e913-4b9e-a6b5-69b2c2501bb2 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:23.156513 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:23.180664 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1789e-6108-4693-8f92-064a1c1925db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:23.181375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1789e-6108-4693-8f92-064a1c1925db None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:23.181754 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1789e-6108-4693-8f92-064a1c1925db None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:23.182166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1789e-6108-4693-8f92-064a1c1925db None admin] PATH_INFO: `/v3/services` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:23.183470 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1789e-6108-4693-8f92-064a1c1925db None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:23.183907 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1789e-6108-4693-8f92-064a1c1925db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:23.185992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1789e-6108-4693-8f92-064a1c1925db None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:23.193389 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 452/919] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 8 17:33:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:23.198810 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1789e-6108-4693-8f92-064a1c1925db None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:23.247150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9298ac5-fc15-493a-b505-7d1afbf70008 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:23.278047 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:23.293973 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96e8be-3e2d-4bda-9ed6-adb93cdc9fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:23.295105 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96e8be-3e2d-4bda-9ed6-adb93cdc9fd8 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:23.295567 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96e8be-3e2d-4bda-9ed6-adb93cdc9fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:23.296225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96e8be-3e2d-4bda-9ed6-adb93cdc9fd8 None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:23.297482 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad96e8be-3e2d-4bda-9ed6-adb93cdc9fd8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:23.298740 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad96e8be-3e2d-4bda-9ed6-adb93cdc9fd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:23.300960 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad96e8be-3e2d-4bda-9ed6-adb93cdc9fd8 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:23.303887 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1789e-6108-4693-8f92-064a1c1925db None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:23.316503 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 468/920] 10.222.0.70 () {56 vars in 1115 bytes} [Mon Aug 8 17:33:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:23.319193 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96e8be-3e2d-4bda-9ed6-adb93cdc9fd8 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:23.343348 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7549180-e338-4273-81d6-9f3dbe46d43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:23.343953 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7549180-e338-4273-81d6-9f3dbe46d43e None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:23.344232 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7549180-e338-4273-81d6-9f3dbe46d43e None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:23.344503 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7549180-e338-4273-81d6-9f3dbe46d43e None admin] PATH_INFO: `/v3/services` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:23.345491 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7549180-e338-4273-81d6-9f3dbe46d43e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:23.345795 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7549180-e338-4273-81d6-9f3dbe46d43e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:23.347168 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7549180-e338-4273-81d6-9f3dbe46d43e None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:23.357010 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 453/921] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 8 17:33:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:33:23.358619 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7549180-e338-4273-81d6-9f3dbe46d43e None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:23.425419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:23.452741 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96e8be-3e2d-4bda-9ed6-adb93cdc9fd8 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:23.466013 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7549180-e338-4273-81d6-9f3dbe46d43e None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:23.500890 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1284d5-4b97-4de9-a806-0829857b25bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:23.501711 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1284d5-4b97-4de9-a806-0829857b25bd None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:23.502035 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1284d5-4b97-4de9-a806-0829857b25bd None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:23.502317 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1284d5-4b97-4de9-a806-0829857b25bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:23.506030 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00a6f5-52c6-46a8-bb27-85888045158a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:23.506915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00a6f5-52c6-46a8-bb27-85888045158a None admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:23.507401 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00a6f5-52c6-46a8-bb27-85888045158a None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:23.507953 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00a6f5-52c6-46a8-bb27-85888045158a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:23.508838 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00a6f5-52c6-46a8-bb27-85888045158a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:23.510442 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00a6f5-52c6-46a8-bb27-85888045158a None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:23.514719 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1284d5-4b97-4de9-a806-0829857b25bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:23.516340 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1284d5-4b97-4de9-a806-0829857b25bd None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:23.533593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-9e1284d5-4b97-4de9-a806-0829857b25bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:23.533593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:23.533593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:23.533593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:23.533593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:23.533593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:23.533593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:23.533593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:23.533593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:23.533593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:23.533593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:23.533593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:23.533593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:33:23.533593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:33:23.533593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:33:23.533593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:33:23.538603 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:23.538603 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:23.538603 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:23.538603 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:23.538603 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:23.538603 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:23.538603 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:23.538603 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:23.538603 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:23.538603 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:23.538603 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:23.538603 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:23.538603 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:23.538603 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:23.538603 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:23.538603 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:23.538603 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:33:23.539869 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:33:23.539869 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:23.539869 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:23.539869 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 469/922] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:23.540415 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1284d5-4b97-4de9-a806-0829857b25bd None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:23.579449 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:23.592740 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 454/923] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:33:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:33:23.663088 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1284d5-4b97-4de9-a806-0829857b25bd None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:23.706998 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce9367-d477-4e7b-b5db-063f2a1e81ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:23.707872 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce9367-d477-4e7b-b5db-063f2a1e81ca None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:23.708313 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce9367-d477-4e7b-b5db-063f2a1e81ca None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:23.708739 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce9367-d477-4e7b-b5db-063f2a1e81ca None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:23.709575 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ce9367-d477-4e7b-b5db-063f2a1e81ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:23.710102 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ce9367-d477-4e7b-b5db-063f2a1e81ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:23.711731 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ce9367-d477-4e7b-b5db-063f2a1e81ca None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:23.730762 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 470/924] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:23.732536 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00a6f5-52c6-46a8-bb27-85888045158a None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:23.838208 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:23.845552 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00a6f5-52c6-46a8-bb27-85888045158a None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:23.877948 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5421745-f914-4f7c-8425-f651ef565d7a None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:23.878273 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5421745-f914-4f7c-8425-f651ef565d7a None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:23.878493 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5421745-f914-4f7c-8425-f651ef565d7a None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:23.879962 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 471/925] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 17:33:23.884668 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177de7c0-7a6d-4196-b91a-88aec7195003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:23.884937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a1112-71bb-46c9-b1c3-5940765833cd None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:23.885249 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a1112-71bb-46c9-b1c3-5940765833cd None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:23.885345 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177de7c0-7a6d-4196-b91a-88aec7195003 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:23.885522 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a1112-71bb-46c9-b1c3-5940765833cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:23.885616 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177de7c0-7a6d-4196-b91a-88aec7195003 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:23.885881 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177de7c0-7a6d-4196-b91a-88aec7195003 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:23.895240 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177de7c0-7a6d-4196-b91a-88aec7195003 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:23.896989 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177de7c0-7a6d-4196-b91a-88aec7195003 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:23.905371 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-203a1112-71bb-46c9-b1c3-5940765833cd None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:23.907877 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-203a1112-71bb-46c9-b1c3-5940765833cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:23.913351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-177de7c0-7a6d-4196-b91a-88aec7195003 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 17:33:23.913351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:23.913351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:23.913351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:23.913351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:23.913351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:23.913351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:23.913351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:23.913351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:23.913351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:23.913351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:23.913351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:23.913351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:33:23.913351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:33:23.913351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:33:23.913351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:33:23.914301 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:23.914301 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:23.914301 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:33:23.914301 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:33:23.914301 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:33:23.914301 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:33:23.914301 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:23.914301 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:23.914301 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:23.914301 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:23.914301 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:23.914301 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:23.914301 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:23.914301 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:23.914301 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:23.914301 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:23.914301 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:23.914301 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:23.915271 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:23.915271 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:23.915271 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:33:23.915271 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:33:23.915271 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:33:23.915271 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:33:23.915271 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:33:23.915271 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:33:23.915271 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 17:33:23.915271 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:23.917846 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 455/926] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Aug 8 17:33:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:23.924590 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177de7c0-7a6d-4196-b91a-88aec7195003 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:23.997155 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 472/927] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 17:33:24.020097 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a1112-71bb-46c9-b1c3-5940765833cd None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:24.051944 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:24.066638 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177de7c0-7a6d-4196-b91a-88aec7195003 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:24.116408 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f841bc-1a28-48d0-b9ad-18112ccb8b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:24.117063 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f841bc-1a28-48d0-b9ad-18112ccb8b6c None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:24.117790 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f841bc-1a28-48d0-b9ad-18112ccb8b6c None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:24.118401 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f841bc-1a28-48d0-b9ad-18112ccb8b6c None admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:24.120368 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f841bc-1a28-48d0-b9ad-18112ccb8b6c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:24.120893 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f841bc-1a28-48d0-b9ad-18112ccb8b6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:24.123162 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f841bc-1a28-48d0-b9ad-18112ccb8b6c None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:24.140083 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a1112-71bb-46c9-b1c3-5940765833cd None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:24.147024 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 456/928] 10.222.0.70 () {56 vars in 1149 bytes} [Mon Aug 8 17:33:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:24.152718 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f841bc-1a28-48d0-b9ad-18112ccb8b6c None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:24.168724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:24.187642 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de05068-272b-4416-b4a0-688ac14cffae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:24.188706 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de05068-272b-4416-b4a0-688ac14cffae None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:24.196962 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de05068-272b-4416-b4a0-688ac14cffae None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:24.196962 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de05068-272b-4416-b4a0-688ac14cffae None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:24.196962 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de05068-272b-4416-b4a0-688ac14cffae None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:24.196962 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de05068-272b-4416-b4a0-688ac14cffae None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:24.204883 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-1de05068-272b-4416-b4a0-688ac14cffae None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 17:33:24.204883 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:24.204883 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 17:33:24.204883 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 17:33:24.204883 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 17:33:24.204883 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 17:33:24.204883 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 17:33:24.204883 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:24.204883 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 17:33:24.204883 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:24.204883 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 17:33:24.204883 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:24.204883 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:24.204883 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:24.204883 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:24.204883 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:24.205942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:24.205942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:24.205942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:24.205942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:24.205942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:24.205942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:24.205942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:24.205942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 17:33:24.205942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 17:33:24.205942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 17:33:24.205942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 17:33:24.205942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:24.205942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:24.205942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:24.205942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:24.205942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:24.205942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:24.206841 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:24.206841 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:24.206841 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:24.206841 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:24.206841 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:24.206841 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:24.206841 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:24.206841 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:24.206841 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:24.206841 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:24.206841 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 17:33:24.206841 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:24.206841 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 17:33:24.206841 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:24.209614 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 473/929] 10.222.0.70 () {56 vars in 1132 bytes} [Mon Aug 8 17:33:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:33:24.217214 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de05068-272b-4416-b4a0-688ac14cffae None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:24.275828 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f841bc-1a28-48d0-b9ad-18112ccb8b6c None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:24.316177 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:24.323100 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f222a-cfeb-41cb-8080-e2e588347188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:24.324257 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f222a-cfeb-41cb-8080-e2e588347188 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:24.324675 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f222a-cfeb-41cb-8080-e2e588347188 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:24.325012 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f222a-cfeb-41cb-8080-e2e588347188 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:24.334342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de05068-272b-4416-b4a0-688ac14cffae None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:24.337062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370f222a-cfeb-41cb-8080-e2e588347188 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:24.338643 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370f222a-cfeb-41cb-8080-e2e588347188 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:24.356419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-370f222a-cfeb-41cb-8080-e2e588347188 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:24.356419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:24.356419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:24.356419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:24.356419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:24.356419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:24.356419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:24.356419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:24.356419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:24.356419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:24.356419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:24.356419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:24.356419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:33:24.356419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:33:24.356419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:33:24.356419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:33:24.357801 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:24.357801 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:24.357801 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:24.357801 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:24.357801 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:24.357801 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:24.357801 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:24.357801 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:24.357801 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:24.357801 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:24.357801 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:24.357801 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:24.357801 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:24.357801 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:24.357801 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:24.357801 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:24.357801 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:33:24.358907 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:33:24.358907 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:24.358907 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:24.361244 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 457/930] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:33:24.367114 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f222a-cfeb-41cb-8080-e2e588347188 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:24.380794 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e8a78-b813-4131-8695-95c17b52342a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:24.381794 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e8a78-b813-4131-8695-95c17b52342a None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:24.382300 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e8a78-b813-4131-8695-95c17b52342a None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:24.382825 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e8a78-b813-4131-8695-95c17b52342a None admin] PATH_INFO: `/v3/services` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:24.383670 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e8a78-b813-4131-8695-95c17b52342a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:24.384173 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e8a78-b813-4131-8695-95c17b52342a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:24.385959 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e8a78-b813-4131-8695-95c17b52342a None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:24.397154 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 474/931] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Aug 8 17:33:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:24.398837 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e8a78-b813-4131-8695-95c17b52342a None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:24.452225 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:24.497752 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f222a-cfeb-41cb-8080-e2e588347188 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:24.529358 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e8a78-b813-4131-8695-95c17b52342a None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:24.535503 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73e431-c150-442e-ad58-c1a6e38724bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:24.536232 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73e431-c150-442e-ad58-c1a6e38724bf None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:24.536673 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73e431-c150-442e-ad58-c1a6e38724bf None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:24.537056 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73e431-c150-442e-ad58-c1a6e38724bf None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:24.537867 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73e431-c150-442e-ad58-c1a6e38724bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:24.538280 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73e431-c150-442e-ad58-c1a6e38724bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:24.539759 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73e431-c150-442e-ad58-c1a6e38724bf None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:24.560857 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 458/932] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:24.561999 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73e431-c150-442e-ad58-c1a6e38724bf None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:24.577593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212713e-5401-42df-aba6-63f67b3d5e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:24.578417 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212713e-5401-42df-aba6-63f67b3d5e0d None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:24.578538 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212713e-5401-42df-aba6-63f67b3d5e0d None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:24.578718 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212713e-5401-42df-aba6-63f67b3d5e0d None admin] PATH_INFO: `/v3/services` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:24.579445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212713e-5401-42df-aba6-63f67b3d5e0d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:24.579740 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212713e-5401-42df-aba6-63f67b3d5e0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:24.581116 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212713e-5401-42df-aba6-63f67b3d5e0d None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:24.592376 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 475/933] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Aug 8 17:33:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:33:24.593706 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212713e-5401-42df-aba6-63f67b3d5e0d None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:24.611318 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:24.701741 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73e431-c150-442e-ad58-c1a6e38724bf None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:24.704317 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212713e-5401-42df-aba6-63f67b3d5e0d None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:24.736891 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:24.743074 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38885d-087b-459d-b06b-09ac75bd2bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:24.743786 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38885d-087b-459d-b06b-09ac75bd2bdf None admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:24.744172 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38885d-087b-459d-b06b-09ac75bd2bdf None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:24.744614 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38885d-087b-459d-b06b-09ac75bd2bdf None admin] PATH_INFO: `/v3/endpoints` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:24.745507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38885d-087b-459d-b06b-09ac75bd2bdf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:24.747020 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38885d-087b-459d-b06b-09ac75bd2bdf None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:24.747383 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a049b-1a2f-46c7-ba6a-b63472b3f3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:24.751687 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a049b-1a2f-46c7-ba6a-b63472b3f3eb None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:24.751687 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a049b-1a2f-46c7-ba6a-b63472b3f3eb None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:24.751687 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a049b-1a2f-46c7-ba6a-b63472b3f3eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:24.756503 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a049b-1a2f-46c7-ba6a-b63472b3f3eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:24.758289 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a049b-1a2f-46c7-ba6a-b63472b3f3eb None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:24.770564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-0d1a049b-1a2f-46c7-ba6a-b63472b3f3eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:33:24.770564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:24.770564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:24.770564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:24.770564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:24.770564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:24.770564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:24.770564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:24.770564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:24.770564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:24.770564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:24.770564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:24.770564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:33:24.770564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:33:24.770564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:33:24.771479 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:33:24.771479 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:24.771479 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:24.771479 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:24.771479 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:24.771479 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:24.771479 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:24.771479 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:24.771479 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:24.771479 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:24.771479 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:24.771479 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:24.771479 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:24.771479 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:24.771479 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:24.771479 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:24.771479 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:24.772376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:33:24.772376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:33:24.772376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:33:24.772376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:33:24.772376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:33:24.772376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:33:24.772376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:33:24.772376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:24.774342 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 459/934] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:33:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:24.780327 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a049b-1a2f-46c7-ba6a-b63472b3f3eb None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:24.844479 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 476/935] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:33:24 2022] POST /identity/v3/endpoints => generated 347 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:33:24.862441 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cc7f2-0ca3-4cf0-a2f5-4c97966fb93e None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:24.863168 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cc7f2-0ca3-4cf0-a2f5-4c97966fb93e None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:24.863665 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cc7f2-0ca3-4cf0-a2f5-4c97966fb93e None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:24.865741 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 477/936] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 17:33:24.875286 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110a5f2-e763-4361-af8d-c8fb94eb58dc None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:24.875988 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110a5f2-e763-4361-af8d-c8fb94eb58dc None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:24.877054 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110a5f2-e763-4361-af8d-c8fb94eb58dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:24.900472 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-6110a5f2-e763-4361-af8d-c8fb94eb58dc None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:24.902764 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-6110a5f2-e763-4361-af8d-c8fb94eb58dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:24.904982 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a049b-1a2f-46c7-ba6a-b63472b3f3eb None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:24.958004 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce941684-87e3-4a99-ad52-6e2f1f2bc392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:24.958835 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce941684-87e3-4a99-ad52-6e2f1f2bc392 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:24.959232 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce941684-87e3-4a99-ad52-6e2f1f2bc392 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:24.959619 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce941684-87e3-4a99-ad52-6e2f1f2bc392 None admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:24.960687 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce941684-87e3-4a99-ad52-6e2f1f2bc392 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:24.961141 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce941684-87e3-4a99-ad52-6e2f1f2bc392 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:24.963567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce941684-87e3-4a99-ad52-6e2f1f2bc392 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:24.981081 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 460/937] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 8 17:33:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:24.988620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce941684-87e3-4a99-ad52-6e2f1f2bc392 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:24.998462 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:25.010170 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 478/938] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 17:33:25.028571 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110a5f2-e763-4361-af8d-c8fb94eb58dc None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:25.041501 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:25.123435 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce941684-87e3-4a99-ad52-6e2f1f2bc392 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:25.169743 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110a5f2-e763-4361-af8d-c8fb94eb58dc None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:25.170088 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dbf6ff-690d-4412-9ec7-96a71ae8a3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:25.170853 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbf6ff-690d-4412-9ec7-96a71ae8a3c7 None admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:25.171230 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbf6ff-690d-4412-9ec7-96a71ae8a3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:25.171604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbf6ff-690d-4412-9ec7-96a71ae8a3c7 None admin] PATH_INFO: `/v3/projects/047a28b7cd11486da9d330723a384812/users/c880ab908c114c5897d11aad7fb48607/roles/b0560db9df8a46708b8b37d306895467` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:25.175866 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dbf6ff-690d-4412-9ec7-96a71ae8a3c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=047a28b7cd11486da9d330723a384812, user_id=c880ab908c114c5897d11aad7fb48607, role_id=b0560db9df8a46708b8b37d306895467)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:25.177525 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dbf6ff-690d-4412-9ec7-96a71ae8a3c7 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:25.209262 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7082e2-c58c-4026-ab79-55db42d06b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:25.209895 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7082e2-c58c-4026-ab79-55db42d06b83 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:25.210180 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7082e2-c58c-4026-ab79-55db42d06b83 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:25.210453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7082e2-c58c-4026-ab79-55db42d06b83 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:25.211029 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7082e2-c58c-4026-ab79-55db42d06b83 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:25.212390 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7082e2-c58c-4026-ab79-55db42d06b83 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:25.222026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-fc7082e2-c58c-4026-ab79-55db42d06b83 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 17:33:25.222026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:25.222026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 17:33:25.222026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 17:33:25.222026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 17:33:25.222026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 17:33:25.222026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 17:33:25.222026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:25.222026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 17:33:25.222026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:25.222026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 17:33:25.222026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:25.222026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:25.222026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:25.222026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:25.222026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:25.222026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:25.223055 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:25.223055 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:25.223055 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:25.223055 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:25.223055 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:25.223055 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:25.223055 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 17:33:25.223055 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 17:33:25.223055 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 17:33:25.223055 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 17:33:25.223055 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:25.223055 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:25.223055 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:25.223055 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:25.223055 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:25.223055 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:25.223955 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:25.223955 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:25.223955 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:25.223955 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:25.223955 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:25.223955 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:25.223955 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:25.223955 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:25.223955 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:25.223955 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:25.223955 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 17:33:25.223955 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:25.223955 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 17:33:25.223955 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:25.223955 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 479/939] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Aug 8 17:33:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:33:25.230711 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7082e2-c58c-4026-ab79-55db42d06b83 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:25.253101 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 461/940] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 8 17:33:24 2022] PUT /identity/v3/projects/047a28b7cd11486da9d330723a384812/users/c880ab908c114c5897d11aad7fb48607/roles/b0560db9df8a46708b8b37d306895467 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:33:25.311971 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:25.364180 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7082e2-c58c-4026-ab79-55db42d06b83 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:25.403811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2926427-c348-4205-b755-90cb600fb00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:25.404530 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2926427-c348-4205-b755-90cb600fb00c None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:25.404884 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2926427-c348-4205-b755-90cb600fb00c None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:25.405294 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2926427-c348-4205-b755-90cb600fb00c None admin] PATH_INFO: `/v3/services` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:25.406090 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2926427-c348-4205-b755-90cb600fb00c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:25.406462 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2926427-c348-4205-b755-90cb600fb00c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:25.408784 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2926427-c348-4205-b755-90cb600fb00c None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:25.415004 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 480/941] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Aug 8 17:33:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:25.421100 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dbf6ff-690d-4412-9ec7-96a71ae8a3c7 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:25.530497 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dbf6ff-690d-4412-9ec7-96a71ae8a3c7 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:25.532857 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:25.567819 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb180e12-0fe1-47e5-8406-2a6e07cc7a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:25.569085 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb180e12-0fe1-47e5-8406-2a6e07cc7a76 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:25.569856 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb180e12-0fe1-47e5-8406-2a6e07cc7a76 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:25.570275 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb180e12-0fe1-47e5-8406-2a6e07cc7a76 None admin] PATH_INFO: `/v3/services` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:25.571072 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb180e12-0fe1-47e5-8406-2a6e07cc7a76 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:25.571531 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb180e12-0fe1-47e5-8406-2a6e07cc7a76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:25.573147 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb180e12-0fe1-47e5-8406-2a6e07cc7a76 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:25.578517 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 462/942] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Aug 8 17:33:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:25.585296 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2926427-c348-4205-b755-90cb600fb00c None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:25.692734 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2926427-c348-4205-b755-90cb600fb00c None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:25.720690 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:25.728418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403b5b1-d4fd-44da-9cd2-6d79f53e5be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:25.729044 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403b5b1-d4fd-44da-9cd2-6d79f53e5be6 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:25.729328 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403b5b1-d4fd-44da-9cd2-6d79f53e5be6 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:25.729598 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403b5b1-d4fd-44da-9cd2-6d79f53e5be6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:25.730300 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403b5b1-d4fd-44da-9cd2-6d79f53e5be6 None admin] RBAC: Adding query filter params (interface=public, service_id=d82522b2d87f47d4b39b9b95e981dd9f, region_id=RegionOne) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:25.730608 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403b5b1-d4fd-44da-9cd2-6d79f53e5be6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:25.731962 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403b5b1-d4fd-44da-9cd2-6d79f53e5be6 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:25.738144 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 481/943] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Aug 8 17:33:25 2022] GET /identity/v3/endpoints?service_id=d82522b2d87f47d4b39b9b95e981dd9f&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:33:25.743832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb180e12-0fe1-47e5-8406-2a6e07cc7a76 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:25.848853 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e8d7c-fb68-4fef-92fe-fbb0858e66c2 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:25.849073 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e8d7c-fb68-4fef-92fe-fbb0858e66c2 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:25.851412 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e8d7c-fb68-4fef-92fe-fbb0858e66c2 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:25.851534 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb180e12-0fe1-47e5-8406-2a6e07cc7a76 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:25.851632 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 482/944] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 17:33:25.857753 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1f38c-865b-4f6b-b0ae-2f011272cd66 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:25.858292 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1f38c-865b-4f6b-b0ae-2f011272cd66 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:25.858791 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1f38c-865b-4f6b-b0ae-2f011272cd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:25.877361 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-42e1f38c-865b-4f6b-b0ae-2f011272cd66 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:25.878712 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-42e1f38c-865b-4f6b-b0ae-2f011272cd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:25.891119 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf59f7-77b5-4d6e-a910-4d51bec4a52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:25.892045 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf59f7-77b5-4d6e-a910-4d51bec4a52e None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:25.892630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf59f7-77b5-4d6e-a910-4d51bec4a52e None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:25.893078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf59f7-77b5-4d6e-a910-4d51bec4a52e None admin] PATH_INFO: `/v3/services` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:25.894210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf59f7-77b5-4d6e-a910-4d51bec4a52e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:25.896563 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf59f7-77b5-4d6e-a910-4d51bec4a52e None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:25.904908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 463/945] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Aug 8 17:33:25 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:33:25.958751 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 483/946] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:33:25.983539 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf59f7-77b5-4d6e-a910-4d51bec4a52e None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:26.020758 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:26.100639 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf59f7-77b5-4d6e-a910-4d51bec4a52e None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:26.136487 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4eeb7-070a-424a-b588-97c537b1db6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:26.137126 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4eeb7-070a-424a-b588-97c537b1db6b None admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:26.137411 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4eeb7-070a-424a-b588-97c537b1db6b None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:26.137685 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4eeb7-070a-424a-b588-97c537b1db6b None admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:26.138390 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4eeb7-070a-424a-b588-97c537b1db6b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:26.139842 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4eeb7-070a-424a-b588-97c537b1db6b None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:26.142805 dv-cinder-852364-1-smb devstack@keystone.service[86920]: WARNING keystone.server.flask.common [None req-4eb4eeb7-070a-424a-b588-97c537b1db6b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 08 17:33:26.185717 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.sql.core [None req-4eb4eeb7-070a-424a-b588-97c537b1db6b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 08 17:33:26.185717 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 08 17:33:26.185717 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [parameters: {'id': 'e1aa936dbb0a4c7bbc66838b0a735499', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 08 17:33:26.185717 dv-cinder-852364-1-smb devstack@keystone.service[86920]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86920) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 08 17:33:26.194231 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-4eb4eeb7-070a-424a-b588-97c537b1db6b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e1aa936dbb0a4c7bbc66838b0a735499.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e1aa936dbb0a4c7bbc66838b0a735499. Aug 08 17:33:26.194231 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:26.194231 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 08 17:33:26.194231 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 08 17:33:26.194231 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 08 17:33:26.194231 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 08 17:33:26.194231 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 08 17:33:26.194231 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application result = self._query(query) Aug 08 17:33:26.194231 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 08 17:33:26.194231 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application conn.query(q) Aug 08 17:33:26.194231 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 08 17:33:26.194231 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 08 17:33:26.194231 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 08 17:33:26.196236 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application result.read() Aug 08 17:33:26.196236 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 08 17:33:26.196236 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 08 17:33:26.196236 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 08 17:33:26.196236 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 08 17:33:26.196236 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 08 17:33:26.196236 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 08 17:33:26.196236 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 08 17:33:26.196236 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 08 17:33:26.196236 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 08 17:33:26.196236 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:26.196236 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 08 17:33:26.196236 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:26.196236 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:26.196236 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 08 17:33:26.196236 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 08 17:33:26.196236 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 08 17:33:26.196236 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 08 17:33:26.197250 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 08 17:33:26.197250 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application next(self.gen) Aug 08 17:33:26.197250 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 08 17:33:26.197250 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application yield resource Aug 08 17:33:26.197250 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 08 17:33:26.197250 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application next(self.gen) Aug 08 17:33:26.197250 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 08 17:33:26.197250 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self.session.rollback() Aug 08 17:33:26.197250 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 08 17:33:26.197250 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self.force_reraise() Aug 08 17:33:26.197250 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 08 17:33:26.197250 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise self.value Aug 08 17:33:26.197250 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 08 17:33:26.197250 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 08 17:33:26.197250 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 08 17:33:26.197250 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application session.commit() Aug 08 17:33:26.197250 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 08 17:33:26.198724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 08 17:33:26.198724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 08 17:33:26.198724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._prepare_impl() Aug 08 17:33:26.198724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 08 17:33:26.198724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self.session.flush() Aug 08 17:33:26.198724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 08 17:33:26.198724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._flush(objects) Aug 08 17:33:26.198724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 08 17:33:26.198724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 08 17:33:26.198724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 08 17:33:26.198724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application compat.raise_( Aug 08 17:33:26.198724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 08 17:33:26.198724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception Aug 08 17:33:26.198724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 08 17:33:26.198724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application flush_context.execute() Aug 08 17:33:26.198724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 08 17:33:26.198724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rec.execute(self) Aug 08 17:33:26.199642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 08 17:33:26.199642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 08 17:33:26.199642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 08 17:33:26.199642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 08 17:33:26.199642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 08 17:33:26.199642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 08 17:33:26.199642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 08 17:33:26.199642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 08 17:33:26.199642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 08 17:33:26.199642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 08 17:33:26.199642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 08 17:33:26.199642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 08 17:33:26.199642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 08 17:33:26.199642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 08 17:33:26.199642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 08 17:33:26.201482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 08 17:33:26.201482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 08 17:33:26.201482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception Aug 08 17:33:26.201482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 08 17:33:26.201482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 08 17:33:26.201482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 08 17:33:26.201482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 08 17:33:26.201482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 08 17:33:26.201482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application result = self._query(query) Aug 08 17:33:26.201482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 08 17:33:26.201482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application conn.query(q) Aug 08 17:33:26.201482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 08 17:33:26.201482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 08 17:33:26.201482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 08 17:33:26.201482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application result.read() Aug 08 17:33:26.201482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 08 17:33:26.201482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 08 17:33:26.203642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 08 17:33:26.203642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 08 17:33:26.203642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 08 17:33:26.203642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 08 17:33:26.203642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 08 17:33:26.203642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 08 17:33:26.203642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 08 17:33:26.203642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 08 17:33:26.203642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [parameters: {'id': 'e1aa936dbb0a4c7bbc66838b0a735499', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 08 17:33:26.203642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 08 17:33:26.203642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:26.203642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 17:33:26.203642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:26.203642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:26.203642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 08 17:33:26.206142 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 08 17:33:26.206142 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 08 17:33:26.206142 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 08 17:33:26.206142 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 08 17:33:26.206142 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:26.206142 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 17:33:26.206142 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:26.206142 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:26.206142 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:26.206142 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:26.206142 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:26.206142 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:26.206142 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:26.206142 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:26.206142 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:26.206142 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:26.206142 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:26.208320 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:26.208320 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 08 17:33:26.208320 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 08 17:33:26.208320 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:26.208320 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:26.208320 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 08 17:33:26.208320 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 08 17:33:26.208320 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e1aa936dbb0a4c7bbc66838b0a735499. Aug 08 17:33:26.208320 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:26.208320 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 464/947] 10.222.0.70 () {60 vars in 1140 bytes} [Mon Aug 8 17:33:25 2022] POST /identity/v3/projects => generated 262 bytes in 213 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:26.212737 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1f38c-865b-4f6b-b0ae-2f011272cd66 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:26.313639 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1f38c-865b-4f6b-b0ae-2f011272cd66 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:26.337777 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:26.349421 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825aeb66-7b0f-4c84-94e2-706c92ad8a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:26.351646 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825aeb66-7b0f-4c84-94e2-706c92ad8a3b None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:26.351646 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825aeb66-7b0f-4c84-94e2-706c92ad8a3b None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:26.351646 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825aeb66-7b0f-4c84-94e2-706c92ad8a3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:26.358041 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825aeb66-7b0f-4c84-94e2-706c92ad8a3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:26.359485 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825aeb66-7b0f-4c84-94e2-706c92ad8a3b None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:26.372378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-825aeb66-7b0f-4c84-94e2-706c92ad8a3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:33:26.372378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:26.372378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:26.372378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:26.372378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:26.372378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:26.372378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:26.372378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:26.372378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:26.372378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:26.372378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:26.372378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:26.372378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:33:26.372378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:33:26.372378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:33:26.373335 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:33:26.373335 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:26.373335 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:26.373335 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:26.373335 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:26.373335 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:26.373335 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:26.373335 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:26.373335 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:26.373335 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:26.373335 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:26.373335 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:26.373335 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:26.373335 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:26.373335 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:26.373335 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:26.373335 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:26.374488 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:33:26.374488 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:33:26.374488 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:33:26.374488 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:33:26.374488 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:33:26.374488 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:33:26.374488 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:33:26.374488 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:26.374488 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 484/948] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:33:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:26.381909 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4eeb7-070a-424a-b588-97c537b1db6b None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:26.472907 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:26.490055 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4eeb7-070a-424a-b588-97c537b1db6b None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:26.526688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03890a9-a08b-458e-8493-a51c679d90bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:26.527536 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03890a9-a08b-458e-8493-a51c679d90bb None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:26.527957 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03890a9-a08b-458e-8493-a51c679d90bb None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:26.528370 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03890a9-a08b-458e-8493-a51c679d90bb None admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:26.529200 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03890a9-a08b-458e-8493-a51c679d90bb None admin] RBAC: Adding query filter params (name=service) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:26.529667 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03890a9-a08b-458e-8493-a51c679d90bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:26.531423 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03890a9-a08b-458e-8493-a51c679d90bb None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:26.556002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 465/949] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Aug 8 17:33:26 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:27.006351 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd428a8-c499-4505-814a-bb0a7b578d25 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:27.006876 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd428a8-c499-4505-814a-bb0a7b578d25 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:27.006876 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd428a8-c499-4505-814a-bb0a7b578d25 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:27.008467 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 485/950] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:27.013809 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528160c-d9de-4052-baa8-5c3ae987c372 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:27.014096 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528160c-d9de-4052-baa8-5c3ae987c372 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:27.014374 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528160c-d9de-4052-baa8-5c3ae987c372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:27.033103 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-e528160c-d9de-4052-baa8-5c3ae987c372 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:27.034626 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-e528160c-d9de-4052-baa8-5c3ae987c372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:27.108065 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 466/951] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:33:27.130992 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd428a8-c499-4505-814a-bb0a7b578d25 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:27.241730 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd428a8-c499-4505-814a-bb0a7b578d25 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:27.278331 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d3438-4dd0-458b-8f87-e657b2f8e8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:27.278878 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d3438-4dd0-458b-8f87-e657b2f8e8cd None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:27.279164 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d3438-4dd0-458b-8f87-e657b2f8e8cd None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:27.279437 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d3438-4dd0-458b-8f87-e657b2f8e8cd None admin] PATH_INFO: `/v3/services/compute` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:27.280020 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27d3438-4dd0-458b-8f87-e657b2f8e8cd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:27.281438 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27d3438-4dd0-458b-8f87-e657b2f8e8cd None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:27.290444 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-b27d3438-4dd0-458b-8f87-e657b2f8e8cd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 17:33:27.290444 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:27.290444 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 17:33:27.290444 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 17:33:27.290444 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 17:33:27.290444 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 17:33:27.290444 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 17:33:27.290444 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:27.290444 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 17:33:27.290444 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:27.290444 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 17:33:27.290444 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:27.290444 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:27.290444 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:27.290444 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:27.290444 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:27.290444 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:27.291559 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:27.291559 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:27.291559 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:27.291559 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:27.291559 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:27.291559 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:27.291559 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 17:33:27.291559 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 17:33:27.291559 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 17:33:27.291559 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 17:33:27.291559 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:27.291559 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:27.291559 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:27.291559 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:27.291559 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:27.291559 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:27.292815 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:27.292815 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:27.292815 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:27.292815 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:27.292815 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:27.292815 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:27.292815 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:27.292815 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:27.292815 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:27.292815 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:27.292815 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 17:33:27.292815 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:27.292815 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 17:33:27.292815 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:27.292815 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 486/952] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:33:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:27.298026 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e528160c-d9de-4052-baa8-5c3ae987c372 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:27.381640 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:27.416464 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e528160c-d9de-4052-baa8-5c3ae987c372 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:27.456684 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3222f790-f7b9-48e2-9cf8-35e62f5d5468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:27.457665 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222f790-f7b9-48e2-9cf8-35e62f5d5468 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:27.458180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222f790-f7b9-48e2-9cf8-35e62f5d5468 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:27.458657 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222f790-f7b9-48e2-9cf8-35e62f5d5468 None admin] PATH_INFO: `/v3/services` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:27.459505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3222f790-f7b9-48e2-9cf8-35e62f5d5468 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:27.460010 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3222f790-f7b9-48e2-9cf8-35e62f5d5468 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:27.461611 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3222f790-f7b9-48e2-9cf8-35e62f5d5468 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:27.467097 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 467/953] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Aug 8 17:33:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:27.473290 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d3438-4dd0-458b-8f87-e657b2f8e8cd None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:27.524207 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:27.585874 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d3438-4dd0-458b-8f87-e657b2f8e8cd None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:27.588909 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec3bb8-6380-418a-9951-94f6a8b656ea None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:27.589387 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec3bb8-6380-418a-9951-94f6a8b656ea None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:27.589468 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec3bb8-6380-418a-9951-94f6a8b656ea None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:27.591041 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 468/954] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:27.597108 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dad71-f340-42f5-83e7-017352639a98 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:27.597395 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dad71-f340-42f5-83e7-017352639a98 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:27.597673 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dad71-f340-42f5-83e7-017352639a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:27.617379 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-a13dad71-f340-42f5-83e7-017352639a98 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:27.618600 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-a13dad71-f340-42f5-83e7-017352639a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:27.622688 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e19572-1c9c-4e40-a471-a1b7ece0654d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:27.623299 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e19572-1c9c-4e40-a471-a1b7ece0654d None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:27.623582 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e19572-1c9c-4e40-a471-a1b7ece0654d None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:27.623858 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e19572-1c9c-4e40-a471-a1b7ece0654d None admin] PATH_INFO: `/v3/services` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:27.624497 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e19572-1c9c-4e40-a471-a1b7ece0654d None admin] RBAC: Adding query filter params (type=compute) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:27.624802 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e19572-1c9c-4e40-a471-a1b7ece0654d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:27.626793 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e19572-1c9c-4e40-a471-a1b7ece0654d None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:27.633543 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 487/955] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Aug 8 17:33:27 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:27.708762 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 469/956] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:33:27.732772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e19572-1c9c-4e40-a471-a1b7ece0654d None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:27.851378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e19572-1c9c-4e40-a471-a1b7ece0654d None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:27.863749 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:27.887806 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378e98c-6a2f-4b51-958a-dfd127e973bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:27.888428 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378e98c-6a2f-4b51-958a-dfd127e973bc None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:27.888704 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378e98c-6a2f-4b51-958a-dfd127e973bc None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:27.888973 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378e98c-6a2f-4b51-958a-dfd127e973bc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:27.900215 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e378e98c-6a2f-4b51-958a-dfd127e973bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:33:27.904811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-e378e98c-6a2f-4b51-958a-dfd127e973bc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 17:33:27.904811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:27.904811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:27.904811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:27.904811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:27.904811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:27.904811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:27.904811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:27.904811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:27.904811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:27.904811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:27.904811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:27.904811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:33:27.904811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:33:27.904811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:33:27.904811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:33:27.907746 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:33:27.907746 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:33:27.907746 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:33:27.907746 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:33:27.907746 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:27.907746 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:27.907746 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:27.907746 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:27.907746 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:27.907746 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:27.907746 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:27.907746 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:27.907746 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:27.907746 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:27.907746 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:27.907746 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:27.910147 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:27.910147 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:27.910147 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:27.910147 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:27.910147 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:33:27.910147 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:33:27.910147 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:33:27.910147 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:33:27.910147 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:33:27.910147 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:33:27.910147 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 17:33:27.910147 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:27.910147 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 488/957] 10.222.0.70 () {56 vars in 1120 bytes} [Mon Aug 8 17:33:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:27.917073 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13dad71-f340-42f5-83e7-017352639a98 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:27.991860 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:28.024426 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13dad71-f340-42f5-83e7-017352639a98 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:28.059651 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b9dde-e899-4a15-8eab-128ecc85c93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:28.060254 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b9dde-e899-4a15-8eab-128ecc85c93a None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:28.060532 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b9dde-e899-4a15-8eab-128ecc85c93a None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:28.060800 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b9dde-e899-4a15-8eab-128ecc85c93a None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:28.061494 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b9dde-e899-4a15-8eab-128ecc85c93a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:28.061793 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b9dde-e899-4a15-8eab-128ecc85c93a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:28.063669 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b9dde-e899-4a15-8eab-128ecc85c93a None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:28.072932 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 470/958] 10.222.0.70 () {56 vars in 1115 bytes} [Mon Aug 8 17:33:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:28.078208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378e98c-6a2f-4b51-958a-dfd127e973bc None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:28.105069 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa17e20-ed23-4d7e-a825-c004c3c86d73 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:28.105649 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa17e20-ed23-4d7e-a825-c004c3c86d73 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:28.106104 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa17e20-ed23-4d7e-a825-c004c3c86d73 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:28.108239 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 471/959] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:28.114259 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7345ef-723a-481d-aab2-2c300d64c6a8 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:28.114546 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7345ef-723a-481d-aab2-2c300d64c6a8 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:28.114854 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7345ef-723a-481d-aab2-2c300d64c6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:28.134083 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-3e7345ef-723a-481d-aab2-2c300d64c6a8 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:28.135289 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-3e7345ef-723a-481d-aab2-2c300d64c6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:28.199391 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378e98c-6a2f-4b51-958a-dfd127e973bc None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:28.229119 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 472/960] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:33:28.243697 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed240779-41a0-464e-a967-0c8ef7f63093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:28.244567 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed240779-41a0-464e-a967-0c8ef7f63093 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:28.245022 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed240779-41a0-464e-a967-0c8ef7f63093 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:28.245491 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed240779-41a0-464e-a967-0c8ef7f63093 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:28.247827 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7345ef-723a-481d-aab2-2c300d64c6a8 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:28.259281 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed240779-41a0-464e-a967-0c8ef7f63093 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:28.261870 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed240779-41a0-464e-a967-0c8ef7f63093 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:28.280993 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-ed240779-41a0-464e-a967-0c8ef7f63093 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:28.280993 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:28.280993 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:28.280993 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:28.280993 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:28.280993 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:28.280993 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:28.280993 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:28.280993 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:28.280993 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:28.280993 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:28.280993 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:28.280993 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:33:28.280993 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:33:28.280993 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:33:28.280993 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:33:28.282634 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:28.282634 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:28.282634 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:28.282634 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:28.282634 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:28.282634 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:28.282634 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:28.282634 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:28.282634 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:28.282634 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:28.282634 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:28.282634 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:28.282634 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:28.282634 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:28.282634 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:28.282634 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:28.282634 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:33:28.283843 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:33:28.283843 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:28.283843 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:28.286143 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 489/961] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:28.294174 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed240779-41a0-464e-a967-0c8ef7f63093 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:28.322529 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:28.326596 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:28.382970 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7345ef-723a-481d-aab2-2c300d64c6a8 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:28.422951 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed240779-41a0-464e-a967-0c8ef7f63093 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:28.433992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970f26a-2ce2-4a41-89d2-d378e379ea0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:28.434624 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970f26a-2ce2-4a41-89d2-d378e379ea0d None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:28.434901 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970f26a-2ce2-4a41-89d2-d378e379ea0d None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:28.435172 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970f26a-2ce2-4a41-89d2-d378e379ea0d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:28.435743 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970f26a-2ce2-4a41-89d2-d378e379ea0d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:28.437398 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970f26a-2ce2-4a41-89d2-d378e379ea0d None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:28.447992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-f970f26a-2ce2-4a41-89d2-d378e379ea0d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 17:33:28.447992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:28.447992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 17:33:28.447992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 17:33:28.447992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 17:33:28.447992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 17:33:28.447992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 17:33:28.447992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:28.447992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 17:33:28.447992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:28.447992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 17:33:28.447992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:28.447992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:28.447992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:28.447992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:28.447992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:28.447992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:28.449123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:28.449123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:28.449123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:28.449123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:28.449123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:28.449123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:28.449123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 17:33:28.449123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 17:33:28.449123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 17:33:28.449123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 17:33:28.449123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:28.449123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:28.449123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:28.449123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:28.449123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:28.449123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:28.450398 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:28.450398 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:28.450398 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:28.450398 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:28.450398 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:28.450398 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:28.450398 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:28.450398 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:28.450398 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:28.450398 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:28.450398 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 17:33:28.450398 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:28.450398 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 17:33:28.450398 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:28.450398 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 473/962] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Aug 8 17:33:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:33:28.458543 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970f26a-2ce2-4a41-89d2-d378e379ea0d None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:28.461583 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99ae49-4943-4375-badc-fb82750ac3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:28.462198 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99ae49-4943-4375-badc-fb82750ac3de None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:28.462476 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99ae49-4943-4375-badc-fb82750ac3de None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:28.462746 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99ae49-4943-4375-badc-fb82750ac3de None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:28.463391 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99ae49-4943-4375-badc-fb82750ac3de None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:28.463691 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99ae49-4943-4375-badc-fb82750ac3de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:28.465093 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99ae49-4943-4375-badc-fb82750ac3de None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:28.477774 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 490/963] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:28.484514 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99ae49-4943-4375-badc-fb82750ac3de None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:28.585614 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970f26a-2ce2-4a41-89d2-d378e379ea0d None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:28.592026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:28.616876 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:28.618564 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99ae49-4943-4375-badc-fb82750ac3de None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:28.625524 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42248f7-4e21-4a02-9999-126bd7460033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:28.626742 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42248f7-4e21-4a02-9999-126bd7460033 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:28.627021 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42248f7-4e21-4a02-9999-126bd7460033 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:28.627300 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42248f7-4e21-4a02-9999-126bd7460033 None admin] PATH_INFO: `/v3/services` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:28.628089 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42248f7-4e21-4a02-9999-126bd7460033 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:28.628221 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42248f7-4e21-4a02-9999-126bd7460033 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:28.629617 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42248f7-4e21-4a02-9999-126bd7460033 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:28.640372 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 474/964] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Aug 8 17:33:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:33:28.643436 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42248f7-4e21-4a02-9999-126bd7460033 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:28.668107 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d8782-2d33-4e24-937e-7289bb79379c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:28.668739 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d8782-2d33-4e24-937e-7289bb79379c None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:28.669018 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d8782-2d33-4e24-937e-7289bb79379c None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:28.669314 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d8782-2d33-4e24-937e-7289bb79379c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:28.679494 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d8782-2d33-4e24-937e-7289bb79379c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:28.681663 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d8782-2d33-4e24-937e-7289bb79379c None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:28.697260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-ac8d8782-2d33-4e24-937e-7289bb79379c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 17:33:28.697260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:28.697260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:28.697260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:28.697260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:28.697260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:28.697260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:28.697260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:28.697260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:28.697260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:28.697260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:28.697260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:28.697260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:33:28.697260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:33:28.697260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:33:28.697260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:33:28.698265 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:28.698265 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:28.698265 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:33:28.698265 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:33:28.698265 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:33:28.698265 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:33:28.698265 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:28.698265 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:28.698265 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:28.698265 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:28.698265 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:28.698265 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:28.698265 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:28.698265 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:28.698265 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:28.698265 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:28.698265 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:28.698265 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:28.699246 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:28.699246 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:28.699246 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:33:28.699246 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:33:28.699246 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:33:28.699246 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:33:28.699246 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:33:28.699246 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:33:28.699246 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 17:33:28.699246 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:28.703498 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 491/965] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Aug 8 17:33:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:33:28.705560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d8782-2d33-4e24-937e-7289bb79379c None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:28.770394 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42248f7-4e21-4a02-9999-126bd7460033 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:28.804469 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a86c92-dfc8-48a7-b46e-34f852f15074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:28.805111 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a86c92-dfc8-48a7-b46e-34f852f15074 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:28.805395 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a86c92-dfc8-48a7-b46e-34f852f15074 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:28.805667 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a86c92-dfc8-48a7-b46e-34f852f15074 None admin] PATH_INFO: `/v3/services` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:28.806293 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a86c92-dfc8-48a7-b46e-34f852f15074 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:28.806597 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a86c92-dfc8-48a7-b46e-34f852f15074 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:28.807958 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a86c92-dfc8-48a7-b46e-34f852f15074 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:28.817621 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 475/966] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Aug 8 17:33:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:33:28.817621 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea25e24-cff4-4f6e-83a6-7a8d2e7ca172 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:28.817621 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea25e24-cff4-4f6e-83a6-7a8d2e7ca172 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:28.817621 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea25e24-cff4-4f6e-83a6-7a8d2e7ca172 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:28.817621 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 476/967] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:28.819258 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea25e24-cff4-4f6e-83a6-7a8d2e7ca172 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:28.822099 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d8782-2d33-4e24-937e-7289bb79379c None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:28.861279 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ab58e-4ffb-46c4-8423-5269964171f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:28.861887 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ab58e-4ffb-46c4-8423-5269964171f3 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:28.862164 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ab58e-4ffb-46c4-8423-5269964171f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:28.862432 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ab58e-4ffb-46c4-8423-5269964171f3 None admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:28.863157 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ab58e-4ffb-46c4-8423-5269964171f3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:28.863463 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ab58e-4ffb-46c4-8423-5269964171f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:28.864989 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ab58e-4ffb-46c4-8423-5269964171f3 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:28.879566 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:28.881672 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:28.890251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 492/968] 10.222.0.70 () {56 vars in 1149 bytes} [Mon Aug 8 17:33:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:28.890251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12341422-1bb9-4b2a-9124-a9b09a96c105 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:28.890251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12341422-1bb9-4b2a-9124-a9b09a96c105 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:28.890251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12341422-1bb9-4b2a-9124-a9b09a96c105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:28.905496 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-12341422-1bb9-4b2a-9124-a9b09a96c105 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:28.906610 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-12341422-1bb9-4b2a-9124-a9b09a96c105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:28.931211 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea25e24-cff4-4f6e-83a6-7a8d2e7ca172 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:28.973006 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591f890-cf03-4d8a-b366-f6e558cad4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:28.974043 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591f890-cf03-4d8a-b366-f6e558cad4d3 None admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:28.974326 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591f890-cf03-4d8a-b366-f6e558cad4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:28.974861 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591f890-cf03-4d8a-b366-f6e558cad4d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:28.975522 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591f890-cf03-4d8a-b366-f6e558cad4d3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:28.977822 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591f890-cf03-4d8a-b366-f6e558cad4d3 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:28.980867 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 493/969] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:33:28.981736 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12341422-1bb9-4b2a-9124-a9b09a96c105 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:29.053065 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 477/970] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:33:28 2022] POST /identity/v3/endpoints => generated 349 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:33:29.053065 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591f890-cf03-4d8a-b366-f6e558cad4d3 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:29.119978 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12341422-1bb9-4b2a-9124-a9b09a96c105 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:29.163918 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:29.180351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591f890-cf03-4d8a-b366-f6e558cad4d3 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:29.181089 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2548f5-e7fd-4463-a65b-5b78355634af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:29.181716 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2548f5-e7fd-4463-a65b-5b78355634af None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:29.181996 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2548f5-e7fd-4463-a65b-5b78355634af None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:29.182575 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2548f5-e7fd-4463-a65b-5b78355634af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:29.189763 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:29.232248 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544a58a-8192-4cdf-a283-9ea5063fb986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:29.233726 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544a58a-8192-4cdf-a283-9ea5063fb986 None admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:29.234007 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544a58a-8192-4cdf-a283-9ea5063fb986 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:29.234283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544a58a-8192-4cdf-a283-9ea5063fb986 None admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:29.235472 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2544a58a-8192-4cdf-a283-9ea5063fb986 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:29.238999 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2544a58a-8192-4cdf-a283-9ea5063fb986 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:29.278507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2548f5-e7fd-4463-a65b-5b78355634af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:29.279963 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2548f5-e7fd-4463-a65b-5b78355634af None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:29.314212 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.sql.core [None req-2544a58a-8192-4cdf-a283-9ea5063fb986 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 08 17:33:29.314212 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 08 17:33:29.314212 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [parameters: {'user_id': '8173967a841b435b84c90e8b5375e443', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 08 17:33:29.314212 dv-cinder-852364-1-smb devstack@keystone.service[86920]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86920) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 08 17:33:29.320577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-2544a58a-8192-4cdf-a283-9ea5063fb986 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 08 17:33:29.320577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:29.320577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 08 17:33:29.320577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 08 17:33:29.320577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 08 17:33:29.320577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 08 17:33:29.320577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 08 17:33:29.320577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application result = self._query(query) Aug 08 17:33:29.320577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 08 17:33:29.320577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application conn.query(q) Aug 08 17:33:29.320577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 08 17:33:29.320577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 08 17:33:29.320577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 08 17:33:29.320577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application result.read() Aug 08 17:33:29.320577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 08 17:33:29.321641 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 08 17:33:29.321641 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 08 17:33:29.321641 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 08 17:33:29.321641 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 08 17:33:29.321641 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 08 17:33:29.321641 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 08 17:33:29.321641 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 08 17:33:29.321641 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 08 17:33:29.321641 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:29.321641 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 08 17:33:29.321641 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:29.321641 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:29.321641 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 08 17:33:29.321641 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 08 17:33:29.321641 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 08 17:33:29.321641 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 08 17:33:29.321641 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 08 17:33:29.321641 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application next(self.gen) Aug 08 17:33:29.322646 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 08 17:33:29.322646 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application yield resource Aug 08 17:33:29.322646 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 08 17:33:29.322646 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application next(self.gen) Aug 08 17:33:29.322646 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 08 17:33:29.322646 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self.session.rollback() Aug 08 17:33:29.322646 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 08 17:33:29.322646 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self.force_reraise() Aug 08 17:33:29.322646 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 08 17:33:29.322646 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise self.value Aug 08 17:33:29.322646 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 08 17:33:29.322646 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 08 17:33:29.322646 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 08 17:33:29.322646 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application session.commit() Aug 08 17:33:29.322646 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 08 17:33:29.322646 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 08 17:33:29.322646 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 08 17:33:29.323553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._prepare_impl() Aug 08 17:33:29.323553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 08 17:33:29.323553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self.session.flush() Aug 08 17:33:29.323553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 08 17:33:29.323553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._flush(objects) Aug 08 17:33:29.323553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 08 17:33:29.323553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 08 17:33:29.323553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 08 17:33:29.323553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application compat.raise_( Aug 08 17:33:29.323553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 08 17:33:29.323553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception Aug 08 17:33:29.323553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 08 17:33:29.323553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application flush_context.execute() Aug 08 17:33:29.323553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 08 17:33:29.323553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rec.execute(self) Aug 08 17:33:29.323553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 08 17:33:29.323553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 08 17:33:29.324442 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 08 17:33:29.324442 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 08 17:33:29.324442 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 08 17:33:29.324442 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 08 17:33:29.324442 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 08 17:33:29.324442 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 08 17:33:29.324442 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 08 17:33:29.324442 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 08 17:33:29.324442 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 08 17:33:29.324442 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 08 17:33:29.324442 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 08 17:33:29.324442 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 08 17:33:29.324442 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 08 17:33:29.324442 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 08 17:33:29.324442 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 08 17:33:29.324442 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception Aug 08 17:33:29.326222 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 08 17:33:29.326222 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 08 17:33:29.326222 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 08 17:33:29.326222 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 08 17:33:29.326222 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 08 17:33:29.326222 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application result = self._query(query) Aug 08 17:33:29.326222 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 08 17:33:29.326222 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application conn.query(q) Aug 08 17:33:29.326222 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 08 17:33:29.326222 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 08 17:33:29.326222 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 08 17:33:29.326222 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application result.read() Aug 08 17:33:29.326222 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 08 17:33:29.326222 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 08 17:33:29.326222 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 08 17:33:29.326222 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 08 17:33:29.328282 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 08 17:33:29.328282 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 08 17:33:29.328282 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 08 17:33:29.328282 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 08 17:33:29.328282 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 08 17:33:29.328282 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 08 17:33:29.328282 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [parameters: {'user_id': '8173967a841b435b84c90e8b5375e443', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 08 17:33:29.328282 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 08 17:33:29.328282 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:29.328282 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 17:33:29.328282 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:29.328282 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:29.328282 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:29.328282 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:29.328282 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:29.331158 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:29.331158 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:29.331158 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:29.331158 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:29.331158 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:29.331158 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:29.331158 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:29.331158 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 08 17:33:29.331158 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 08 17:33:29.331158 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:29.331158 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:29.331158 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:33:29.331158 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:33:29.331158 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:33:29.331158 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:33:29.331158 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 08 17:33:29.331158 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 08 17:33:29.333946 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 08 17:33:29.333946 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 08 17:33:29.333946 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 08 17:33:29.333946 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 08 17:33:29.333946 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 08 17:33:29.333946 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:29.333946 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 478/971] 10.222.0.70 () {60 vars in 1131 bytes} [Mon Aug 8 17:33:29 2022] POST /identity/v3/users => generated 160 bytes in 278 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:29.333946 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544a58a-8192-4cdf-a283-9ea5063fb986 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:29.412682 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 494/972] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:33:28 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 17:33:29.420153 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2548f5-e7fd-4463-a65b-5b78355634af None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:29.446497 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:29.455142 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544a58a-8192-4cdf-a283-9ea5063fb986 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:29.493257 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234721d-7067-4996-b068-3580d4000182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:29.493891 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234721d-7067-4996-b068-3580d4000182 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:29.494172 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234721d-7067-4996-b068-3580d4000182 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:29.494444 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234721d-7067-4996-b068-3580d4000182 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:29.502785 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234721d-7067-4996-b068-3580d4000182 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:29.504429 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234721d-7067-4996-b068-3580d4000182 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:29.517197 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-6234721d-7067-4996-b068-3580d4000182 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 17:33:29.517197 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:29.517197 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:29.517197 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:29.517197 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:29.517197 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:29.517197 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:29.517197 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:29.517197 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:29.517197 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:29.517197 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:29.517197 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:29.517197 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:33:29.517197 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:33:29.517197 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:33:29.517197 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:33:29.518266 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:29.518266 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:29.518266 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:33:29.518266 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:33:29.518266 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:33:29.518266 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:33:29.518266 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:29.518266 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:29.518266 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:29.518266 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:29.518266 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:29.518266 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:29.518266 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:29.518266 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:29.518266 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:29.518266 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:29.518266 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:29.518266 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:29.519230 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:29.519230 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:29.519230 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:33:29.519230 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:33:29.519230 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:33:29.519230 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:33:29.519230 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:33:29.519230 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:33:29.519230 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 17:33:29.519230 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:29.519230 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 479/973] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:33:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:29.524217 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234721d-7067-4996-b068-3580d4000182 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:29.532901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2548f5-e7fd-4463-a65b-5b78355634af None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:29.555688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:29.570595 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b300a3-0efc-499e-8025-c5e4e3f1a10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:29.571230 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b300a3-0efc-499e-8025-c5e4e3f1a10a None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:29.571507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b300a3-0efc-499e-8025-c5e4e3f1a10a None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:29.571775 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b300a3-0efc-499e-8025-c5e4e3f1a10a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:29.582992 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b300a3-0efc-499e-8025-c5e4e3f1a10a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:29.584603 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b300a3-0efc-499e-8025-c5e4e3f1a10a None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:29.600591 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-69b300a3-0efc-499e-8025-c5e4e3f1a10a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:29.600591 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:29.600591 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:29.600591 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:29.600591 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:29.600591 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:29.600591 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:29.600591 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:29.600591 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:29.600591 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:29.600591 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:29.600591 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:29.600591 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:33:29.600591 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:33:29.600591 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:33:29.600591 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:33:29.603255 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:29.603255 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:29.603255 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:29.603255 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:29.603255 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:29.603255 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:29.603255 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:29.603255 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:29.603255 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:29.603255 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:29.603255 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:29.603255 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:29.603255 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:29.603255 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:29.603255 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:29.603255 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:29.603255 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:33:29.604158 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:33:29.604158 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:29.604158 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:29.606440 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 495/974] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:33:29.607506 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b300a3-0efc-499e-8025-c5e4e3f1a10a None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:29.638629 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234721d-7067-4996-b068-3580d4000182 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:29.676325 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84b62c-6be9-4ecc-8a7f-416f3a5fa330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:29.677282 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84b62c-6be9-4ecc-8a7f-416f3a5fa330 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:29.677782 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84b62c-6be9-4ecc-8a7f-416f3a5fa330 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:29.678272 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84b62c-6be9-4ecc-8a7f-416f3a5fa330 None admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:29.679162 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84b62c-6be9-4ecc-8a7f-416f3a5fa330 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:29.679661 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84b62c-6be9-4ecc-8a7f-416f3a5fa330 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:29.681388 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84b62c-6be9-4ecc-8a7f-416f3a5fa330 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:29.693650 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:29.716192 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b300a3-0efc-499e-8025-c5e4e3f1a10a None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:29.722878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 480/975] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 8 17:33:29 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:33:29.759543 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41297107-0796-40cc-b683-02836cd40946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:29.760548 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41297107-0796-40cc-b683-02836cd40946 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:29.761069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41297107-0796-40cc-b683-02836cd40946 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:29.761547 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41297107-0796-40cc-b683-02836cd40946 None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:29.762431 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41297107-0796-40cc-b683-02836cd40946 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:29.762999 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41297107-0796-40cc-b683-02836cd40946 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:29.764730 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41297107-0796-40cc-b683-02836cd40946 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:29.778629 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161a1c5-3511-4ddb-a107-5cd231bef85c None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:29.778946 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161a1c5-3511-4ddb-a107-5cd231bef85c None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:29.779184 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161a1c5-3511-4ddb-a107-5cd231bef85c None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:29.780378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 496/976] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:29.781082 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 481/977] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 17:33:29.786657 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161a1c5-3511-4ddb-a107-5cd231bef85c None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:29.786824 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01b4bc-a171-42b6-87ed-5eb54e7d94f6 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:29.787422 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01b4bc-a171-42b6-87ed-5eb54e7d94f6 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:29.787690 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01b4bc-a171-42b6-87ed-5eb54e7d94f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:29.814398 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-6f01b4bc-a171-42b6-87ed-5eb54e7d94f6 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:29.815787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-6f01b4bc-a171-42b6-87ed-5eb54e7d94f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:29.892274 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:29.909649 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161a1c5-3511-4ddb-a107-5cd231bef85c None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:29.917325 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 497/978] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 17:33:29.934881 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01b4bc-a171-42b6-87ed-5eb54e7d94f6 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:29.948122 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e383bfd-e5b1-4e5e-b74d-f6f68263c43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:29.948750 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e383bfd-e5b1-4e5e-b74d-f6f68263c43a None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:29.949056 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e383bfd-e5b1-4e5e-b74d-f6f68263c43a None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:29.949331 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e383bfd-e5b1-4e5e-b74d-f6f68263c43a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:29.958134 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e383bfd-e5b1-4e5e-b74d-f6f68263c43a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:29.960197 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e383bfd-e5b1-4e5e-b74d-f6f68263c43a None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:29.978035 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-2e383bfd-e5b1-4e5e-b74d-f6f68263c43a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:33:29.978035 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:29.978035 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:29.978035 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:29.978035 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:29.978035 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:29.978035 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:29.978035 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:29.978035 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:29.978035 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:29.978035 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:29.978035 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:29.978035 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:33:29.978035 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:33:29.978035 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:33:29.979213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:33:29.979213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:29.979213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:29.979213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:29.979213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:29.979213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:29.979213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:29.979213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:29.979213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:29.979213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:29.979213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:29.979213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:29.979213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:29.979213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:29.979213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:29.979213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:29.979213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:29.980337 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:33:29.980337 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:33:29.980337 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:33:29.980337 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:33:29.980337 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:33:29.980337 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:33:29.980337 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:33:29.980337 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:29.982707 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 482/979] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:33:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:29.991231 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e383bfd-e5b1-4e5e-b74d-f6f68263c43a None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:30.036549 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:30.078354 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01b4bc-a171-42b6-87ed-5eb54e7d94f6 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:30.117746 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7cf83-bf12-4944-a693-cab884501923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:30.118350 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7cf83-bf12-4944-a693-cab884501923 None admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:30.118723 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7cf83-bf12-4944-a693-cab884501923 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:30.119004 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7cf83-bf12-4944-a693-cab884501923 None admin] PATH_INFO: `/v3/services` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:30.119648 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7cf83-bf12-4944-a693-cab884501923 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:30.120159 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e383bfd-e5b1-4e5e-b74d-f6f68263c43a None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:30.121017 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7cf83-bf12-4944-a693-cab884501923 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:30.154860 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a77492-6d38-4102-8dc0-e8e71732d8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:30.155511 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a77492-6d38-4102-8dc0-e8e71732d8f9 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:30.155730 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a77492-6d38-4102-8dc0-e8e71732d8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:30.155992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a77492-6d38-4102-8dc0-e8e71732d8f9 None admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:30.156711 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a77492-6d38-4102-8dc0-e8e71732d8f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:30.157451 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a77492-6d38-4102-8dc0-e8e71732d8f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:30.158907 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a77492-6d38-4102-8dc0-e8e71732d8f9 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:30.171867 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 483/980] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 8 17:33:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:30.178729 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a77492-6d38-4102-8dc0-e8e71732d8f9 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:30.186775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:30.209947 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 498/981] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Aug 8 17:33:29 2022] POST /identity/v3/services => generated 242 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:33:30.295970 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a77492-6d38-4102-8dc0-e8e71732d8f9 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:30.342593 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78afd22-1fe3-4024-89cc-ad30fcdfb241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:30.343201 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78afd22-1fe3-4024-89cc-ad30fcdfb241 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:30.343473 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78afd22-1fe3-4024-89cc-ad30fcdfb241 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:30.343739 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78afd22-1fe3-4024-89cc-ad30fcdfb241 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:30.345583 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78afd22-1fe3-4024-89cc-ad30fcdfb241 None admin] RBAC: Adding query filter params (role.id=b0560db9df8a46708b8b37d306895467, scope.project.id=047a28b7cd11486da9d330723a384812, user.id=c880ab908c114c5897d11aad7fb48607) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:30.345900 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78afd22-1fe3-4024-89cc-ad30fcdfb241 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:30.347350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78afd22-1fe3-4024-89cc-ad30fcdfb241 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:30.361067 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 484/982] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:33:30 2022] GET /identity/v3/role_assignments?user.id=c880ab908c114c5897d11aad7fb48607&scope.project.id=047a28b7cd11486da9d330723a384812&role.id=b0560db9df8a46708b8b37d306895467 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:33:31.181442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef89db8-f73b-46f6-8c21-9009dcb70611 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:31.181985 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef89db8-f73b-46f6-8c21-9009dcb70611 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:31.181985 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef89db8-f73b-46f6-8c21-9009dcb70611 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:31.183595 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 499/983] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:31.189434 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd4e4d-e082-4b0f-81cc-c01609dc09c9 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:31.189820 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd4e4d-e082-4b0f-81cc-c01609dc09c9 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:31.190006 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd4e4d-e082-4b0f-81cc-c01609dc09c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:31.208670 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-c9bd4e4d-e082-4b0f-81cc-c01609dc09c9 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:31.210241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-c9bd4e4d-e082-4b0f-81cc-c01609dc09c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:31.269418 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:31.277304 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 485/984] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:31 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:33:31.299755 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef89db8-f73b-46f6-8c21-9009dcb70611 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:31.411187 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef89db8-f73b-46f6-8c21-9009dcb70611 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:31.438442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:31.446626 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c351476-a4be-4918-8edb-8625ae76879c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:31.447223 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c351476-a4be-4918-8edb-8625ae76879c None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:31.447502 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c351476-a4be-4918-8edb-8625ae76879c None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:31.447772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c351476-a4be-4918-8edb-8625ae76879c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:31.448369 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c351476-a4be-4918-8edb-8625ae76879c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:31.449749 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c351476-a4be-4918-8edb-8625ae76879c None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:31.458836 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-8c351476-a4be-4918-8edb-8625ae76879c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 17:33:31.458836 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:31.458836 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 17:33:31.458836 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 17:33:31.458836 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 17:33:31.458836 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 17:33:31.458836 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 17:33:31.458836 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:31.458836 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 17:33:31.458836 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:31.458836 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 17:33:31.458836 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:31.458836 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:31.458836 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:31.458836 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:31.458836 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:31.458836 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:31.459911 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:31.459911 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:31.459911 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:31.459911 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:31.459911 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:31.459911 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:31.459911 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 17:33:31.459911 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 17:33:31.459911 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 17:33:31.459911 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 17:33:31.459911 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:31.459911 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:31.459911 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:31.459911 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:31.459911 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:31.459911 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:31.460772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:31.460772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:31.460772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:31.460772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:31.460772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:31.460772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:31.460772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:31.460772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:31.460772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:31.460772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:31.460772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 17:33:31.460772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:31.460772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 17:33:31.460772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:31.460772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 500/985] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Aug 8 17:33:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:31.466099 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd4e4d-e082-4b0f-81cc-c01609dc09c9 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:31.569728 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd4e4d-e082-4b0f-81cc-c01609dc09c9 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:31.603985 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5978ba-5a2b-404f-97b5-2aae4b854f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:31.604588 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5978ba-5a2b-404f-97b5-2aae4b854f66 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:31.604868 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5978ba-5a2b-404f-97b5-2aae4b854f66 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:31.605173 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5978ba-5a2b-404f-97b5-2aae4b854f66 None admin] PATH_INFO: `/v3/services` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:31.605799 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5978ba-5a2b-404f-97b5-2aae4b854f66 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:31.606104 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5978ba-5a2b-404f-97b5-2aae4b854f66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:31.607720 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5978ba-5a2b-404f-97b5-2aae4b854f66 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:31.617107 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 486/986] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Aug 8 17:33:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:31.619452 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c351476-a4be-4918-8edb-8625ae76879c None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:31.720372 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c351476-a4be-4918-8edb-8625ae76879c None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:31.755152 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdbf12-5c40-4ea1-bf03-ff83cfaba832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:31.756006 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdbf12-5c40-4ea1-bf03-ff83cfaba832 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:31.756500 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdbf12-5c40-4ea1-bf03-ff83cfaba832 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:31.756958 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdbf12-5c40-4ea1-bf03-ff83cfaba832 None admin] PATH_INFO: `/v3/services` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:31.757811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fdbf12-5c40-4ea1-bf03-ff83cfaba832 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:31.758313 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fdbf12-5c40-4ea1-bf03-ff83cfaba832 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:31.759848 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fdbf12-5c40-4ea1-bf03-ff83cfaba832 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:31.770044 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 501/987] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Aug 8 17:33:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:33:31.771796 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5978ba-5a2b-404f-97b5-2aae4b854f66 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:31.832719 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:31.874102 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5978ba-5a2b-404f-97b5-2aae4b854f66 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:31.909315 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab5f5f-e7bd-4b2b-8033-6c2e87076be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:31.910215 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab5f5f-e7bd-4b2b-8033-6c2e87076be6 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:31.910688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab5f5f-e7bd-4b2b-8033-6c2e87076be6 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:31.911174 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab5f5f-e7bd-4b2b-8033-6c2e87076be6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:31.912064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab5f5f-e7bd-4b2b-8033-6c2e87076be6 None admin] RBAC: Adding query filter params (interface=admin, service_id=d82522b2d87f47d4b39b9b95e981dd9f, region_id=RegionOne) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:31.912558 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab5f5f-e7bd-4b2b-8033-6c2e87076be6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:31.914140 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab5f5f-e7bd-4b2b-8033-6c2e87076be6 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:31.924450 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 487/988] 10.222.0.70 () {56 vars in 1249 bytes} [Mon Aug 8 17:33:31 2022] GET /identity/v3/endpoints?service_id=d82522b2d87f47d4b39b9b95e981dd9f&interface=admin®ion_id=RegionOne => generated 193 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:31.926230 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdbf12-5c40-4ea1-bf03-ff83cfaba832 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:31.984397 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:32.028888 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdbf12-5c40-4ea1-bf03-ff83cfaba832 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:32.063714 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327363c-3d8c-4902-a831-8e91f8d63662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:32.064318 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327363c-3d8c-4902-a831-8e91f8d63662 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:32.064601 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327363c-3d8c-4902-a831-8e91f8d63662 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:32.064874 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327363c-3d8c-4902-a831-8e91f8d63662 None admin] PATH_INFO: `/v3/services` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:32.065502 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0327363c-3d8c-4902-a831-8e91f8d63662 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:32.066863 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0327363c-3d8c-4902-a831-8e91f8d63662 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:32.077115 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 502/989] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Aug 8 17:33:31 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:33:32.274115 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d1268-972b-4204-967a-a4be9f626d8d None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:32.274651 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d1268-972b-4204-967a-a4be9f626d8d None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:32.274651 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d1268-972b-4204-967a-a4be9f626d8d None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:32.276085 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 488/990] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:32.281076 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61e92d-1b17-4e3f-9968-f7f6c34063d1 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:32.281509 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61e92d-1b17-4e3f-9968-f7f6c34063d1 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:32.281697 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61e92d-1b17-4e3f-9968-f7f6c34063d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:32.300067 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-af61e92d-1b17-4e3f-9968-f7f6c34063d1 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:32.301284 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-af61e92d-1b17-4e3f-9968-f7f6c34063d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:32.369869 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 503/991] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:32 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:33:32.394701 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d1268-972b-4204-967a-a4be9f626d8d None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:32.437634 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36615989-69aa-44dc-9cf9-3f1d0b6e9527 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:32.438540 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36615989-69aa-44dc-9cf9-3f1d0b6e9527 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:32.438540 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36615989-69aa-44dc-9cf9-3f1d0b6e9527 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:32.439885 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 504/992] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 17:33:32.444684 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9d9df-a6c4-483f-877f-7f7df2243635 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:32.444968 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9d9df-a6c4-483f-877f-7f7df2243635 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:32.445273 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9d9df-a6c4-483f-877f-7f7df2243635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:32.464614 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-69a9d9df-a6c4-483f-877f-7f7df2243635 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:32.465832 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-69a9d9df-a6c4-483f-877f-7f7df2243635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:32.510703 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d1268-972b-4204-967a-a4be9f626d8d None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:32.523646 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:32.543403 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:32.544879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 505/993] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:32 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 17:33:32.549759 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fadc0-ea8a-4949-aab0-e811acb0c40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:32.550390 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fadc0-ea8a-4949-aab0-e811acb0c40c None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:32.550671 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fadc0-ea8a-4949-aab0-e811acb0c40c None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:32.550945 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fadc0-ea8a-4949-aab0-e811acb0c40c None admin] PATH_INFO: `/v3/services/compute` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:32.551525 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3fadc0-ea8a-4949-aab0-e811acb0c40c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:32.552884 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3fadc0-ea8a-4949-aab0-e811acb0c40c None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:32.561461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-3c3fadc0-ea8a-4949-aab0-e811acb0c40c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 17:33:32.561461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:32.561461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 17:33:32.561461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 17:33:32.561461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 17:33:32.561461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 17:33:32.561461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 17:33:32.561461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:32.561461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 17:33:32.561461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:32.561461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 17:33:32.561461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:32.561461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:32.561461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:32.561461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:32.561461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:32.561461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:32.562500 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:32.562500 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:32.562500 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:32.562500 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:32.562500 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:32.562500 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:32.562500 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 17:33:32.562500 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 17:33:32.562500 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 17:33:32.562500 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 17:33:32.562500 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:32.562500 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:32.562500 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:32.562500 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:32.562500 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:32.562500 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:32.563449 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:32.563449 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:32.563449 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:32.563449 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:32.563449 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:32.563449 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:32.563449 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:32.563449 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:32.563449 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:32.563449 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:32.563449 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 17:33:32.563449 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:32.563449 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 17:33:32.563449 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:32.565403 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 489/994] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:33:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:32.568432 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fadc0-ea8a-4949-aab0-e811acb0c40c None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:32.568639 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9d9df-a6c4-483f-877f-7f7df2243635 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:32.673922 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fadc0-ea8a-4949-aab0-e811acb0c40c None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:32.676678 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9d9df-a6c4-483f-877f-7f7df2243635 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:32.707919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99701010-97c0-448e-9c04-2b982d9a4371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:32.708524 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99701010-97c0-448e-9c04-2b982d9a4371 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:32.708801 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99701010-97c0-448e-9c04-2b982d9a4371 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:32.709098 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99701010-97c0-448e-9c04-2b982d9a4371 None admin] PATH_INFO: `/v3/services` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:32.709778 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99701010-97c0-448e-9c04-2b982d9a4371 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:32.710097 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99701010-97c0-448e-9c04-2b982d9a4371 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:32.711265 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13178dc2-59d0-4075-a9e9-d6079e4ab56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:32.711382 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99701010-97c0-448e-9c04-2b982d9a4371 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:32.711896 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13178dc2-59d0-4075-a9e9-d6079e4ab56f None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:32.712180 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13178dc2-59d0-4075-a9e9-d6079e4ab56f None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:32.712456 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13178dc2-59d0-4075-a9e9-d6079e4ab56f None admin] PATH_INFO: `/v3/services/image` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:32.713052 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13178dc2-59d0-4075-a9e9-d6079e4ab56f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:32.714409 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13178dc2-59d0-4075-a9e9-d6079e4ab56f None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:32.722082 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 490/995] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Aug 8 17:33:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:32.723391 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99701010-97c0-448e-9c04-2b982d9a4371 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:32.733256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-13178dc2-59d0-4075-a9e9-d6079e4ab56f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 17:33:32.733256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:32.733256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 17:33:32.733256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 17:33:32.733256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 17:33:32.733256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 17:33:32.733256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 17:33:32.733256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:32.733256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 17:33:32.733256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:32.733256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 17:33:32.733256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:32.733256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:32.733256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:32.733256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:32.733256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:32.733256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:32.734274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:32.734274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:32.734274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:32.734274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:32.734274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:32.734274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:32.734274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 17:33:32.734274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 17:33:32.734274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 17:33:32.734274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 17:33:32.734274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:32.734274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:32.734274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:32.734274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:32.734274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:32.734274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:32.735980 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:32.735980 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:32.735980 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:32.735980 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:32.735980 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:32.735980 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:32.735980 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:32.735980 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:32.735980 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:32.735980 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:32.735980 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 17:33:32.735980 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:32.735980 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 17:33:32.735980 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:32.736819 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 506/996] 10.222.0.70 () {56 vars in 1105 bytes} [Mon Aug 8 17:33:32 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:32.741953 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13178dc2-59d0-4075-a9e9-d6079e4ab56f None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:32.790002 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:32.795679 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:32.846061 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99701010-97c0-448e-9c04-2b982d9a4371 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:32.846997 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13178dc2-59d0-4075-a9e9-d6079e4ab56f None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:32.883680 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f92ee1-c16f-404b-8c13-4690d27afe80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:32.884538 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f92ee1-c16f-404b-8c13-4690d27afe80 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:32.884780 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f92ee1-c16f-404b-8c13-4690d27afe80 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:32.885172 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026778e-2750-4652-8992-871c446b1fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:32.885313 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f92ee1-c16f-404b-8c13-4690d27afe80 None admin] PATH_INFO: `/v3/services` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:32.885778 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026778e-2750-4652-8992-871c446b1fbe None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:32.885892 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f92ee1-c16f-404b-8c13-4690d27afe80 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:32.886060 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026778e-2750-4652-8992-871c446b1fbe None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:32.886162 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f92ee1-c16f-404b-8c13-4690d27afe80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:32.886331 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026778e-2750-4652-8992-871c446b1fbe None admin] PATH_INFO: `/v3/services` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:32.886955 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026778e-2750-4652-8992-871c446b1fbe None admin] RBAC: Adding query filter params (name=image) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:32.887260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026778e-2750-4652-8992-871c446b1fbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:32.887413 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f92ee1-c16f-404b-8c13-4690d27afe80 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:32.888600 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026778e-2750-4652-8992-871c446b1fbe None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:32.897334 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 491/997] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Aug 8 17:33:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:33:32.897479 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 507/998] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:33:32.898101 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f92ee1-c16f-404b-8c13-4690d27afe80 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:32.899260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026778e-2750-4652-8992-871c446b1fbe None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:33.003459 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f92ee1-c16f-404b-8c13-4690d27afe80 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:33.007615 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026778e-2750-4652-8992-871c446b1fbe None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:33.016747 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:33.020771 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:33.038068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6507e-f758-4ea2-96a6-38ccfec3bbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:33.038672 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6507e-f758-4ea2-96a6-38ccfec3bbd5 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:33.038977 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6507e-f758-4ea2-96a6-38ccfec3bbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:33.039253 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6507e-f758-4ea2-96a6-38ccfec3bbd5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:33.039950 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6507e-f758-4ea2-96a6-38ccfec3bbd5 None admin] RBAC: Adding query filter params (interface=public, service_id=c46be04b7e5749d4a223bdabd80eeed8, region_id=RegionOne) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:33.040256 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6507e-f758-4ea2-96a6-38ccfec3bbd5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:33.041648 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6507e-f758-4ea2-96a6-38ccfec3bbd5 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:33.044680 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7919a1e-77d9-4d2a-b492-ba7406f17f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:33.045320 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7919a1e-77d9-4d2a-b492-ba7406f17f46 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:33.045606 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7919a1e-77d9-4d2a-b492-ba7406f17f46 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:33.045934 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7919a1e-77d9-4d2a-b492-ba7406f17f46 None admin] PATH_INFO: `/v3/services` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:33.046540 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7919a1e-77d9-4d2a-b492-ba7406f17f46 None admin] RBAC: Adding query filter params (type=image) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:33.051765 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7919a1e-77d9-4d2a-b492-ba7406f17f46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:33.051940 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 492/999] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Aug 8 17:33:32 2022] GET /identity/v3/endpoints?service_id=c46be04b7e5749d4a223bdabd80eeed8&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:33:33.052126 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7919a1e-77d9-4d2a-b492-ba7406f17f46 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:33.052916 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6507e-f758-4ea2-96a6-38ccfec3bbd5 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:33.056326 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 508/1000] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:32 2022] GET /identity/v3/services?type=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:33:33.165638 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6507e-f758-4ea2-96a6-38ccfec3bbd5 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:33.203065 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdfb87f-7f1b-4898-8a5e-8620deda7dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:33.203974 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfb87f-7f1b-4898-8a5e-8620deda7dde None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:33.204261 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfb87f-7f1b-4898-8a5e-8620deda7dde None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:33.204538 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfb87f-7f1b-4898-8a5e-8620deda7dde None admin] PATH_INFO: `/v3/services` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:33.205183 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdfb87f-7f1b-4898-8a5e-8620deda7dde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:33.206596 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdfb87f-7f1b-4898-8a5e-8620deda7dde None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:33.214139 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 493/1001] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Aug 8 17:33:33 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:33:34.158263 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf08ead-d353-498d-a6e0-22497c578aaa None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:34.158784 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf08ead-d353-498d-a6e0-22497c578aaa None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:34.158784 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf08ead-d353-498d-a6e0-22497c578aaa None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:34.160302 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 509/1002] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:34.165502 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c29552-4de7-459b-bd75-19b24d4202ac None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:34.165994 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c29552-4de7-459b-bd75-19b24d4202ac None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:34.166072 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c29552-4de7-459b-bd75-19b24d4202ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:34.185458 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-79c29552-4de7-459b-bd75-19b24d4202ac None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:34.186641 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-79c29552-4de7-459b-bd75-19b24d4202ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:34.230107 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:34.258220 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 494/1003] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:34 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:33:34.281846 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf08ead-d353-498d-a6e0-22497c578aaa None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:34.388725 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf08ead-d353-498d-a6e0-22497c578aaa None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:34.432208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59983ee5-b5b3-48cb-bdc8-59c7f5f1eb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:34.432834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59983ee5-b5b3-48cb-bdc8-59c7f5f1eb49 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:34.433150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59983ee5-b5b3-48cb-bdc8-59c7f5f1eb49 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:34.433424 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59983ee5-b5b3-48cb-bdc8-59c7f5f1eb49 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:34.433999 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59983ee5-b5b3-48cb-bdc8-59c7f5f1eb49 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:34.435356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59983ee5-b5b3-48cb-bdc8-59c7f5f1eb49 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:34.443857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-59983ee5-b5b3-48cb-bdc8-59c7f5f1eb49 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 17:33:34.443857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:34.443857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 17:33:34.443857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 17:33:34.443857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 17:33:34.443857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 17:33:34.443857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 17:33:34.443857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:34.443857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 17:33:34.443857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:34.443857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 17:33:34.443857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:34.443857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:34.443857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:34.443857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:34.443857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:34.443857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:34.444916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:34.444916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:34.444916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:34.444916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:34.444916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:34.444916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:34.444916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 17:33:34.444916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 17:33:34.444916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 17:33:34.444916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 17:33:34.444916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:34.444916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:34.444916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:34.444916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:34.444916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:34.444916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:34.450039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:34.450039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:34.450039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:34.450039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:34.450039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:34.450039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:34.450039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:34.450039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:34.450039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:34.450039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:34.450039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 17:33:34.450039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:34.450039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 17:33:34.450039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:34.450039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 510/1004] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Aug 8 17:33:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:34.453621 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c29552-4de7-459b-bd75-19b24d4202ac None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:34.554868 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c29552-4de7-459b-bd75-19b24d4202ac None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:34.589913 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc7c39-6d09-4a41-a7bd-53442fa2b246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:34.590520 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc7c39-6d09-4a41-a7bd-53442fa2b246 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:34.590799 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc7c39-6d09-4a41-a7bd-53442fa2b246 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:34.591070 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc7c39-6d09-4a41-a7bd-53442fa2b246 None admin] PATH_INFO: `/v3/services` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:34.591695 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc7c39-6d09-4a41-a7bd-53442fa2b246 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:34.591994 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc7c39-6d09-4a41-a7bd-53442fa2b246 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:34.593394 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc7c39-6d09-4a41-a7bd-53442fa2b246 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:34.598464 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 495/1005] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Aug 8 17:33:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:34.603885 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59983ee5-b5b3-48cb-bdc8-59c7f5f1eb49 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:34.641984 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:34.709125 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59983ee5-b5b3-48cb-bdc8-59c7f5f1eb49 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:34.744196 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4470f3a-d797-4635-9b04-ff6ebb35c913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:34.744800 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4470f3a-d797-4635-9b04-ff6ebb35c913 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:34.745103 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4470f3a-d797-4635-9b04-ff6ebb35c913 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:34.745379 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4470f3a-d797-4635-9b04-ff6ebb35c913 None admin] PATH_INFO: `/v3/services` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:34.746006 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4470f3a-d797-4635-9b04-ff6ebb35c913 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:34.746305 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4470f3a-d797-4635-9b04-ff6ebb35c913 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:34.747659 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4470f3a-d797-4635-9b04-ff6ebb35c913 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:34.758746 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 511/1006] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Aug 8 17:33:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:34.759738 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc7c39-6d09-4a41-a7bd-53442fa2b246 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:34.801532 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:34.862535 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc7c39-6d09-4a41-a7bd-53442fa2b246 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:34.898623 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5ebf7-5378-4c6e-996c-9c43d70fca40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:34.899231 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5ebf7-5378-4c6e-996c-9c43d70fca40 None admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:34.899510 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5ebf7-5378-4c6e-996c-9c43d70fca40 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:34.899781 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5ebf7-5378-4c6e-996c-9c43d70fca40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:34.900453 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5ebf7-5378-4c6e-996c-9c43d70fca40 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:34.901846 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5ebf7-5378-4c6e-996c-9c43d70fca40 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:34.969492 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 496/1007] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:33:34 2022] POST /identity/v3/endpoints => generated 325 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:33:35.084840 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e42697-9dc3-4fb1-b66a-a6034629299c None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:35.085169 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e42697-9dc3-4fb1-b66a-a6034629299c None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:35.085425 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e42697-9dc3-4fb1-b66a-a6034629299c None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:35.089426 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 512/1008] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:35.092394 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c61987-b98d-419b-9b86-1cb0d31f1088 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:35.092689 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c61987-b98d-419b-9b86-1cb0d31f1088 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:35.092964 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c61987-b98d-419b-9b86-1cb0d31f1088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:35.112784 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-92c61987-b98d-419b-9b86-1cb0d31f1088 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:35.114113 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-92c61987-b98d-419b-9b86-1cb0d31f1088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:35.193943 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 497/1009] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:35 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:33:35.216376 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e42697-9dc3-4fb1-b66a-a6034629299c None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:35.253129 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc8240-9466-42f6-9ec3-47af345ce539 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:35.253325 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc8240-9466-42f6-9ec3-47af345ce539 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:35.253589 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc8240-9466-42f6-9ec3-47af345ce539 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:35.254942 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 498/1010] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:35.259809 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99da31-1bf2-44da-8b7a-5660953f0952 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:35.260093 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99da31-1bf2-44da-8b7a-5660953f0952 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:35.260369 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99da31-1bf2-44da-8b7a-5660953f0952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:35.278584 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-4f99da31-1bf2-44da-8b7a-5660953f0952 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:35.279782 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-4f99da31-1bf2-44da-8b7a-5660953f0952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:35.298503 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:35.327653 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:35.331941 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e42697-9dc3-4fb1-b66a-a6034629299c None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:35.354511 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 499/1011] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:35 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 17:33:35.369732 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f120f-591f-41c3-bed7-c22910a6ff5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:35.370341 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f120f-591f-41c3-bed7-c22910a6ff5c None admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:35.370687 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f120f-591f-41c3-bed7-c22910a6ff5c None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:35.370961 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f120f-591f-41c3-bed7-c22910a6ff5c None admin] PATH_INFO: `/v3/services` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:35.371607 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f120f-591f-41c3-bed7-c22910a6ff5c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:35.372972 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f120f-591f-41c3-bed7-c22910a6ff5c None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:35.378509 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99da31-1bf2-44da-8b7a-5660953f0952 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:35.455192 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 513/1012] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Aug 8 17:33:35 2022] POST /identity/v3/services => generated 242 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:33:35.489057 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99da31-1bf2-44da-8b7a-5660953f0952 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:35.535052 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab51c44-a73c-4b86-808a-29deb1d50942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:35.535617 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab51c44-a73c-4b86-808a-29deb1d50942 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:35.535900 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab51c44-a73c-4b86-808a-29deb1d50942 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:35.536176 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab51c44-a73c-4b86-808a-29deb1d50942 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:35.536767 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab51c44-a73c-4b86-808a-29deb1d50942 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:35.538216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab51c44-a73c-4b86-808a-29deb1d50942 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:35.548435 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-eab51c44-a73c-4b86-808a-29deb1d50942 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 17:33:35.548435 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:35.548435 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 17:33:35.548435 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 17:33:35.548435 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 17:33:35.548435 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 17:33:35.548435 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 17:33:35.548435 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:35.548435 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 17:33:35.548435 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:35.548435 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 17:33:35.548435 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:35.548435 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:35.548435 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:35.548435 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:35.548435 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:35.548435 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:35.549931 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:35.549931 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:35.549931 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:35.549931 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:35.549931 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:35.549931 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:35.549931 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 17:33:35.549931 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 17:33:35.549931 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 17:33:35.549931 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 17:33:35.549931 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:35.549931 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:35.549931 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:35.549931 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:35.549931 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:35.549931 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:35.550840 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:35.550840 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:35.550840 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:35.550840 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:35.550840 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:35.550840 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:35.550840 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:35.550840 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:35.550840 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:35.550840 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:35.550840 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 17:33:35.550840 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:35.550840 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 17:33:35.550840 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:35.553509 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 500/1013] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:33:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:35.555707 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f120f-591f-41c3-bed7-c22910a6ff5c None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:35.666032 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f120f-591f-41c3-bed7-c22910a6ff5c None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:35.700407 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78470f50-3bba-4945-947f-afd5ba501e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:35.701015 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78470f50-3bba-4945-947f-afd5ba501e5b None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:35.701318 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78470f50-3bba-4945-947f-afd5ba501e5b None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:35.701586 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78470f50-3bba-4945-947f-afd5ba501e5b None admin] PATH_INFO: `/v3/services` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:35.702209 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78470f50-3bba-4945-947f-afd5ba501e5b None admin] RBAC: Adding query filter params (name=compute) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:35.702506 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78470f50-3bba-4945-947f-afd5ba501e5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:35.705120 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78470f50-3bba-4945-947f-afd5ba501e5b None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:35.710154 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 514/1014] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Aug 8 17:33:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:35.715534 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab51c44-a73c-4b86-808a-29deb1d50942 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:35.732401 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:35.823642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab51c44-a73c-4b86-808a-29deb1d50942 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:35.858015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc458e3-0bfc-4bb9-9521-985c4a079f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:35.858612 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc458e3-0bfc-4bb9-9521-985c4a079f38 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:35.858891 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc458e3-0bfc-4bb9-9521-985c4a079f38 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:35.859159 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc458e3-0bfc-4bb9-9521-985c4a079f38 None admin] PATH_INFO: `/v3/services` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:35.860819 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc458e3-0bfc-4bb9-9521-985c4a079f38 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:35.861152 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc458e3-0bfc-4bb9-9521-985c4a079f38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:35.862514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc458e3-0bfc-4bb9-9521-985c4a079f38 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:35.867396 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 501/1015] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Aug 8 17:33:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:35.872783 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78470f50-3bba-4945-947f-afd5ba501e5b None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:35.900563 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:35.979124 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78470f50-3bba-4945-947f-afd5ba501e5b None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:36.014681 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93dc6e-b14a-4c98-9e7c-3b7dedfa7faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:36.015289 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93dc6e-b14a-4c98-9e7c-3b7dedfa7faf None admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:36.016300 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93dc6e-b14a-4c98-9e7c-3b7dedfa7faf None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:36.016739 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93dc6e-b14a-4c98-9e7c-3b7dedfa7faf None admin] PATH_INFO: `/v3/endpoints` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:36.017466 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93dc6e-b14a-4c98-9e7c-3b7dedfa7faf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:36.018842 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93dc6e-b14a-4c98-9e7c-3b7dedfa7faf None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:36.080154 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 515/1016] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:33:35 2022] POST /identity/v3/endpoints => generated 334 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:33:37.025922 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbc811-5c0e-4291-994e-4524ed077c2f None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:37.026451 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbc811-5c0e-4291-994e-4524ed077c2f None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:37.026451 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbc811-5c0e-4291-994e-4524ed077c2f None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:37.027948 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 502/1017] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:37.033301 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47354d-badd-4280-b1a5-0886c8269fcd None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:37.033683 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47354d-badd-4280-b1a5-0886c8269fcd None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:37.033853 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47354d-badd-4280-b1a5-0886c8269fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:37.052330 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-2f47354d-badd-4280-b1a5-0886c8269fcd None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:37.053540 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-2f47354d-badd-4280-b1a5-0886c8269fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:37.127061 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 516/1018] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:37 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:33:37.149549 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbc811-5c0e-4291-994e-4524ed077c2f None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:37.233565 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:37.256768 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbc811-5c0e-4291-994e-4524ed077c2f None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:37.294066 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3004206-6de9-44a9-aeb1-90fd9e842b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:37.294988 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3004206-6de9-44a9-aeb1-90fd9e842b93 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:37.295448 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3004206-6de9-44a9-aeb1-90fd9e842b93 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:37.295893 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3004206-6de9-44a9-aeb1-90fd9e842b93 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:37.297666 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3004206-6de9-44a9-aeb1-90fd9e842b93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:37.299272 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3004206-6de9-44a9-aeb1-90fd9e842b93 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:37.301344 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 503/1019] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:37.306976 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47354d-badd-4280-b1a5-0886c8269fcd None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:37.317005 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:37.421202 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47354d-badd-4280-b1a5-0886c8269fcd None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:37.457386 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1ecd8-be2e-4d13-bd80-4d2fa4272ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:37.458001 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1ecd8-be2e-4d13-bd80-4d2fa4272ca0 None admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:37.458281 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1ecd8-be2e-4d13-bd80-4d2fa4272ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:37.458553 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1ecd8-be2e-4d13-bd80-4d2fa4272ca0 None admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:37.459222 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1ecd8-be2e-4d13-bd80-4d2fa4272ca0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:37.460637 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1ecd8-be2e-4d13-bd80-4d2fa4272ca0 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:37.513155 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35813e-08c2-455c-944f-dbad784d77a6 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:37.513446 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35813e-08c2-455c-944f-dbad784d77a6 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:37.513725 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35813e-08c2-455c-944f-dbad784d77a6 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:37.515093 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 504/1020] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 17:33:37.519993 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a9502-5c94-4733-b3b9-2ab808cd1016 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:37.520280 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a9502-5c94-4733-b3b9-2ab808cd1016 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:37.520554 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a9502-5c94-4733-b3b9-2ab808cd1016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:37.538589 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-d03a9502-5c94-4733-b3b9-2ab808cd1016 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:37.539772 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-d03a9502-5c94-4733-b3b9-2ab808cd1016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:37.570095 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 517/1021] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Aug 8 17:33:37 2022] POST /identity/v3/projects => generated 311 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:33:37.614094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 505/1022] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:37 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 17:33:37.637658 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1ecd8-be2e-4d13-bd80-4d2fa4272ca0 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:37.718048 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:37.763816 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1ecd8-be2e-4d13-bd80-4d2fa4272ca0 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:37.804563 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9ab8c-1462-46d0-9471-210b8be96a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:37.805621 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9ab8c-1462-46d0-9471-210b8be96a04 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:37.806134 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9ab8c-1462-46d0-9471-210b8be96a04 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:37.806606 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9ab8c-1462-46d0-9471-210b8be96a04 None admin] PATH_INFO: `/v3/services/image` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:37.807400 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9ab8c-1462-46d0-9471-210b8be96a04 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:37.808760 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9ab8c-1462-46d0-9471-210b8be96a04 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:37.818997 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-0ec9ab8c-1462-46d0-9471-210b8be96a04 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 17:33:37.818997 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:37.818997 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 17:33:37.818997 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 17:33:37.818997 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 17:33:37.818997 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 17:33:37.818997 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 17:33:37.818997 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:37.818997 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 17:33:37.818997 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:37.818997 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 17:33:37.818997 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:37.818997 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:37.818997 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:37.818997 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:37.818997 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:37.818997 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:37.820026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:37.820026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:37.820026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:37.820026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:37.820026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:37.820026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:37.820026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 17:33:37.820026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 17:33:37.820026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 17:33:37.820026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 17:33:37.820026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:37.820026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:37.820026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:37.820026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:37.820026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:37.820026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:37.821009 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:37.821009 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:37.821009 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:37.821009 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:37.821009 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:37.821009 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:37.821009 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:37.821009 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:37.821009 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:37.821009 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:37.821009 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 17:33:37.821009 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:37.821009 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 17:33:37.821009 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:37.821009 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 518/1023] 10.222.0.70 () {56 vars in 1105 bytes} [Mon Aug 8 17:33:37 2022] GET /identity/v3/services/image => generated 86 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:37.826572 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a9502-5c94-4733-b3b9-2ab808cd1016 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:37.915810 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:37.941520 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a9502-5c94-4733-b3b9-2ab808cd1016 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:37.979679 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36237f9b-4122-4fc0-823a-634c7090bcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:37.980666 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36237f9b-4122-4fc0-823a-634c7090bcd1 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:37.981215 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36237f9b-4122-4fc0-823a-634c7090bcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:37.981670 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36237f9b-4122-4fc0-823a-634c7090bcd1 None admin] PATH_INFO: `/v3/services` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:37.982768 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36237f9b-4122-4fc0-823a-634c7090bcd1 None admin] RBAC: Adding query filter params (name=image) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:37.983270 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36237f9b-4122-4fc0-823a-634c7090bcd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:37.985555 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36237f9b-4122-4fc0-823a-634c7090bcd1 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:37.991425 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 506/1024] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:37.998283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9ab8c-1462-46d0-9471-210b8be96a04 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:38.107844 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9ab8c-1462-46d0-9471-210b8be96a04 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:38.131102 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:38.143029 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3d64e-7067-4b61-b64f-f4770514e1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:38.143636 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3d64e-7067-4b61-b64f-f4770514e1ee None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:38.143916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3d64e-7067-4b61-b64f-f4770514e1ee None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:38.144186 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3d64e-7067-4b61-b64f-f4770514e1ee None admin] PATH_INFO: `/v3/services` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:38.144813 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3d64e-7067-4b61-b64f-f4770514e1ee None admin] RBAC: Adding query filter params (type=image) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:38.145136 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3d64e-7067-4b61-b64f-f4770514e1ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:38.147635 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3d64e-7067-4b61-b64f-f4770514e1ee None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:38.151916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 519/1025] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:38.158890 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36237f9b-4122-4fc0-823a-634c7090bcd1 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:38.251828 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee4e67-6a9a-4100-833f-937e52010697 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:38.252111 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee4e67-6a9a-4100-833f-937e52010697 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:38.252389 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee4e67-6a9a-4100-833f-937e52010697 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:38.253775 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 520/1026] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 17:33:38.259236 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10554c47-c4f0-4c62-b740-f2984015e5ea None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:38.259519 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10554c47-c4f0-4c62-b740-f2984015e5ea None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:38.259797 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10554c47-c4f0-4c62-b740-f2984015e5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:38.264483 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36237f9b-4122-4fc0-823a-634c7090bcd1 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:38.277982 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-10554c47-c4f0-4c62-b740-f2984015e5ea None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:38.279170 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-10554c47-c4f0-4c62-b740-f2984015e5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:38.304218 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab869b-88c7-4f1b-b9ec-2eb00f758a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:38.304830 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab869b-88c7-4f1b-b9ec-2eb00f758a13 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:38.305157 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab869b-88c7-4f1b-b9ec-2eb00f758a13 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:38.305437 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab869b-88c7-4f1b-b9ec-2eb00f758a13 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:38.306139 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab869b-88c7-4f1b-b9ec-2eb00f758a13 None admin] RBAC: Adding query filter params (interface=public, service_id=edd0403fdfac40cdb17e45eb8d82d26e, region_id=RegionOne) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:38.306451 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab869b-88c7-4f1b-b9ec-2eb00f758a13 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:38.307828 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab869b-88c7-4f1b-b9ec-2eb00f758a13 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:38.317387 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 507/1027] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Aug 8 17:33:38 2022] GET /identity/v3/endpoints?service_id=edd0403fdfac40cdb17e45eb8d82d26e&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:38.318391 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab869b-88c7-4f1b-b9ec-2eb00f758a13 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:38.325717 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:38.365251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 521/1028] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:38 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 17:33:38.378020 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10554c47-c4f0-4c62-b740-f2984015e5ea None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:38.433259 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab869b-88c7-4f1b-b9ec-2eb00f758a13 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:38.466975 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0829cd7-a177-4bbe-964b-503ebf9d89ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:38.467579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0829cd7-a177-4bbe-964b-503ebf9d89ed None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:38.467860 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0829cd7-a177-4bbe-964b-503ebf9d89ed None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:38.468133 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0829cd7-a177-4bbe-964b-503ebf9d89ed None admin] PATH_INFO: `/v3/services` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:38.468789 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0829cd7-a177-4bbe-964b-503ebf9d89ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:38.470294 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0829cd7-a177-4bbe-964b-503ebf9d89ed None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:38.485059 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 508/1029] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Aug 8 17:33:38 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:33:38.499682 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10554c47-c4f0-4c62-b740-f2984015e5ea None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:38.519855 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:38.539584 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5748a6e-931f-486e-8fb0-f1c059e9e15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:38.540238 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5748a6e-931f-486e-8fb0-f1c059e9e15e None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:38.540518 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5748a6e-931f-486e-8fb0-f1c059e9e15e None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:38.540838 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5748a6e-931f-486e-8fb0-f1c059e9e15e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:38.553994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5748a6e-931f-486e-8fb0-f1c059e9e15e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:33:38.558966 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-a5748a6e-931f-486e-8fb0-f1c059e9e15e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 17:33:38.558966 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:38.558966 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:38.558966 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:38.558966 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:38.558966 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:38.558966 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:38.558966 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:38.558966 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:38.558966 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:38.558966 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:38.558966 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:38.558966 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:33:38.558966 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:33:38.558966 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:33:38.558966 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:33:38.559986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:33:38.559986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:33:38.559986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:33:38.559986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:33:38.559986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:38.559986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:38.559986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:38.559986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:38.559986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:38.559986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:38.559986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:38.559986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:38.559986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:38.559986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:38.559986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:38.559986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:38.560854 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:38.560854 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:38.560854 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:38.560854 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:38.560854 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:33:38.560854 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:33:38.560854 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:33:38.560854 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:33:38.560854 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:33:38.560854 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:33:38.560854 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 17:33:38.560854 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:38.566045 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 522/1030] 10.222.0.70 () {56 vars in 1120 bytes} [Mon Aug 8 17:33:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:33:38.567302 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0829cd7-a177-4bbe-964b-503ebf9d89ed None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:38.639378 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:38.674604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0829cd7-a177-4bbe-964b-503ebf9d89ed None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:38.710743 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e0866-f150-4953-b164-1bc6dc8fbe9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:38.711343 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e0866-f150-4953-b164-1bc6dc8fbe9b None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:38.711618 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e0866-f150-4953-b164-1bc6dc8fbe9b None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:38.711890 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e0866-f150-4953-b164-1bc6dc8fbe9b None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:38.712545 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e0866-f150-4953-b164-1bc6dc8fbe9b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:38.712846 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e0866-f150-4953-b164-1bc6dc8fbe9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:38.714242 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e0866-f150-4953-b164-1bc6dc8fbe9b None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:38.723047 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 509/1031] 10.222.0.70 () {56 vars in 1115 bytes} [Mon Aug 8 17:33:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:38.728897 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5748a6e-931f-486e-8fb0-f1c059e9e15e None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:38.836806 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5748a6e-931f-486e-8fb0-f1c059e9e15e None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:38.872359 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93469784-f017-438f-a30a-6adde735d5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:38.872989 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93469784-f017-438f-a30a-6adde735d5f0 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:38.873298 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93469784-f017-438f-a30a-6adde735d5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:38.873574 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93469784-f017-438f-a30a-6adde735d5f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:38.883753 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93469784-f017-438f-a30a-6adde735d5f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:38.885222 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93469784-f017-438f-a30a-6adde735d5f0 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:38.899845 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-93469784-f017-438f-a30a-6adde735d5f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:38.899845 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:38.899845 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:38.899845 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:38.899845 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:38.899845 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:38.899845 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:38.899845 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:38.899845 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:38.899845 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:38.899845 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:38.899845 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:38.899845 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:33:38.899845 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:33:38.899845 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:33:38.899845 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:33:38.900808 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:38.900808 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:38.900808 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:38.900808 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:38.900808 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:38.900808 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:38.900808 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:38.900808 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:38.900808 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:38.900808 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:38.900808 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:38.900808 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:38.900808 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:38.900808 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:38.900808 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:38.900808 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:38.900808 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:33:38.901775 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:33:38.901775 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:38.901775 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:38.905099 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 523/1032] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:33:38.907848 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e0866-f150-4953-b164-1bc6dc8fbe9b None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:39.009305 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e0866-f150-4953-b164-1bc6dc8fbe9b None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:39.037817 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:39.044113 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1aee20-0dff-4ce3-924e-73aed8331b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:39.044715 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1aee20-0dff-4ce3-924e-73aed8331b4f None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:39.044997 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1aee20-0dff-4ce3-924e-73aed8331b4f None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:39.045309 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1aee20-0dff-4ce3-924e-73aed8331b4f None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:39.045951 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1aee20-0dff-4ce3-924e-73aed8331b4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:39.046251 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1aee20-0dff-4ce3-924e-73aed8331b4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:39.048196 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1aee20-0dff-4ce3-924e-73aed8331b4f None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:39.060068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 510/1033] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:39.065637 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93469784-f017-438f-a30a-6adde735d5f0 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:39.098588 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:39.174353 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93469784-f017-438f-a30a-6adde735d5f0 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:39.209262 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e12dc8-bc85-4c9c-97d7-932a0c3b53d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:39.209890 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e12dc8-bc85-4c9c-97d7-932a0c3b53d1 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:39.210172 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e12dc8-bc85-4c9c-97d7-932a0c3b53d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:39.210443 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e12dc8-bc85-4c9c-97d7-932a0c3b53d1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:39.218070 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e12dc8-bc85-4c9c-97d7-932a0c3b53d1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:39.220204 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e12dc8-bc85-4c9c-97d7-932a0c3b53d1 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:39.231453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-c8e12dc8-bc85-4c9c-97d7-932a0c3b53d1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 17:33:39.231453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:39.231453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:39.231453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:39.231453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:39.231453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:39.231453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:39.231453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:39.231453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:39.231453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:39.231453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:39.231453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:39.231453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:33:39.231453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:33:39.231453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:33:39.231453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:33:39.232793 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:39.232793 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:39.232793 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:33:39.232793 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:33:39.232793 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:33:39.232793 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:33:39.232793 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:39.232793 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:39.232793 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:39.232793 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:39.232793 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:39.232793 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:39.232793 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:39.232793 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:39.232793 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:39.232793 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:39.232793 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:39.232793 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:39.238787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:39.238787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:39.238787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:33:39.238787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:33:39.238787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:33:39.238787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:33:39.238787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:33:39.238787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:33:39.238787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 17:33:39.238787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:39.238787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 524/1034] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Aug 8 17:33:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:39.239428 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1aee20-0dff-4ce3-924e-73aed8331b4f None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:39.340340 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1aee20-0dff-4ce3-924e-73aed8331b4f None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:39.376812 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1899b2-f8bc-40ca-932e-f2b3a73cfd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:39.377774 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1899b2-f8bc-40ca-932e-f2b3a73cfd91 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:39.378263 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1899b2-f8bc-40ca-932e-f2b3a73cfd91 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:39.378760 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1899b2-f8bc-40ca-932e-f2b3a73cfd91 None admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:39.379684 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1899b2-f8bc-40ca-932e-f2b3a73cfd91 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:39.380193 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1899b2-f8bc-40ca-932e-f2b3a73cfd91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:39.381927 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1899b2-f8bc-40ca-932e-f2b3a73cfd91 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:39.407617 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 511/1035] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Aug 8 17:33:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:39.409838 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e12dc8-bc85-4c9c-97d7-932a0c3b53d1 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:39.503427 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:39.515463 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e12dc8-bc85-4c9c-97d7-932a0c3b53d1 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:39.549874 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51878554-970a-4b10-9534-ede7590e7442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:39.550483 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51878554-970a-4b10-9534-ede7590e7442 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:39.550766 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51878554-970a-4b10-9534-ede7590e7442 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:39.551040 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51878554-970a-4b10-9534-ede7590e7442 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:39.620245 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51878554-970a-4b10-9534-ede7590e7442 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:39.621717 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51878554-970a-4b10-9534-ede7590e7442 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:39.710506 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:39.728395 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 525/1036] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:33:39 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 17:33:39.729617 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1899b2-f8bc-40ca-932e-f2b3a73cfd91 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:39.737527 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c692f1f-d774-4fdc-a136-9f3474a18a7b None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:39.737820 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c692f1f-d774-4fdc-a136-9f3474a18a7b None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:39.738101 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c692f1f-d774-4fdc-a136-9f3474a18a7b None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:39.739661 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 526/1037] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 17:33:39.744550 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760848cf-653f-4ae8-a933-5030eb98a9f7 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:39.745203 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760848cf-653f-4ae8-a933-5030eb98a9f7 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:39.745483 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760848cf-653f-4ae8-a933-5030eb98a9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:39.764198 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-760848cf-653f-4ae8-a933-5030eb98a9f7 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:39.765427 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-760848cf-653f-4ae8-a933-5030eb98a9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:39.785168 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:39.836532 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 527/1038] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:39 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 17:33:39.838952 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1899b2-f8bc-40ca-932e-f2b3a73cfd91 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:39.861647 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760848cf-653f-4ae8-a933-5030eb98a9f7 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:39.875543 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8f2c3-92b7-4e83-8972-bdc9f814ae41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:39.876169 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8f2c3-92b7-4e83-8972-bdc9f814ae41 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:39.876446 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8f2c3-92b7-4e83-8972-bdc9f814ae41 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:39.876718 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8f2c3-92b7-4e83-8972-bdc9f814ae41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:39.886924 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8f2c3-92b7-4e83-8972-bdc9f814ae41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:39.888426 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8f2c3-92b7-4e83-8972-bdc9f814ae41 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:39.904015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-a5f8f2c3-92b7-4e83-8972-bdc9f814ae41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:39.904015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:39.904015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:39.904015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:39.904015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:39.904015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:39.904015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:39.904015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:39.904015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:39.904015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:39.904015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:39.904015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:39.904015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:33:39.904015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:33:39.904015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:33:39.904015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:33:39.904992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:39.904992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:39.904992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:39.904992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:39.904992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:39.904992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:39.904992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:39.904992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:39.904992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:39.904992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:39.904992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:39.904992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:39.904992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:39.904992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:39.904992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:39.904992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:39.904992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:33:39.906217 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:33:39.906217 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:39.906217 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:39.906217 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 512/1039] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:39.914121 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8f2c3-92b7-4e83-8972-bdc9f814ae41 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:39.969151 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760848cf-653f-4ae8-a933-5030eb98a9f7 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:39.990299 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:40.007495 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12530383-9213-488a-8da9-8a58948d4ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:40.008227 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12530383-9213-488a-8da9-8a58948d4ac6 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:40.008513 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12530383-9213-488a-8da9-8a58948d4ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:40.008791 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12530383-9213-488a-8da9-8a58948d4ac6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:40.009946 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12530383-9213-488a-8da9-8a58948d4ac6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:40.011385 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12530383-9213-488a-8da9-8a58948d4ac6 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:40.012967 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 528/1040] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:33:40.020562 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12530383-9213-488a-8da9-8a58948d4ac6 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:40.021789 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:40.024817 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8f2c3-92b7-4e83-8972-bdc9f814ae41 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:40.064912 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16956f2c-bd3e-458b-9248-0e1d49ad8c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:40.066023 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16956f2c-bd3e-458b-9248-0e1d49ad8c6f None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:40.066307 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16956f2c-bd3e-458b-9248-0e1d49ad8c6f None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:40.066835 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16956f2c-bd3e-458b-9248-0e1d49ad8c6f None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:40.067224 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16956f2c-bd3e-458b-9248-0e1d49ad8c6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:40.067528 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16956f2c-bd3e-458b-9248-0e1d49ad8c6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:40.068896 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16956f2c-bd3e-458b-9248-0e1d49ad8c6f None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:40.081789 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 513/1041] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:33:40.087566 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16956f2c-bd3e-458b-9248-0e1d49ad8c6f None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:40.130114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12530383-9213-488a-8da9-8a58948d4ac6 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:40.166563 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db0aa9-8f35-406b-b9bc-f6be66200707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:40.167196 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db0aa9-8f35-406b-b9bc-f6be66200707 None admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:40.167480 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db0aa9-8f35-406b-b9bc-f6be66200707 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:40.167757 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db0aa9-8f35-406b-b9bc-f6be66200707 None admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:40.168394 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db0aa9-8f35-406b-b9bc-f6be66200707 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:40.169929 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db0aa9-8f35-406b-b9bc-f6be66200707 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:40.195185 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16956f2c-bd3e-458b-9248-0e1d49ad8c6f None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:40.228863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead0148-4623-4b91-badb-979b9a004117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:40.229577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead0148-4623-4b91-badb-979b9a004117 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:40.229860 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead0148-4623-4b91-badb-979b9a004117 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:40.230136 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead0148-4623-4b91-badb-979b9a004117 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:40.237937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead0148-4623-4b91-badb-979b9a004117 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:40.239393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead0148-4623-4b91-badb-979b9a004117 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:40.250843 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-aead0148-4623-4b91-badb-979b9a004117 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:33:40.250843 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:40.250843 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:40.250843 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:40.250843 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:40.250843 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:40.250843 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:40.250843 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:40.250843 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:40.250843 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:40.250843 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:40.250843 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:40.250843 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:33:40.250843 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:33:40.250843 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:33:40.255963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:33:40.255963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:40.255963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:40.255963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:40.255963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:40.255963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:40.255963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:40.255963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:40.255963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:40.255963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:40.255963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:40.255963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:40.255963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:40.255963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:40.255963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:40.255963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:40.255963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:40.256978 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:33:40.256978 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:33:40.256978 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:33:40.256978 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:33:40.256978 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:33:40.256978 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:33:40.256978 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:33:40.256978 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:40.256978 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 514/1042] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:33:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:33:40.258663 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead0148-4623-4b91-badb-979b9a004117 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:40.284135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 529/1043] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Aug 8 17:33:40 2022] POST /identity/v3/users => generated 285 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:33:40.287464 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:40.375656 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead0148-4623-4b91-badb-979b9a004117 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:40.423867 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b1a63-1fdf-45d7-adc3-68414b84af30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:40.424492 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b1a63-1fdf-45d7-adc3-68414b84af30 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:40.424772 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b1a63-1fdf-45d7-adc3-68414b84af30 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:40.425077 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b1a63-1fdf-45d7-adc3-68414b84af30 None admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:40.425778 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b1a63-1fdf-45d7-adc3-68414b84af30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:40.426083 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b1a63-1fdf-45d7-adc3-68414b84af30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:40.427598 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b1a63-1fdf-45d7-adc3-68414b84af30 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:40.441457 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 515/1044] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 8 17:33:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:40.447698 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db0aa9-8f35-406b-b9bc-f6be66200707 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:40.495890 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:40.552980 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fda3b3-ad52-4b82-875f-c114adce2d4d None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:40.553206 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fda3b3-ad52-4b82-875f-c114adce2d4d None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:40.553483 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fda3b3-ad52-4b82-875f-c114adce2d4d None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:40.556016 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 516/1045] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 17:33:40.557391 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db0aa9-8f35-406b-b9bc-f6be66200707 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:40.559918 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2529ab2-c68a-4e46-a8dc-4b9d14669b7c None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:40.560188 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2529ab2-c68a-4e46-a8dc-4b9d14669b7c None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:40.560449 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2529ab2-c68a-4e46-a8dc-4b9d14669b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:40.579628 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-f2529ab2-c68a-4e46-a8dc-4b9d14669b7c None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:40.580827 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-f2529ab2-c68a-4e46-a8dc-4b9d14669b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:40.599484 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761291d-842c-4933-a221-6eec64159542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:40.600094 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761291d-842c-4933-a221-6eec64159542 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:40.600375 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761291d-842c-4933-a221-6eec64159542 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:40.600649 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761291d-842c-4933-a221-6eec64159542 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:40.601401 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761291d-842c-4933-a221-6eec64159542 None admin] RBAC: Adding query filter params (role.id=b0560db9df8a46708b8b37d306895467, scope.project.id=047a28b7cd11486da9d330723a384812, user.id=3973b8fbfbb9475896e4e110ca8aa615) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:40.601719 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761291d-842c-4933-a221-6eec64159542 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:40.603148 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761291d-842c-4933-a221-6eec64159542 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:40.610263 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 530/1046] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:33:40 2022] GET /identity/v3/role_assignments?user.id=3973b8fbfbb9475896e4e110ca8aa615&scope.project.id=047a28b7cd11486da9d330723a384812&role.id=b0560db9df8a46708b8b37d306895467 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:33:40.660027 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 517/1047] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 17:33:40.683455 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761291d-842c-4933-a221-6eec64159542 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:40.791508 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761291d-842c-4933-a221-6eec64159542 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:40.799607 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:40.827278 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ebe1f-90b6-42f2-99c2-85bbfead1c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:40.827858 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ebe1f-90b6-42f2-99c2-85bbfead1c50 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:40.828142 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ebe1f-90b6-42f2-99c2-85bbfead1c50 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:40.828565 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ebe1f-90b6-42f2-99c2-85bbfead1c50 None admin] PATH_INFO: `/v3/services/image` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:40.829252 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ebe1f-90b6-42f2-99c2-85bbfead1c50 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:40.831273 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ebe1f-90b6-42f2-99c2-85bbfead1c50 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:40.840706 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-309ebe1f-90b6-42f2-99c2-85bbfead1c50 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 17:33:40.840706 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:40.840706 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 17:33:40.840706 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 17:33:40.840706 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 17:33:40.840706 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 17:33:40.840706 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 17:33:40.840706 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:40.840706 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 17:33:40.840706 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:40.840706 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 17:33:40.840706 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:40.840706 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:40.840706 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:40.840706 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:40.840706 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:40.840706 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:40.841766 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:40.841766 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:40.841766 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:40.841766 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:40.841766 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:40.841766 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:40.841766 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 17:33:40.841766 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 17:33:40.841766 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 17:33:40.841766 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 17:33:40.841766 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:40.841766 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:40.841766 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:40.841766 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:40.841766 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:40.841766 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:40.848409 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:40.848409 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:40.848409 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:40.848409 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:40.848409 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:40.848409 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:40.848409 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:40.848409 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:40.848409 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:40.848409 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:40.848409 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 17:33:40.848409 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:33:40.848409 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 17:33:40.848409 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:40.848409 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 531/1048] 10.222.0.70 () {56 vars in 1105 bytes} [Mon Aug 8 17:33:40 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:40.849358 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2529ab2-c68a-4e46-a8dc-4b9d14669b7c None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:40.860521 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:40.949623 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2529ab2-c68a-4e46-a8dc-4b9d14669b7c None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:40.984897 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e3636-50d2-41c8-a2e2-a490b99a1a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:40.985538 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e3636-50d2-41c8-a2e2-a490b99a1a59 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:40.985822 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e3636-50d2-41c8-a2e2-a490b99a1a59 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:40.986097 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e3636-50d2-41c8-a2e2-a490b99a1a59 None admin] PATH_INFO: `/v3/services` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:40.986726 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e3636-50d2-41c8-a2e2-a490b99a1a59 None admin] RBAC: Adding query filter params (name=image) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:40.987030 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e3636-50d2-41c8-a2e2-a490b99a1a59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:40.988471 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e3636-50d2-41c8-a2e2-a490b99a1a59 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:40.998229 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 518/1049] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:41.000037 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ebe1f-90b6-42f2-99c2-85bbfead1c50 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:41.106910 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ebe1f-90b6-42f2-99c2-85bbfead1c50 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:41.143146 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168128fe-4faa-464a-a3c9-2420a4b7b1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:41.143754 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168128fe-4faa-464a-a3c9-2420a4b7b1d4 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:41.144035 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168128fe-4faa-464a-a3c9-2420a4b7b1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:41.144306 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168128fe-4faa-464a-a3c9-2420a4b7b1d4 None admin] PATH_INFO: `/v3/services` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:41.144930 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168128fe-4faa-464a-a3c9-2420a4b7b1d4 None admin] RBAC: Adding query filter params (type=image) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:41.145264 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168128fe-4faa-464a-a3c9-2420a4b7b1d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:41.146628 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168128fe-4faa-464a-a3c9-2420a4b7b1d4 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:41.151621 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 532/1050] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:41.157858 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e3636-50d2-41c8-a2e2-a490b99a1a59 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:41.231994 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:41.257452 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e3636-50d2-41c8-a2e2-a490b99a1a59 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:41.293239 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3dcd8-cdb3-4d5a-b3e7-8245a1eedfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:41.293848 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3dcd8-cdb3-4d5a-b3e7-8245a1eedfb4 None admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:41.294130 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3dcd8-cdb3-4d5a-b3e7-8245a1eedfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:41.294403 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3dcd8-cdb3-4d5a-b3e7-8245a1eedfb4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:41.295070 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3dcd8-cdb3-4d5a-b3e7-8245a1eedfb4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:41.296618 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3dcd8-cdb3-4d5a-b3e7-8245a1eedfb4 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:41.363245 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 519/1051] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:33:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:33:42.387938 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ce2b6-ce7a-489b-8749-c006593bcbf8 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:42.388495 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ce2b6-ce7a-489b-8749-c006593bcbf8 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:42.388495 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ce2b6-ce7a-489b-8749-c006593bcbf8 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:42.392618 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 533/1052] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:42.397923 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1cbe7-ccb4-491c-bb33-9d4676b305d7 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:42.398365 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1cbe7-ccb4-491c-bb33-9d4676b305d7 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:42.398538 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1cbe7-ccb4-491c-bb33-9d4676b305d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:42.417155 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-97b1cbe7-ccb4-491c-bb33-9d4676b305d7 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:42.418336 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-97b1cbe7-ccb4-491c-bb33-9d4676b305d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:42.495782 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 520/1053] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:33:42.518297 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ce2b6-ce7a-489b-8749-c006593bcbf8 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:42.557327 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:42.613492 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097395e8-1317-4ee1-a15c-c70c1263b60d None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:42.613803 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097395e8-1317-4ee1-a15c-c70c1263b60d None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:42.614084 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097395e8-1317-4ee1-a15c-c70c1263b60d None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:42.615563 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 521/1054] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 17:33:42.620253 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00c439-a280-4c71-9b57-9fc73485f891 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:42.620539 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00c439-a280-4c71-9b57-9fc73485f891 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:42.620812 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00c439-a280-4c71-9b57-9fc73485f891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:42.627407 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ce2b6-ce7a-489b-8749-c006593bcbf8 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:42.639582 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-ae00c439-a280-4c71-9b57-9fc73485f891 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:42.641386 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-ae00c439-a280-4c71-9b57-9fc73485f891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:42.666357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6d5f5-4ef0-4841-9745-edbb1a9443b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:42.666988 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6d5f5-4ef0-4841-9745-edbb1a9443b7 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:42.667266 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6d5f5-4ef0-4841-9745-edbb1a9443b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:42.667533 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6d5f5-4ef0-4841-9745-edbb1a9443b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:42.681476 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6d5f5-4ef0-4841-9745-edbb1a9443b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:33:42.686712 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-c3e6d5f5-4ef0-4841-9745-edbb1a9443b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:33:42.686712 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:42.686712 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:42.686712 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:42.686712 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:42.686712 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:42.686712 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:42.686712 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:42.686712 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:42.686712 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:42.686712 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:42.686712 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:42.686712 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:33:42.686712 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:33:42.686712 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:33:42.686712 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:33:42.688135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:33:42.688135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:33:42.688135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:33:42.688135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:33:42.688135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:42.688135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:42.688135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:42.688135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:42.688135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:42.688135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:42.688135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:42.688135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:42.688135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:42.688135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:42.688135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:42.688135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:42.689010 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:42.689010 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:42.689010 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:42.689010 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:42.689010 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:33:42.689010 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:33:42.689010 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:33:42.689010 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:33:42.689010 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:33:42.689010 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:33:42.689010 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:33:42.689010 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:42.689712 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 534/1055] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 8 17:33:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:42.695410 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6d5f5-4ef0-4841-9745-edbb1a9443b7 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:42.695549 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:42.717129 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 522/1056] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 17:33:42.736532 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00c439-a280-4c71-9b57-9fc73485f891 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:42.794902 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:42.802655 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6d5f5-4ef0-4841-9745-edbb1a9443b7 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:42.837486 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00c439-a280-4c71-9b57-9fc73485f891 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:42.839760 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b9925-3287-4712-aeca-54c05582b45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:42.840370 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b9925-3287-4712-aeca-54c05582b45e None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:42.840647 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b9925-3287-4712-aeca-54c05582b45e None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:42.840919 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b9925-3287-4712-aeca-54c05582b45e None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:42.841604 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b9925-3287-4712-aeca-54c05582b45e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:42.841904 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b9925-3287-4712-aeca-54c05582b45e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:42.843300 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b9925-3287-4712-aeca-54c05582b45e None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:42.851848 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 535/1057] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:33:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:33:42.857728 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b9925-3287-4712-aeca-54c05582b45e None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:42.873970 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1471318-f79e-439f-91e5-646a078b663a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:42.874814 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1471318-f79e-439f-91e5-646a078b663a None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:42.875106 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1471318-f79e-439f-91e5-646a078b663a None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:42.875381 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1471318-f79e-439f-91e5-646a078b663a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:42.885499 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1471318-f79e-439f-91e5-646a078b663a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:33:42.890883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-e1471318-f79e-439f-91e5-646a078b663a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 17:33:42.890883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:42.890883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:42.890883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:42.890883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:42.890883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:42.890883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:42.890883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:42.890883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:42.890883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:42.890883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:42.890883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:42.890883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:33:42.890883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:33:42.890883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:33:42.890883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:33:42.892128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:33:42.892128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:33:42.892128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:33:42.892128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:33:42.892128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:42.892128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:42.892128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:42.892128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:42.892128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:42.892128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:42.892128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:42.892128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:42.892128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:42.892128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:42.892128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:42.892128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:42.893279 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:42.893279 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:42.893279 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:42.893279 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:42.893279 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:33:42.893279 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:33:42.893279 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:33:42.893279 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:33:42.893279 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:33:42.893279 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:33:42.893279 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 17:33:42.893279 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:42.893279 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 523/1058] 10.222.0.70 () {56 vars in 1120 bytes} [Mon Aug 8 17:33:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:33:42.897858 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1471318-f79e-439f-91e5-646a078b663a None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:42.945292 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:42.965407 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b9925-3287-4712-aeca-54c05582b45e None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:43.002186 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f072de-122f-4615-8262-e2757a95fe4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:43.002815 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f072de-122f-4615-8262-e2757a95fe4e None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:43.002950 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1471318-f79e-439f-91e5-646a078b663a None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:43.003133 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f072de-122f-4615-8262-e2757a95fe4e None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:43.003373 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f072de-122f-4615-8262-e2757a95fe4e None admin] PATH_INFO: `/v3/users/230dc65a36d5414db5b5f580444406e2` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:43.017671 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f072de-122f-4615-8262-e2757a95fe4e None admin] RBAC: Authorizing `identity:get_user(user_id=230dc65a36d5414db5b5f580444406e2)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:43.019224 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f072de-122f-4615-8262-e2757a95fe4e None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:43.025466 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 536/1059] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:33:42 2022] GET /identity/v3/users/230dc65a36d5414db5b5f580444406e2 => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:33:43.026942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f072de-122f-4615-8262-e2757a95fe4e None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:43.040890 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5659b06-8912-425a-8894-1bb91782e5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:43.041534 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5659b06-8912-425a-8894-1bb91782e5b9 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:43.041819 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5659b06-8912-425a-8894-1bb91782e5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:43.042095 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5659b06-8912-425a-8894-1bb91782e5b9 None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:43.043005 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5659b06-8912-425a-8894-1bb91782e5b9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:43.043123 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:43.043221 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5659b06-8912-425a-8894-1bb91782e5b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:43.044410 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5659b06-8912-425a-8894-1bb91782e5b9 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:43.053454 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 524/1060] 10.222.0.70 () {56 vars in 1115 bytes} [Mon Aug 8 17:33:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:33:43.059368 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5659b06-8912-425a-8894-1bb91782e5b9 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:43.140342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f072de-122f-4615-8262-e2757a95fe4e None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:43.174338 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5659b06-8912-425a-8894-1bb91782e5b9 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:43.176650 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7aabb-fc76-418c-a0a6-b78846a5f218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:43.177290 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7aabb-fc76-418c-a0a6-b78846a5f218 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:43.177579 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7aabb-fc76-418c-a0a6-b78846a5f218 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:43.177853 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7aabb-fc76-418c-a0a6-b78846a5f218 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:43.184405 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:43.210252 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c090760-a5fe-4a11-957f-21b011c6f8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:43.210858 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c090760-a5fe-4a11-957f-21b011c6f8ae None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:43.211133 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c090760-a5fe-4a11-957f-21b011c6f8ae None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:43.211401 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c090760-a5fe-4a11-957f-21b011c6f8ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:43.223277 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c090760-a5fe-4a11-957f-21b011c6f8ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:43.225401 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c090760-a5fe-4a11-957f-21b011c6f8ae None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:43.242175 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-0c090760-a5fe-4a11-957f-21b011c6f8ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:43.242175 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:43.242175 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:43.242175 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:43.242175 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:43.242175 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:43.242175 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:43.242175 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:43.242175 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:43.242175 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:43.242175 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:43.242175 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:43.242175 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:33:43.242175 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:33:43.242175 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:33:43.242175 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:33:43.243228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:43.243228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:43.243228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:43.243228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:43.243228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:43.243228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:43.243228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:43.243228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:43.243228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:43.243228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:43.243228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:43.243228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:43.243228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:43.243228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:43.243228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:43.243228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:43.243228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:33:43.244159 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:33:43.244159 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:43.244159 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:43.244159 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 525/1061] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:33:43.248866 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c090760-a5fe-4a11-957f-21b011c6f8ae None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:43.252279 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7aabb-fc76-418c-a0a6-b78846a5f218 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:43.253759 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7aabb-fc76-418c-a0a6-b78846a5f218 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:43.269942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:43.358983 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c090760-a5fe-4a11-957f-21b011c6f8ae None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:43.368680 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 537/1062] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:33:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 08 17:33:43.370126 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7aabb-fc76-418c-a0a6-b78846a5f218 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:43.401938 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622e979-b29b-4a43-ac3d-7c4aa5a17a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:43.402612 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622e979-b29b-4a43-ac3d-7c4aa5a17a3d None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:43.402987 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622e979-b29b-4a43-ac3d-7c4aa5a17a3d None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:43.403266 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622e979-b29b-4a43-ac3d-7c4aa5a17a3d None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:43.404379 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622e979-b29b-4a43-ac3d-7c4aa5a17a3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:43.404810 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622e979-b29b-4a43-ac3d-7c4aa5a17a3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:43.406936 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622e979-b29b-4a43-ac3d-7c4aa5a17a3d None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:43.421203 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 526/1063] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:43.422762 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669dd0b4-a94d-42db-af76-19c6f0a6cca8 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:43.423151 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669dd0b4-a94d-42db-af76-19c6f0a6cca8 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:43.423432 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669dd0b4-a94d-42db-af76-19c6f0a6cca8 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:43.424751 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 527/1064] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:43.426245 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669dd0b4-a94d-42db-af76-19c6f0a6cca8 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:43.447620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:43.475109 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7aabb-fc76-418c-a0a6-b78846a5f218 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:43.490410 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:43.511913 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b3b71-30b1-4f7b-a594-32bb00af25da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:43.512543 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b3b71-30b1-4f7b-a594-32bb00af25da None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:43.512826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b3b71-30b1-4f7b-a594-32bb00af25da None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:43.513132 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b3b71-30b1-4f7b-a594-32bb00af25da None admin] PATH_INFO: `/v3/projects/05257bc1557c405c94a0ba30586b0a93` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:43.514275 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b3b71-30b1-4f7b-a594-32bb00af25da None admin] RBAC: Authorizing `identity:get_project(project_id=05257bc1557c405c94a0ba30586b0a93)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:43.515931 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b3b71-30b1-4f7b-a594-32bb00af25da None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:43.517588 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 538/1065] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:33:43 2022] GET /identity/v3/projects/05257bc1557c405c94a0ba30586b0a93 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:33:43.518693 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c90b75-10d8-4206-9635-d0364109fa60 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:43.518975 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c90b75-10d8-4206-9635-d0364109fa60 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:43.519248 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c90b75-10d8-4206-9635-d0364109fa60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:43.534606 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669dd0b4-a94d-42db-af76-19c6f0a6cca8 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:43.536699 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-39c90b75-10d8-4206-9635-d0364109fa60 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:43.537931 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-39c90b75-10d8-4206-9635-d0364109fa60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:43.568927 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89babb-16c0-48da-a831-6a2405679fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:43.569568 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89babb-16c0-48da-a831-6a2405679fce None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:43.569844 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89babb-16c0-48da-a831-6a2405679fce None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:43.570113 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89babb-16c0-48da-a831-6a2405679fce None admin] PATH_INFO: `/v3/users/nova` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:43.577000 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89babb-16c0-48da-a831-6a2405679fce None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:43.579502 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89babb-16c0-48da-a831-6a2405679fce None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:43.590573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-cd89babb-16c0-48da-a831-6a2405679fce None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 17:33:43.590573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:43.590573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:43.590573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:43.590573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:43.590573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:43.590573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:43.590573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:43.590573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:43.590573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:43.590573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:43.590573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:43.590573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:33:43.590573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:33:43.590573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:33:43.590573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:33:43.591711 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:43.591711 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:43.591711 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:33:43.591711 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:33:43.591711 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:33:43.591711 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:33:43.591711 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:43.591711 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:43.591711 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:43.591711 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:43.591711 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:43.591711 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:43.591711 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:43.591711 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:43.591711 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:43.591711 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:43.591711 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:43.591711 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:43.592947 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:43.592947 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:43.592947 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:33:43.592947 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:33:43.592947 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:33:43.592947 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:33:43.592947 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:33:43.592947 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:33:43.592947 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 17:33:43.592947 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:43.592947 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 528/1066] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Aug 8 17:33:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:33:43.592947 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89babb-16c0-48da-a831-6a2405679fce None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:43.611727 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 539/1067] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:33:43.612562 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c90b75-10d8-4206-9635-d0364109fa60 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:43.680080 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:43.698666 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89babb-16c0-48da-a831-6a2405679fce None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:43.711741 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c90b75-10d8-4206-9635-d0364109fa60 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:43.725508 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:43.736025 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7ff42-a0da-4951-860c-1c9df5a13bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:43.736629 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7ff42-a0da-4951-860c-1c9df5a13bd1 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:43.736903 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7ff42-a0da-4951-860c-1c9df5a13bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:43.737220 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7ff42-a0da-4951-860c-1c9df5a13bd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:43.737943 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7ff42-a0da-4951-860c-1c9df5a13bd1 None admin] RBAC: Adding query filter params (role.id=5c25aa917ab34baabb795c54dd8a4d02, scope.project.id=05257bc1557c405c94a0ba30586b0a93, user.id=230dc65a36d5414db5b5f580444406e2) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:43.738267 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7ff42-a0da-4951-860c-1c9df5a13bd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:43.739690 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7ff42-a0da-4951-860c-1c9df5a13bd1 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:43.745191 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 529/1068] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:33:43 2022] GET /identity/v3/role_assignments?user.id=230dc65a36d5414db5b5f580444406e2&scope.project.id=05257bc1557c405c94a0ba30586b0a93&role.id=5c25aa917ab34baabb795c54dd8a4d02 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:43.745966 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7ff42-a0da-4951-860c-1c9df5a13bd1 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:43.748278 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afc172-d6aa-466d-a804-e4ec133eff46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:43.748756 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afc172-d6aa-466d-a804-e4ec133eff46 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:43.749941 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afc172-d6aa-466d-a804-e4ec133eff46 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:43.749941 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afc172-d6aa-466d-a804-e4ec133eff46 None admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:43.750121 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0afc172-d6aa-466d-a804-e4ec133eff46 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:43.750432 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0afc172-d6aa-466d-a804-e4ec133eff46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:43.751900 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0afc172-d6aa-466d-a804-e4ec133eff46 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:43.775803 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 540/1069] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Aug 8 17:33:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:43.782252 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afc172-d6aa-466d-a804-e4ec133eff46 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:43.864770 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7ff42-a0da-4951-860c-1c9df5a13bd1 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:43.903302 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afc172-d6aa-466d-a804-e4ec133eff46 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:43.904289 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda1afa-54cb-4c27-be6c-8125207d85cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:43.904907 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda1afa-54cb-4c27-be6c-8125207d85cb None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:43.905221 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda1afa-54cb-4c27-be6c-8125207d85cb None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:43.906441 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda1afa-54cb-4c27-be6c-8125207d85cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:43.927728 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:43.944360 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbecce-9e69-45e8-b922-d7e11110660a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:43.944994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbecce-9e69-45e8-b922-d7e11110660a None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:43.945335 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbecce-9e69-45e8-b922-d7e11110660a None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:43.945611 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbecce-9e69-45e8-b922-d7e11110660a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:43.957239 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbecce-9e69-45e8-b922-d7e11110660a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:43.958701 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbecce-9e69-45e8-b922-d7e11110660a None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:43.973526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-0cdbecce-9e69-45e8-b922-d7e11110660a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:43.973526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:43.973526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:43.973526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:43.973526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:43.973526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:43.973526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:43.973526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:43.973526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:43.973526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:43.973526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:43.973526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:43.973526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:33:43.973526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:33:43.973526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:33:43.973526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:33:43.974626 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:43.974626 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:43.974626 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:43.974626 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:43.974626 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:43.974626 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:43.974626 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:43.974626 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:43.974626 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:43.974626 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:43.974626 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:43.974626 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:43.974626 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:43.974626 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:43.974626 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:43.974626 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:43.974626 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:33:43.975582 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:33:43.975582 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:43.975582 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:43.975582 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 541/1070] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:33:43.980054 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbecce-9e69-45e8-b922-d7e11110660a None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:43.993161 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda1afa-54cb-4c27-be6c-8125207d85cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:43.994613 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda1afa-54cb-4c27-be6c-8125207d85cb None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:44.008312 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:44.094896 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbecce-9e69-45e8-b922-d7e11110660a None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:44.105069 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 530/1071] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:33:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 17:33:44.108278 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda1afa-54cb-4c27-be6c-8125207d85cb None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:44.136564 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977886d3-73d0-47b8-87fb-93ababdd4f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:44.138850 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977886d3-73d0-47b8-87fb-93ababdd4f2a None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:44.138850 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977886d3-73d0-47b8-87fb-93ababdd4f2a None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:44.138850 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977886d3-73d0-47b8-87fb-93ababdd4f2a None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:44.138850 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977886d3-73d0-47b8-87fb-93ababdd4f2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:44.138850 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977886d3-73d0-47b8-87fb-93ababdd4f2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:44.140894 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977886d3-73d0-47b8-87fb-93ababdd4f2a None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:44.159151 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 542/1072] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:44.160177 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977886d3-73d0-47b8-87fb-93ababdd4f2a None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:44.165633 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:44.225885 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda1afa-54cb-4c27-be6c-8125207d85cb None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:44.254177 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:44.260208 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b7d2c-b2d2-4ed3-8459-6c5ac3b3f8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:44.260835 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b7d2c-b2d2-4ed3-8459-6c5ac3b3f8a7 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:44.261153 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b7d2c-b2d2-4ed3-8459-6c5ac3b3f8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:44.261434 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b7d2c-b2d2-4ed3-8459-6c5ac3b3f8a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:44.271873 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b7d2c-b2d2-4ed3-8459-6c5ac3b3f8a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:44.273345 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b7d2c-b2d2-4ed3-8459-6c5ac3b3f8a7 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:44.276014 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977886d3-73d0-47b8-87fb-93ababdd4f2a None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:44.288567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-fd5b7d2c-b2d2-4ed3-8459-6c5ac3b3f8a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:44.288567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:44.288567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:44.288567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:44.288567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:44.288567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:44.288567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:44.288567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:44.288567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:44.288567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:44.288567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:44.288567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:44.288567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:33:44.288567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:33:44.288567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:33:44.288567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:33:44.294573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:44.294573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:44.294573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:44.294573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:44.294573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:44.294573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:44.294573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:44.294573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:44.294573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:44.294573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:44.294573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:44.294573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:44.294573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:44.294573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:44.294573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:44.294573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:44.294573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:33:44.295580 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:33:44.295580 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:44.295580 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:44.295580 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 531/1073] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:33:44.296709 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b7d2c-b2d2-4ed3-8459-6c5ac3b3f8a7 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:44.320518 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f5a44-3a8c-4727-90b2-244565c20aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:44.321574 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f5a44-3a8c-4727-90b2-244565c20aee None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:44.322120 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f5a44-3a8c-4727-90b2-244565c20aee None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:44.322587 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f5a44-3a8c-4727-90b2-244565c20aee None admin] PATH_INFO: `/v3/projects/service` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:44.330168 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f5a44-3a8c-4727-90b2-244565c20aee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:44.331923 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f5a44-3a8c-4727-90b2-244565c20aee None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:44.344893 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-f39f5a44-3a8c-4727-90b2-244565c20aee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:33:44.344893 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:44.344893 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:44.344893 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:44.344893 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:44.344893 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:44.344893 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:44.344893 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:44.344893 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:44.344893 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:44.344893 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:44.344893 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:44.344893 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:33:44.344893 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:33:44.344893 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:33:44.346040 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:33:44.346040 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:44.346040 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:44.346040 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:44.346040 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:44.346040 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:44.346040 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:44.346040 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:44.346040 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:44.346040 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:44.346040 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:44.346040 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:44.346040 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:44.346040 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:44.346040 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:44.346040 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:44.346040 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:44.347151 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:33:44.347151 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:33:44.347151 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:33:44.347151 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:33:44.347151 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:33:44.347151 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:33:44.347151 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:33:44.347151 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:44.349005 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 543/1074] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:33:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:44.354674 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f5a44-3a8c-4727-90b2-244565c20aee None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:44.396856 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:44.402724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b7d2c-b2d2-4ed3-8459-6c5ac3b3f8a7 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:44.442694 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54341d95-d58e-40b6-bd06-89daa4ab9ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:44.443751 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54341d95-d58e-40b6-bd06-89daa4ab9ce5 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:44.444230 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54341d95-d58e-40b6-bd06-89daa4ab9ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:44.444724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54341d95-d58e-40b6-bd06-89daa4ab9ce5 None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:44.445893 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54341d95-d58e-40b6-bd06-89daa4ab9ce5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:44.446794 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54341d95-d58e-40b6-bd06-89daa4ab9ce5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:44.450306 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54341d95-d58e-40b6-bd06-89daa4ab9ce5 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:44.477160 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 532/1075] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:44.486498 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f5a44-3a8c-4727-90b2-244565c20aee None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:44.526053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2162c-0ce2-44c3-9e18-a5f2042cd717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:44.526676 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2162c-0ce2-44c3-9e18-a5f2042cd717 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:44.526955 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2162c-0ce2-44c3-9e18-a5f2042cd717 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:44.527227 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2162c-0ce2-44c3-9e18-a5f2042cd717 None admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:44.527932 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2162c-0ce2-44c3-9e18-a5f2042cd717 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:44.528234 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2162c-0ce2-44c3-9e18-a5f2042cd717 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:44.529756 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2162c-0ce2-44c3-9e18-a5f2042cd717 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:44.548353 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 544/1076] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 8 17:33:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:44.549650 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54341d95-d58e-40b6-bd06-89daa4ab9ce5 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:44.665742 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54341d95-d58e-40b6-bd06-89daa4ab9ce5 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:44.709013 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6058d9-8f2a-475a-a0a5-8184edf49f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:44.709707 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6058d9-8f2a-475a-a0a5-8184edf49f15 None admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:44.709987 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6058d9-8f2a-475a-a0a5-8184edf49f15 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:44.710259 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6058d9-8f2a-475a-a0a5-8184edf49f15 None admin] PATH_INFO: `/v3/projects/047a28b7cd11486da9d330723a384812/users/3973b8fbfbb9475896e4e110ca8aa615/roles/b0560db9df8a46708b8b37d306895467` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:44.713423 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6058d9-8f2a-475a-a0a5-8184edf49f15 None admin] RBAC: Authorizing `identity:create_grant(project_id=047a28b7cd11486da9d330723a384812, user_id=3973b8fbfbb9475896e4e110ca8aa615, role_id=b0560db9df8a46708b8b37d306895467)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:44.714320 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6058d9-8f2a-475a-a0a5-8184edf49f15 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:44.791703 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 533/1077] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 8 17:33:44 2022] PUT /identity/v3/projects/047a28b7cd11486da9d330723a384812/users/3973b8fbfbb9475896e4e110ca8aa615/roles/b0560db9df8a46708b8b37d306895467 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:33:45.801670 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2447b-e3f4-4ad4-b108-f42d5b3c682d None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:45.802205 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2447b-e3f4-4ad4-b108-f42d5b3c682d None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:45.802205 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2447b-e3f4-4ad4-b108-f42d5b3c682d None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:45.803550 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 545/1078] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:45.808877 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcefa83-dd7c-496d-8943-dbb58cfff3b9 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:45.809291 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcefa83-dd7c-496d-8943-dbb58cfff3b9 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:45.809463 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcefa83-dd7c-496d-8943-dbb58cfff3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:45.827553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-0fcefa83-dd7c-496d-8943-dbb58cfff3b9 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:45.828830 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-0fcefa83-dd7c-496d-8943-dbb58cfff3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:45.839336 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:45.894776 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 534/1079] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:33:45.917887 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2447b-e3f4-4ad4-b108-f42d5b3c682d None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:45.920788 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:46.022808 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2447b-e3f4-4ad4-b108-f42d5b3c682d None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:46.056597 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7d16b-fd99-47d9-bf42-b5bc39d26afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:46.057172 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7d16b-fd99-47d9-bf42-b5bc39d26afb None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:46.057457 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7d16b-fd99-47d9-bf42-b5bc39d26afb None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:46.057767 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7d16b-fd99-47d9-bf42-b5bc39d26afb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:46.068811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d7d16b-fd99-47d9-bf42-b5bc39d26afb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:33:46.073398 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-c6d7d16b-fd99-47d9-bf42-b5bc39d26afb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:33:46.073398 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:46.073398 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:46.073398 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:46.073398 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:46.073398 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:46.073398 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:46.073398 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:46.073398 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:46.073398 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:46.073398 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:46.073398 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:46.073398 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:33:46.073398 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:33:46.073398 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:33:46.073398 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:33:46.074353 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:33:46.074353 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:33:46.074353 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:33:46.074353 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:33:46.074353 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:46.074353 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:46.074353 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:46.074353 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:46.074353 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:46.074353 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:46.074353 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:46.074353 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:46.074353 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:46.074353 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:46.074353 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:46.074353 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:46.075221 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:46.075221 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:46.075221 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:46.075221 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:46.075221 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:33:46.075221 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:33:46.075221 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:33:46.075221 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:33:46.075221 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:33:46.075221 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:33:46.075221 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:33:46.075221 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:46.075221 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 546/1080] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 8 17:33:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:46.081388 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcefa83-dd7c-496d-8943-dbb58cfff3b9 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:46.180169 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcefa83-dd7c-496d-8943-dbb58cfff3b9 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:46.215737 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547a8c6-daff-4f58-ba7c-234e2ef3f5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:46.216336 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547a8c6-daff-4f58-ba7c-234e2ef3f5d7 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:46.216610 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547a8c6-daff-4f58-ba7c-234e2ef3f5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:46.216876 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547a8c6-daff-4f58-ba7c-234e2ef3f5d7 None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:46.217559 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547a8c6-daff-4f58-ba7c-234e2ef3f5d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:46.218345 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547a8c6-daff-4f58-ba7c-234e2ef3f5d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:46.219702 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547a8c6-daff-4f58-ba7c-234e2ef3f5d7 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:46.227491 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 535/1081] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:33:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:46.234216 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7d16b-fd99-47d9-bf42-b5bc39d26afb None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:46.294975 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:46.334963 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7d16b-fd99-47d9-bf42-b5bc39d26afb None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:46.367554 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b6293-bdb6-4fb5-9656-a56339895a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:46.368173 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b6293-bdb6-4fb5-9656-a56339895a7d None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:46.368449 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b6293-bdb6-4fb5-9656-a56339895a7d None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:46.368717 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b6293-bdb6-4fb5-9656-a56339895a7d None admin] PATH_INFO: `/v3/users/230dc65a36d5414db5b5f580444406e2` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:46.369849 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b6293-bdb6-4fb5-9656-a56339895a7d None admin] RBAC: Authorizing `identity:get_user(user_id=230dc65a36d5414db5b5f580444406e2)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:46.371266 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b6293-bdb6-4fb5-9656-a56339895a7d None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:46.372820 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 547/1082] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:33:46 2022] GET /identity/v3/users/230dc65a36d5414db5b5f580444406e2 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:46.379247 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547a8c6-daff-4f58-ba7c-234e2ef3f5d7 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:46.390701 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:46.486954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547a8c6-daff-4f58-ba7c-234e2ef3f5d7 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:46.520912 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f4f52f-3479-464e-86de-9f8862c9de6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:46.521564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4f52f-3479-464e-86de-9f8862c9de6a None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:46.521845 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4f52f-3479-464e-86de-9f8862c9de6a None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:46.522115 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4f52f-3479-464e-86de-9f8862c9de6a None admin] PATH_INFO: `/v3/projects/05257bc1557c405c94a0ba30586b0a93` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:46.523225 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f4f52f-3479-464e-86de-9f8862c9de6a None admin] RBAC: Authorizing `identity:get_project(project_id=05257bc1557c405c94a0ba30586b0a93)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:46.524642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f4f52f-3479-464e-86de-9f8862c9de6a None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:46.526300 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 536/1083] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:33:46 2022] GET /identity/v3/projects/05257bc1557c405c94a0ba30586b0a93 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:33:46.532693 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b6293-bdb6-4fb5-9656-a56339895a7d None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:46.630611 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b6293-bdb6-4fb5-9656-a56339895a7d None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:46.658753 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:46.664139 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920b75a-902f-4854-9cba-cb426f5aa141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:46.681995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920b75a-902f-4854-9cba-cb426f5aa141 None admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:46.681995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920b75a-902f-4854-9cba-cb426f5aa141 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:46.681995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920b75a-902f-4854-9cba-cb426f5aa141 None admin] PATH_INFO: `/v3/projects/05257bc1557c405c94a0ba30586b0a93/users/230dc65a36d5414db5b5f580444406e2/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:46.681995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920b75a-902f-4854-9cba-cb426f5aa141 None admin] RBAC: Authorizing `identity:create_grant(project_id=05257bc1557c405c94a0ba30586b0a93, user_id=230dc65a36d5414db5b5f580444406e2, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:46.681995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920b75a-902f-4854-9cba-cb426f5aa141 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:46.738760 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 548/1084] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 8 17:33:46 2022] PUT /identity/v3/projects/05257bc1557c405c94a0ba30586b0a93/users/230dc65a36d5414db5b5f580444406e2/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:33:46.878036 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad64e5-99b4-4574-b742-cfa2d31b01cc None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:46.878559 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad64e5-99b4-4574-b742-cfa2d31b01cc None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:46.878559 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad64e5-99b4-4574-b742-cfa2d31b01cc None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:46.880179 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 537/1085] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:46.885673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6ca98-31ed-4f0f-983b-1b3dd99ce896 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:46.886106 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6ca98-31ed-4f0f-983b-1b3dd99ce896 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:46.886185 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6ca98-31ed-4f0f-983b-1b3dd99ce896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:46.905191 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-2fc6ca98-31ed-4f0f-983b-1b3dd99ce896 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:46.906504 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-2fc6ca98-31ed-4f0f-983b-1b3dd99ce896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:46.972436 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 549/1086] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 17:33:46.995681 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad64e5-99b4-4574-b742-cfa2d31b01cc None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:47.072869 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:47.096695 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad64e5-99b4-4574-b742-cfa2d31b01cc None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:47.130504 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9a247-1479-4010-94cd-d429def20b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:47.131118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9a247-1479-4010-94cd-d429def20b81 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:47.131389 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9a247-1479-4010-94cd-d429def20b81 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:47.131655 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9a247-1479-4010-94cd-d429def20b81 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:47.142194 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df9a247-1479-4010-94cd-d429def20b81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:33:47.146666 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-3df9a247-1479-4010-94cd-d429def20b81 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 17:33:47.146666 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:47.146666 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:47.146666 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:47.146666 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:47.146666 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:47.146666 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:47.146666 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:47.146666 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:47.146666 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:47.146666 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:47.146666 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:47.146666 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:33:47.146666 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:33:47.146666 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:33:47.146666 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:33:47.147599 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:33:47.147599 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:33:47.147599 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:33:47.147599 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:33:47.147599 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:47.147599 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:47.147599 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:47.147599 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:47.147599 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:47.147599 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:47.147599 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:47.147599 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:47.147599 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:47.147599 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:47.147599 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:47.147599 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:47.148601 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:47.148601 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:47.148601 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:47.148601 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:47.148601 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:33:47.148601 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:33:47.148601 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:33:47.148601 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:33:47.148601 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:33:47.148601 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:33:47.148601 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 17:33:47.148601 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:47.148601 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 538/1087] 10.222.0.70 () {56 vars in 1120 bytes} [Mon Aug 8 17:33:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:47.153863 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6ca98-31ed-4f0f-983b-1b3dd99ce896 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:47.253115 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6ca98-31ed-4f0f-983b-1b3dd99ce896 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:47.273543 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:47.288754 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b434d-5ebe-4d3b-bbb3-c1c2775a9942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:47.289394 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b434d-5ebe-4d3b-bbb3-c1c2775a9942 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:47.289678 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b434d-5ebe-4d3b-bbb3-c1c2775a9942 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:47.289950 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b434d-5ebe-4d3b-bbb3-c1c2775a9942 None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:47.290607 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b434d-5ebe-4d3b-bbb3-c1c2775a9942 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:47.290908 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b434d-5ebe-4d3b-bbb3-c1c2775a9942 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:47.292377 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b434d-5ebe-4d3b-bbb3-c1c2775a9942 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:47.300467 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 550/1088] 10.222.0.70 () {56 vars in 1115 bytes} [Mon Aug 8 17:33:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:47.306431 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9a247-1479-4010-94cd-d429def20b81 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:47.403781 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9a247-1479-4010-94cd-d429def20b81 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:47.438267 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10640ac8-7acb-4aba-adbc-7f78eee25cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:47.438888 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10640ac8-7acb-4aba-adbc-7f78eee25cb9 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:47.439165 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10640ac8-7acb-4aba-adbc-7f78eee25cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:47.439434 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10640ac8-7acb-4aba-adbc-7f78eee25cb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:47.442016 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:47.449477 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10640ac8-7acb-4aba-adbc-7f78eee25cb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:47.450915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10640ac8-7acb-4aba-adbc-7f78eee25cb9 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:47.465568 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-10640ac8-7acb-4aba-adbc-7f78eee25cb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:47.465568 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:47.465568 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:47.465568 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:47.465568 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:47.465568 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:47.465568 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:47.465568 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:47.465568 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:47.465568 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:47.465568 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:47.465568 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:47.465568 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:33:47.465568 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:33:47.465568 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:33:47.465568 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:33:47.466684 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:47.466684 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:47.466684 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:47.466684 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:47.466684 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:47.466684 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:47.466684 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:47.466684 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:47.466684 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:47.466684 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:47.466684 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:47.466684 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:47.466684 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:47.466684 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:47.466684 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:47.466684 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:47.466684 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:33:47.467670 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:33:47.467670 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:47.467670 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:47.467670 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 539/1089] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:47.473229 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b434d-5ebe-4d3b-bbb3-c1c2775a9942 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:47.572580 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b434d-5ebe-4d3b-bbb3-c1c2775a9942 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:47.604793 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd91741-a002-49a9-9c1a-e7f25f14aceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:47.605417 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd91741-a002-49a9-9c1a-e7f25f14aceb None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:47.605697 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd91741-a002-49a9-9c1a-e7f25f14aceb None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:47.605965 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd91741-a002-49a9-9c1a-e7f25f14aceb None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:47.606856 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd91741-a002-49a9-9c1a-e7f25f14aceb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:47.607151 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd91741-a002-49a9-9c1a-e7f25f14aceb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:47.608525 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd91741-a002-49a9-9c1a-e7f25f14aceb None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:47.619627 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 551/1090] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:47.625877 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10640ac8-7acb-4aba-adbc-7f78eee25cb9 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:47.721867 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10640ac8-7acb-4aba-adbc-7f78eee25cb9 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:47.754205 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f5658-28cf-419a-8668-d19e8c501f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:47.754814 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f5658-28cf-419a-8668-d19e8c501f80 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:47.755090 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f5658-28cf-419a-8668-d19e8c501f80 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:47.755359 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f5658-28cf-419a-8668-d19e8c501f80 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:47.762435 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f5658-28cf-419a-8668-d19e8c501f80 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:47.763854 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f5658-28cf-419a-8668-d19e8c501f80 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:47.775094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-5e4f5658-28cf-419a-8668-d19e8c501f80 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 17:33:47.775094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:47.775094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:47.775094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:47.775094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:47.775094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:47.775094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:47.775094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:47.775094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:47.775094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:47.775094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:47.775094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:47.775094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:33:47.775094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:33:47.775094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:33:47.775094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:33:47.776216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:47.776216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:47.776216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:33:47.776216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:33:47.776216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:33:47.776216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:33:47.776216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:47.776216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:47.776216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:47.776216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:47.776216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:47.776216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:47.776216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:47.776216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:47.776216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:47.776216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:47.776216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:47.776216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:47.777209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:47.777209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:47.777209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:33:47.777209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:33:47.777209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:33:47.777209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:33:47.777209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:33:47.777209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:33:47.777209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 17:33:47.777209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:47.777209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 540/1091] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Aug 8 17:33:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:47.782229 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd91741-a002-49a9-9c1a-e7f25f14aceb None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:47.829361 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:47.884117 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd91741-a002-49a9-9c1a-e7f25f14aceb None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:47.917107 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f09423-3a77-481f-8328-befd620877b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:47.917703 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f09423-3a77-481f-8328-befd620877b0 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:47.917969 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f09423-3a77-481f-8328-befd620877b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:47.918239 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f09423-3a77-481f-8328-befd620877b0 None admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:47.918948 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f09423-3a77-481f-8328-befd620877b0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:47.919247 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f09423-3a77-481f-8328-befd620877b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:47.920681 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f09423-3a77-481f-8328-befd620877b0 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:47.938578 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 552/1092] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Aug 8 17:33:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:47.944291 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f5658-28cf-419a-8668-d19e8c501f80 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:47.993272 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:48.042714 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f5658-28cf-419a-8668-d19e8c501f80 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:48.076273 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47706388-87e4-48bf-9db2-4aa311659dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:48.076898 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47706388-87e4-48bf-9db2-4aa311659dc1 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:48.077701 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47706388-87e4-48bf-9db2-4aa311659dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:48.077975 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47706388-87e4-48bf-9db2-4aa311659dc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:48.145354 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47706388-87e4-48bf-9db2-4aa311659dc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:48.146789 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47706388-87e4-48bf-9db2-4aa311659dc1 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:48.193973 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:48.244830 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 541/1093] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:33:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 17:33:48.251115 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f09423-3a77-481f-8328-befd620877b0 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:48.347288 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:48.350098 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f09423-3a77-481f-8328-befd620877b0 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:48.384446 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575f865-591d-46b7-82ab-08932c8e7c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:48.385106 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575f865-591d-46b7-82ab-08932c8e7c8a None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:48.385393 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575f865-591d-46b7-82ab-08932c8e7c8a None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:48.385668 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575f865-591d-46b7-82ab-08932c8e7c8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:48.396824 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b575f865-591d-46b7-82ab-08932c8e7c8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:48.398297 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b575f865-591d-46b7-82ab-08932c8e7c8a None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:48.416262 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-b575f865-591d-46b7-82ab-08932c8e7c8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:48.416262 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:48.416262 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:48.416262 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:48.416262 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:48.416262 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:48.416262 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:48.416262 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:48.416262 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:48.416262 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:48.416262 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:48.416262 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:48.416262 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:33:48.416262 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:33:48.416262 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:33:48.416262 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:33:48.417461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:48.417461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:48.417461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:48.417461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:48.417461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:48.417461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:48.417461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:48.417461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:48.417461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:48.417461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:48.417461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:48.417461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:48.417461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:48.417461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:48.417461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:48.417461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:48.417461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:33:48.418831 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:33:48.418831 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:33:48.418831 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:48.418831 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 553/1094] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:48.423841 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47706388-87e4-48bf-9db2-4aa311659dc1 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:48.519939 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47706388-87e4-48bf-9db2-4aa311659dc1 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:48.554390 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77492857-fd13-462a-a80f-56eb5cfb37ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:48.554987 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77492857-fd13-462a-a80f-56eb5cfb37ed None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:48.555265 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77492857-fd13-462a-a80f-56eb5cfb37ed None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:48.555537 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77492857-fd13-462a-a80f-56eb5cfb37ed None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:48.556181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77492857-fd13-462a-a80f-56eb5cfb37ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:48.556482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77492857-fd13-462a-a80f-56eb5cfb37ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:48.557889 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77492857-fd13-462a-a80f-56eb5cfb37ed None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:48.569271 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 542/1095] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:48.574790 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575f865-591d-46b7-82ab-08932c8e7c8a None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:48.675203 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575f865-591d-46b7-82ab-08932c8e7c8a None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:48.708238 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb6055-2f7a-4da9-8935-adb730a668ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:48.708864 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb6055-2f7a-4da9-8935-adb730a668ba None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:48.709178 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb6055-2f7a-4da9-8935-adb730a668ba None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:48.709454 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb6055-2f7a-4da9-8935-adb730a668ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:48.715906 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb6055-2f7a-4da9-8935-adb730a668ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:48.717380 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb6055-2f7a-4da9-8935-adb730a668ba None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:48.728326 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-acbb6055-2f7a-4da9-8935-adb730a668ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:33:48.728326 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:48.728326 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:48.728326 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:48.728326 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:48.728326 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:48.728326 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:48.728326 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:48.728326 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:48.728326 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:48.728326 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:48.728326 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:48.728326 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:33:48.728326 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:33:48.728326 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:33:48.729418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:33:48.729418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:48.729418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:48.729418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:48.729418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:48.729418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:48.729418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:48.729418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:48.729418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:48.729418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:48.729418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:48.729418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:48.729418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:48.729418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:48.729418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:48.729418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:48.729418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:48.730377 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:33:48.730377 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:33:48.730377 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:33:48.730377 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:33:48.730377 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:33:48.730377 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:33:48.730377 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:33:48.730377 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:33:48.730377 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 554/1096] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:33:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:33:48.730903 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c99c78-1ba3-482f-95c0-e729aaf3e39b None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:48.731415 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c99c78-1ba3-482f-95c0-e729aaf3e39b None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:48.731699 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c99c78-1ba3-482f-95c0-e729aaf3e39b None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:48.733044 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 543/1097] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:48.735928 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb6055-2f7a-4da9-8935-adb730a668ba None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:48.738441 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1146941-a8cb-49d4-902c-5278da791b31 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:48.738729 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1146941-a8cb-49d4-902c-5278da791b31 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:48.739005 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1146941-a8cb-49d4-902c-5278da791b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:48.751963 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:48.757382 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-f1146941-a8cb-49d4-902c-5278da791b31 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:48.758650 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-f1146941-a8cb-49d4-902c-5278da791b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:48.760703 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:48.827409 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 544/1098] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 17:33:48.835409 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb6055-2f7a-4da9-8935-adb730a668ba None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:48.851930 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1146941-a8cb-49d4-902c-5278da791b31 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:48.869009 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689dd4d6-c4b4-430e-9990-20274c3dea73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:48.869641 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dd4d6-c4b4-430e-9990-20274c3dea73 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:48.869924 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dd4d6-c4b4-430e-9990-20274c3dea73 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:48.870198 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dd4d6-c4b4-430e-9990-20274c3dea73 None admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:48.870884 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689dd4d6-c4b4-430e-9990-20274c3dea73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:48.871189 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689dd4d6-c4b4-430e-9990-20274c3dea73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:48.872617 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689dd4d6-c4b4-430e-9990-20274c3dea73 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:48.884656 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 555/1099] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 8 17:33:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:48.891071 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689dd4d6-c4b4-430e-9990-20274c3dea73 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:48.950387 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1146941-a8cb-49d4-902c-5278da791b31 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:48.960396 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:48.985769 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a59cea-a261-4711-8ca5-9e567e84bab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:48.986393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a59cea-a261-4711-8ca5-9e567e84bab2 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:48.986674 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a59cea-a261-4711-8ca5-9e567e84bab2 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:48.986949 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a59cea-a261-4711-8ca5-9e567e84bab2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:48.991009 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689dd4d6-c4b4-430e-9990-20274c3dea73 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:48.993707 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:48.997457 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a59cea-a261-4711-8ca5-9e567e84bab2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:33:49.002468 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-a2a59cea-a261-4711-8ca5-9e567e84bab2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:33:49.002468 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:33:49.002468 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:33:49.002468 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:33:49.002468 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:33:49.002468 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:33:49.002468 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:33:49.002468 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:33:49.002468 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:33:49.002468 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:33:49.002468 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:33:49.002468 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:33:49.002468 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:33:49.002468 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:33:49.002468 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:33:49.002468 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:33:49.003505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:33:49.003505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:33:49.003505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:33:49.003505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:33:49.003505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:33:49.003505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:33:49.003505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:33:49.003505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:33:49.003505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:33:49.003505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:33:49.003505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:33:49.003505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:33:49.003505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:33:49.003505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:33:49.003505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:33:49.003505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:33:49.004373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:33:49.004373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:33:49.004373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:33:49.004373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:33:49.004373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:33:49.004373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:33:49.004373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:33:49.004373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:33:49.004373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:33:49.004373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:33:49.004373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:33:49.004373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:33:49.004373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 545/1100] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 8 17:33:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:33:49.009503 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a59cea-a261-4711-8ca5-9e567e84bab2 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:49.028914 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59141e6a-d64e-4af1-ad59-710a135466cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:49.029555 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59141e6a-d64e-4af1-ad59-710a135466cf None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:49.029837 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59141e6a-d64e-4af1-ad59-710a135466cf None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:49.030232 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59141e6a-d64e-4af1-ad59-710a135466cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:49.031008 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59141e6a-d64e-4af1-ad59-710a135466cf None admin] RBAC: Adding query filter params (role.id=b0560db9df8a46708b8b37d306895467, scope.project.id=047a28b7cd11486da9d330723a384812, user.id=3973b8fbfbb9475896e4e110ca8aa615) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:49.031323 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59141e6a-d64e-4af1-ad59-710a135466cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:49.032739 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59141e6a-d64e-4af1-ad59-710a135466cf None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:49.038374 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 556/1101] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:33:48 2022] GET /identity/v3/role_assignments?user.id=3973b8fbfbb9475896e4e110ca8aa615&scope.project.id=047a28b7cd11486da9d330723a384812&role.id=b0560db9df8a46708b8b37d306895467 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:33:49.123276 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a59cea-a261-4711-8ca5-9e567e84bab2 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:49.159506 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060ba56-c7e0-46e7-89cd-339e7fdc81a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:49.160123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060ba56-c7e0-46e7-89cd-339e7fdc81a6 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:49.160403 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060ba56-c7e0-46e7-89cd-339e7fdc81a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:49.160674 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060ba56-c7e0-46e7-89cd-339e7fdc81a6 None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:49.161384 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060ba56-c7e0-46e7-89cd-339e7fdc81a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:49.161688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060ba56-c7e0-46e7-89cd-339e7fdc81a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:49.163073 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060ba56-c7e0-46e7-89cd-339e7fdc81a6 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:49.172087 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 546/1102] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:33:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:49.178117 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59141e6a-d64e-4af1-ad59-710a135466cf None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:49.282560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59141e6a-d64e-4af1-ad59-710a135466cf None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:49.316675 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9505267-ec16-43ea-8d57-999a77d942d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:49.317337 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9505267-ec16-43ea-8d57-999a77d942d0 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:49.317613 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9505267-ec16-43ea-8d57-999a77d942d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:49.317881 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9505267-ec16-43ea-8d57-999a77d942d0 None admin] PATH_INFO: `/v3/users/230dc65a36d5414db5b5f580444406e2` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:49.319003 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9505267-ec16-43ea-8d57-999a77d942d0 None admin] RBAC: Authorizing `identity:get_user(user_id=230dc65a36d5414db5b5f580444406e2)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:49.320407 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9505267-ec16-43ea-8d57-999a77d942d0 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:49.322156 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 557/1103] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:33:49 2022] GET /identity/v3/users/230dc65a36d5414db5b5f580444406e2 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:33:49.329116 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060ba56-c7e0-46e7-89cd-339e7fdc81a6 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:49.398522 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:49.440328 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060ba56-c7e0-46e7-89cd-339e7fdc81a6 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:49.474817 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad5125-95fd-4527-8792-9adb244712e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:49.475422 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad5125-95fd-4527-8792-9adb244712e5 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:49.475700 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad5125-95fd-4527-8792-9adb244712e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:49.475968 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad5125-95fd-4527-8792-9adb244712e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:49.546932 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad5125-95fd-4527-8792-9adb244712e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:49.548391 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad5125-95fd-4527-8792-9adb244712e5 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:49.607749 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:49.652203 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 547/1104] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:33:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 17:33:49.658556 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9505267-ec16-43ea-8d57-999a77d942d0 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:49.662351 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:49.759752 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9505267-ec16-43ea-8d57-999a77d942d0 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:49.793656 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6046d-bb2d-49db-8766-0ec861c34e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:49.794284 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6046d-bb2d-49db-8766-0ec861c34e4c None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:49.794565 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6046d-bb2d-49db-8766-0ec861c34e4c None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:49.794836 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6046d-bb2d-49db-8766-0ec861c34e4c None admin] PATH_INFO: `/v3/projects/05257bc1557c405c94a0ba30586b0a93` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:49.796548 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6046d-bb2d-49db-8766-0ec861c34e4c None admin] RBAC: Authorizing `identity:get_project(project_id=05257bc1557c405c94a0ba30586b0a93)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:49.798073 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6046d-bb2d-49db-8766-0ec861c34e4c None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:49.799702 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 558/1105] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:33:49 2022] GET /identity/v3/projects/05257bc1557c405c94a0ba30586b0a93 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:49.806146 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad5125-95fd-4527-8792-9adb244712e5 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:49.909551 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad5125-95fd-4527-8792-9adb244712e5 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:49.943360 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84fd54-87b5-4a24-ba03-efc676da55b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:49.943958 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84fd54-87b5-4a24-ba03-efc676da55b5 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:49.944239 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84fd54-87b5-4a24-ba03-efc676da55b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:49.944513 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84fd54-87b5-4a24-ba03-efc676da55b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:49.945269 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df84fd54-87b5-4a24-ba03-efc676da55b5 None admin] RBAC: Adding query filter params (role.id=5c25aa917ab34baabb795c54dd8a4d02, scope.project.id=05257bc1557c405c94a0ba30586b0a93, user.id=230dc65a36d5414db5b5f580444406e2) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:49.945581 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df84fd54-87b5-4a24-ba03-efc676da55b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:49.947001 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df84fd54-87b5-4a24-ba03-efc676da55b5 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:49.952671 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 548/1106] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:33:49 2022] GET /identity/v3/role_assignments?user.id=230dc65a36d5414db5b5f580444406e2&scope.project.id=05257bc1557c405c94a0ba30586b0a93&role.id=5c25aa917ab34baabb795c54dd8a4d02 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:51.957731 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd26eda-96e7-44e6-9ea8-3d30009bdf1a None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:51.958337 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd26eda-96e7-44e6-9ea8-3d30009bdf1a None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:51.958337 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd26eda-96e7-44e6-9ea8-3d30009bdf1a None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:51.959577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 559/1107] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:51.964759 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f83a88-95a4-45ed-92c8-808ac22f95ed None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:51.965204 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f83a88-95a4-45ed-92c8-808ac22f95ed None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:51.965339 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f83a88-95a4-45ed-92c8-808ac22f95ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:51.983620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-19f83a88-95a4-45ed-92c8-808ac22f95ed None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:51.984838 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-19f83a88-95a4-45ed-92c8-808ac22f95ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:52.001524 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:52.048445 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 549/1108] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:33:52.072749 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd26eda-96e7-44e6-9ea8-3d30009bdf1a None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:52.144523 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:52.174825 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd26eda-96e7-44e6-9ea8-3d30009bdf1a None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:52.208428 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269f930-bddf-452a-8f22-5669a7148dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:52.208974 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269f930-bddf-452a-8f22-5669a7148dde None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:52.209283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269f930-bddf-452a-8f22-5669a7148dde None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:52.209555 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269f930-bddf-452a-8f22-5669a7148dde None admin] PATH_INFO: `/v3/domains/default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:52.210658 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269f930-bddf-452a-8f22-5669a7148dde None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:52.212069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269f930-bddf-452a-8f22-5669a7148dde None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:52.213641 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 560/1109] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:33:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:52.219556 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f83a88-95a4-45ed-92c8-808ac22f95ed None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:52.317238 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f83a88-95a4-45ed-92c8-808ac22f95ed None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:52.350331 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591a1e5-c10d-40c7-a719-4d17fb3faf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:52.350921 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591a1e5-c10d-40c7-a719-4d17fb3faf2e None admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:52.351201 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591a1e5-c10d-40c7-a719-4d17fb3faf2e None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:52.351473 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591a1e5-c10d-40c7-a719-4d17fb3faf2e None admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:52.352118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591a1e5-c10d-40c7-a719-4d17fb3faf2e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:52.353581 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591a1e5-c10d-40c7-a719-4d17fb3faf2e None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:52.458864 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 550/1110] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Aug 8 17:33:52 2022] POST /identity/v3/users => generated 286 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:33:54.485570 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15be8f5-66b8-46be-bbd2-e9bb3effcb68 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:54.486108 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15be8f5-66b8-46be-bbd2-e9bb3effcb68 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:54.486108 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15be8f5-66b8-46be-bbd2-e9bb3effcb68 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:54.487427 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 561/1111] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:54.492456 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f217ee4-131d-45e1-a1ec-f67a4ba9d5f8 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:54.492855 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f217ee4-131d-45e1-a1ec-f67a4ba9d5f8 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:54.492999 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f217ee4-131d-45e1-a1ec-f67a4ba9d5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:54.510744 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-3f217ee4-131d-45e1-a1ec-f67a4ba9d5f8 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:54.511925 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-3f217ee4-131d-45e1-a1ec-f67a4ba9d5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:54.514690 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:54.578841 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 551/1112] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:33:54.602143 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15be8f5-66b8-46be-bbd2-e9bb3effcb68 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:54.701916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15be8f5-66b8-46be-bbd2-e9bb3effcb68 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:54.734416 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d66c35-6280-45d3-bffb-81ae902e624f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:54.735028 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d66c35-6280-45d3-bffb-81ae902e624f None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:54.735310 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d66c35-6280-45d3-bffb-81ae902e624f None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:54.735585 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d66c35-6280-45d3-bffb-81ae902e624f None admin] PATH_INFO: `/v3/roles/0ff11803573b472ab020a59b7f452dcd` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:54.736970 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d66c35-6280-45d3-bffb-81ae902e624f None admin] RBAC: Authorizing `identity:get_role(role_id=0ff11803573b472ab020a59b7f452dcd)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:54.738359 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d66c35-6280-45d3-bffb-81ae902e624f None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:54.739673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 562/1113] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:33:54 2022] GET /identity/v3/roles/0ff11803573b472ab020a59b7f452dcd => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:54.745391 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f217ee4-131d-45e1-a1ec-f67a4ba9d5f8 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:54.840782 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f217ee4-131d-45e1-a1ec-f67a4ba9d5f8 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:54.875193 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64719ece-77ee-45d4-93b3-86ef3fee3d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:54.875795 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64719ece-77ee-45d4-93b3-86ef3fee3d11 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:54.876072 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64719ece-77ee-45d4-93b3-86ef3fee3d11 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:54.876342 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64719ece-77ee-45d4-93b3-86ef3fee3d11 None admin] PATH_INFO: `/v3/users/a0e3b01e3221483b8d1f2785f08c76f2` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:54.886049 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:54.889701 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64719ece-77ee-45d4-93b3-86ef3fee3d11 None admin] RBAC: Authorizing `identity:get_user(user_id=a0e3b01e3221483b8d1f2785f08c76f2)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:54.891113 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64719ece-77ee-45d4-93b3-86ef3fee3d11 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:54.892675 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 552/1114] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:33:54 2022] GET /identity/v3/users/a0e3b01e3221483b8d1f2785f08c76f2 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:54.898402 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d66c35-6280-45d3-bffb-81ae902e624f None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:54.909664 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:54.996838 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d66c35-6280-45d3-bffb-81ae902e624f None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:55.030068 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35ca1a-b0a1-459f-8ee5-7dfc28c60dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:55.030658 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35ca1a-b0a1-459f-8ee5-7dfc28c60dd9 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:55.030938 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35ca1a-b0a1-459f-8ee5-7dfc28c60dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:55.031208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35ca1a-b0a1-459f-8ee5-7dfc28c60dd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:55.097451 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be35ca1a-b0a1-459f-8ee5-7dfc28c60dd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:55.098874 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be35ca1a-b0a1-459f-8ee5-7dfc28c60dd9 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:55.109138 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:55.194670 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 563/1115] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:33:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 17:33:55.200651 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64719ece-77ee-45d4-93b3-86ef3fee3d11 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:55.298494 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64719ece-77ee-45d4-93b3-86ef3fee3d11 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:55.331458 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681893a-fd0f-46ff-bae5-4a3ec8e937aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:55.332074 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681893a-fd0f-46ff-bae5-4a3ec8e937aa None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:55.332356 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681893a-fd0f-46ff-bae5-4a3ec8e937aa None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:55.332631 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681893a-fd0f-46ff-bae5-4a3ec8e937aa None admin] PATH_INFO: `/v3/projects/05257bc1557c405c94a0ba30586b0a93` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:55.333759 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b681893a-fd0f-46ff-bae5-4a3ec8e937aa None admin] RBAC: Authorizing `identity:get_project(project_id=05257bc1557c405c94a0ba30586b0a93)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:55.335190 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b681893a-fd0f-46ff-bae5-4a3ec8e937aa None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:55.336801 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 553/1116] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:33:55 2022] GET /identity/v3/projects/05257bc1557c405c94a0ba30586b0a93 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:55.343347 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35ca1a-b0a1-459f-8ee5-7dfc28c60dd9 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:55.438975 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35ca1a-b0a1-459f-8ee5-7dfc28c60dd9 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:55.447804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:55.472530 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121dfde-eeb6-4afe-80fb-259c9453605b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:55.473150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121dfde-eeb6-4afe-80fb-259c9453605b None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:55.473433 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121dfde-eeb6-4afe-80fb-259c9453605b None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:55.473705 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121dfde-eeb6-4afe-80fb-259c9453605b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:55.474419 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121dfde-eeb6-4afe-80fb-259c9453605b None admin] RBAC: Adding query filter params (role.id=0ff11803573b472ab020a59b7f452dcd, scope.project.id=05257bc1557c405c94a0ba30586b0a93, user.id=a0e3b01e3221483b8d1f2785f08c76f2) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:33:55.474728 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121dfde-eeb6-4afe-80fb-259c9453605b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:55.476140 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121dfde-eeb6-4afe-80fb-259c9453605b None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:55.482206 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 564/1117] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:33:55 2022] GET /identity/v3/role_assignments?user.id=a0e3b01e3221483b8d1f2785f08c76f2&scope.project.id=05257bc1557c405c94a0ba30586b0a93&role.id=0ff11803573b472ab020a59b7f452dcd => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:57.448762 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d22f99-838d-46fd-9f72-1f771b794a69 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:57.449324 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d22f99-838d-46fd-9f72-1f771b794a69 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:57.449423 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d22f99-838d-46fd-9f72-1f771b794a69 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:57.450761 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 554/1118] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:33:57.457000 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67144b5a-0bd0-4e5c-b953-c55103382899 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:57.457421 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67144b5a-0bd0-4e5c-b953-c55103382899 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:57.457572 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67144b5a-0bd0-4e5c-b953-c55103382899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:57.475474 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-67144b5a-0bd0-4e5c-b953-c55103382899 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:33:57.476642 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-67144b5a-0bd0-4e5c-b953-c55103382899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:33:57.545550 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 565/1119] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:33:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:33:57.568074 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d22f99-838d-46fd-9f72-1f771b794a69 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:57.633793 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:57.668162 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d22f99-838d-46fd-9f72-1f771b794a69 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:57.703843 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5d5a8-90a5-45dc-9114-bc20ab650dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:57.704467 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5d5a8-90a5-45dc-9114-bc20ab650dee None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:57.704750 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5d5a8-90a5-45dc-9114-bc20ab650dee None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:57.705025 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5d5a8-90a5-45dc-9114-bc20ab650dee None admin] PATH_INFO: `/v3/roles/0ff11803573b472ab020a59b7f452dcd` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:57.706447 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5d5a8-90a5-45dc-9114-bc20ab650dee None admin] RBAC: Authorizing `identity:get_role(role_id=0ff11803573b472ab020a59b7f452dcd)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:57.707815 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5d5a8-90a5-45dc-9114-bc20ab650dee None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:57.709168 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 555/1120] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:33:57 2022] GET /identity/v3/roles/0ff11803573b472ab020a59b7f452dcd => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:57.715049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67144b5a-0bd0-4e5c-b953-c55103382899 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:57.812517 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67144b5a-0bd0-4e5c-b953-c55103382899 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:57.814042 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:33:57.846273 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2594c-1c54-46f7-b816-8392ca53395e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:57.846891 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2594c-1c54-46f7-b816-8392ca53395e None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:57.847174 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2594c-1c54-46f7-b816-8392ca53395e None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:57.847447 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2594c-1c54-46f7-b816-8392ca53395e None admin] PATH_INFO: `/v3/users/a0e3b01e3221483b8d1f2785f08c76f2` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:57.848568 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2594c-1c54-46f7-b816-8392ca53395e None admin] RBAC: Authorizing `identity:get_user(user_id=a0e3b01e3221483b8d1f2785f08c76f2)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:57.850049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2594c-1c54-46f7-b816-8392ca53395e None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:57.851600 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 566/1121] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:33:57 2022] GET /identity/v3/users/a0e3b01e3221483b8d1f2785f08c76f2 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:57.858606 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5d5a8-90a5-45dc-9114-bc20ab650dee None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:57.956618 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5d5a8-90a5-45dc-9114-bc20ab650dee None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:57.990244 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d54c4-6dc0-4f6f-b296-a7d21bf51ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:57.990858 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d54c4-6dc0-4f6f-b296-a7d21bf51ec3 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:57.991140 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d54c4-6dc0-4f6f-b296-a7d21bf51ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:57.991415 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d54c4-6dc0-4f6f-b296-a7d21bf51ec3 None admin] PATH_INFO: `/v3/projects/05257bc1557c405c94a0ba30586b0a93` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:57.992518 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d54c4-6dc0-4f6f-b296-a7d21bf51ec3 None admin] RBAC: Authorizing `identity:get_project(project_id=05257bc1557c405c94a0ba30586b0a93)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:57.993996 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d54c4-6dc0-4f6f-b296-a7d21bf51ec3 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:57.995607 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 556/1122] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:33:57 2022] GET /identity/v3/projects/05257bc1557c405c94a0ba30586b0a93 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:33:58.001878 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2594c-1c54-46f7-b816-8392ca53395e None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:33:58.100621 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2594c-1c54-46f7-b816-8392ca53395e None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:33:58.134308 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45b7fc-5be4-4a7b-bd66-942596434429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:33:58.134948 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45b7fc-5be4-4a7b-bd66-942596434429 None admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:33:58.135233 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45b7fc-5be4-4a7b-bd66-942596434429 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:33:58.135506 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45b7fc-5be4-4a7b-bd66-942596434429 None admin] PATH_INFO: `/v3/projects/05257bc1557c405c94a0ba30586b0a93/users/a0e3b01e3221483b8d1f2785f08c76f2/roles/0ff11803573b472ab020a59b7f452dcd` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:33:58.137652 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45b7fc-5be4-4a7b-bd66-942596434429 None admin] RBAC: Authorizing `identity:create_grant(project_id=05257bc1557c405c94a0ba30586b0a93, user_id=a0e3b01e3221483b8d1f2785f08c76f2, role_id=0ff11803573b472ab020a59b7f452dcd)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:33:58.139753 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45b7fc-5be4-4a7b-bd66-942596434429 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:33:58.211343 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 567/1123] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 8 17:33:58 2022] PUT /identity/v3/projects/05257bc1557c405c94a0ba30586b0a93/users/a0e3b01e3221483b8d1f2785f08c76f2/roles/0ff11803573b472ab020a59b7f452dcd => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:34:00.171224 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad315cb5-7bbb-456c-b25f-a472dd3d1a37 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:00.171786 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad315cb5-7bbb-456c-b25f-a472dd3d1a37 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:00.171786 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad315cb5-7bbb-456c-b25f-a472dd3d1a37 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:00.173168 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 557/1124] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 17:34:00.178347 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c25531-4ecf-48fc-bd42-88538db98eed None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:00.178732 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c25531-4ecf-48fc-bd42-88538db98eed None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:00.178897 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c25531-4ecf-48fc-bd42-88538db98eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:00.196643 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-72c25531-4ecf-48fc-bd42-88538db98eed None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:34:00.197878 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-72c25531-4ecf-48fc-bd42-88538db98eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:34:00.222017 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:00.264657 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 568/1125] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:34:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:34:00.288566 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad315cb5-7bbb-456c-b25f-a472dd3d1a37 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:00.291456 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:00.390301 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad315cb5-7bbb-456c-b25f-a472dd3d1a37 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:00.424622 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ee82e-96cc-452f-bf14-7ec8c17e44b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:00.425213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ee82e-96cc-452f-bf14-7ec8c17e44b2 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:00.425491 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ee82e-96cc-452f-bf14-7ec8c17e44b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:00.425761 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ee82e-96cc-452f-bf14-7ec8c17e44b2 None admin] PATH_INFO: `/v3/roles/0ff11803573b472ab020a59b7f452dcd` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:00.427123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ee82e-96cc-452f-bf14-7ec8c17e44b2 None admin] RBAC: Authorizing `identity:get_role(role_id=0ff11803573b472ab020a59b7f452dcd)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:00.428471 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ee82e-96cc-452f-bf14-7ec8c17e44b2 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:00.429809 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 558/1126] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:34:00 2022] GET /identity/v3/roles/0ff11803573b472ab020a59b7f452dcd => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:34:00.436101 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c25531-4ecf-48fc-bd42-88538db98eed None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:00.532397 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c25531-4ecf-48fc-bd42-88538db98eed None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:00.565452 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977b517-9748-4fbb-9e25-46ce48c8f99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:00.566064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977b517-9748-4fbb-9e25-46ce48c8f99b None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:00.566340 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977b517-9748-4fbb-9e25-46ce48c8f99b None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:00.566610 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977b517-9748-4fbb-9e25-46ce48c8f99b None admin] PATH_INFO: `/v3/users/a0e3b01e3221483b8d1f2785f08c76f2` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:00.567698 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977b517-9748-4fbb-9e25-46ce48c8f99b None admin] RBAC: Authorizing `identity:get_user(user_id=a0e3b01e3221483b8d1f2785f08c76f2)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:00.569142 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977b517-9748-4fbb-9e25-46ce48c8f99b None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:00.570672 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 569/1127] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:34:00 2022] GET /identity/v3/users/a0e3b01e3221483b8d1f2785f08c76f2 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:34:00.576622 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ee82e-96cc-452f-bf14-7ec8c17e44b2 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:00.644823 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:00.674745 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ee82e-96cc-452f-bf14-7ec8c17e44b2 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:00.707864 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9735bd-edf1-49f2-b59c-e0b13163938e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:00.708452 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9735bd-edf1-49f2-b59c-e0b13163938e None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:00.708726 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9735bd-edf1-49f2-b59c-e0b13163938e None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:00.708991 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9735bd-edf1-49f2-b59c-e0b13163938e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:00.774326 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9735bd-edf1-49f2-b59c-e0b13163938e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:00.775749 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9735bd-edf1-49f2-b59c-e0b13163938e None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:00.840850 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:00.873717 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 559/1128] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:34:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 17:34:00.879744 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977b517-9748-4fbb-9e25-46ce48c8f99b None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:00.908411 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:00.977682 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977b517-9748-4fbb-9e25-46ce48c8f99b None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:01.010113 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a71d9-68ce-4104-805d-d0fed631724a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:01.010727 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a71d9-68ce-4104-805d-d0fed631724a None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:01.011008 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a71d9-68ce-4104-805d-d0fed631724a None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:01.011284 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a71d9-68ce-4104-805d-d0fed631724a None admin] PATH_INFO: `/v3/projects/05257bc1557c405c94a0ba30586b0a93` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:01.012396 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a71d9-68ce-4104-805d-d0fed631724a None admin] RBAC: Authorizing `identity:get_project(project_id=05257bc1557c405c94a0ba30586b0a93)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:01.014388 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a71d9-68ce-4104-805d-d0fed631724a None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:01.015977 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 570/1129] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:34:00 2022] GET /identity/v3/projects/05257bc1557c405c94a0ba30586b0a93 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:34:01.022051 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9735bd-edf1-49f2-b59c-e0b13163938e None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:01.120575 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9735bd-edf1-49f2-b59c-e0b13163938e None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:01.153499 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24b308-09c3-4770-bc36-74f7e1fd0e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:01.155053 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24b308-09c3-4770-bc36-74f7e1fd0e4e None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:01.155327 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24b308-09c3-4770-bc36-74f7e1fd0e4e None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:01.155668 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24b308-09c3-4770-bc36-74f7e1fd0e4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:01.156659 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24b308-09c3-4770-bc36-74f7e1fd0e4e None admin] RBAC: Adding query filter params (role.id=0ff11803573b472ab020a59b7f452dcd, scope.project.id=05257bc1557c405c94a0ba30586b0a93, user.id=a0e3b01e3221483b8d1f2785f08c76f2) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:34:01.157101 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24b308-09c3-4770-bc36-74f7e1fd0e4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:01.158511 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24b308-09c3-4770-bc36-74f7e1fd0e4e None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:01.164003 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 560/1130] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:34:01 2022] GET /identity/v3/role_assignments?user.id=a0e3b01e3221483b8d1f2785f08c76f2&scope.project.id=05257bc1557c405c94a0ba30586b0a93&role.id=0ff11803573b472ab020a59b7f452dcd => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:34:03.170320 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd79c7f-a8de-48aa-8876-f5842929689a None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:03.170887 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd79c7f-a8de-48aa-8876-f5842929689a None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:03.170887 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd79c7f-a8de-48aa-8876-f5842929689a None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:03.172181 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 571/1131] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:34:03.177284 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b395e-d1cc-46a8-a27d-e3ad7325b52e None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:03.177666 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b395e-d1cc-46a8-a27d-e3ad7325b52e None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:03.177849 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b395e-d1cc-46a8-a27d-e3ad7325b52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:03.196366 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-d83b395e-d1cc-46a8-a27d-e3ad7325b52e None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:34:03.197578 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-d83b395e-d1cc-46a8-a27d-e3ad7325b52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:34:03.222980 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:03.261988 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 561/1132] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:34:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:34:03.284664 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd79c7f-a8de-48aa-8876-f5842929689a None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:03.376665 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:03.382952 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd79c7f-a8de-48aa-8876-f5842929689a None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:03.416663 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841d283-72f6-4a39-900a-c84f18ecc3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:03.417322 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841d283-72f6-4a39-900a-c84f18ecc3ad None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:03.417607 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841d283-72f6-4a39-900a-c84f18ecc3ad None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:03.417880 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841d283-72f6-4a39-900a-c84f18ecc3ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:03.418986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841d283-72f6-4a39-900a-c84f18ecc3ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:03.421311 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841d283-72f6-4a39-900a-c84f18ecc3ad None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:03.422844 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 572/1133] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:34:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:34:03.428647 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b395e-d1cc-46a8-a27d-e3ad7325b52e None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:03.525107 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b395e-d1cc-46a8-a27d-e3ad7325b52e None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:03.558220 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0a518-61f8-4d7e-a863-8cc079c3ab2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:03.558801 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0a518-61f8-4d7e-a863-8cc079c3ab2c None admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:03.559076 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0a518-61f8-4d7e-a863-8cc079c3ab2c None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:03.559344 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0a518-61f8-4d7e-a863-8cc079c3ab2c None admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:03.560918 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0a518-61f8-4d7e-a863-8cc079c3ab2c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:03.562357 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0a518-61f8-4d7e-a863-8cc079c3ab2c None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:03.640906 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 562/1134] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Aug 8 17:34:03 2022] POST /identity/v3/projects => generated 311 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:34:05.703005 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b703ba-3c22-4794-9cbd-36447f2abc83 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:05.703557 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b703ba-3c22-4794-9cbd-36447f2abc83 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:05.703557 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b703ba-3c22-4794-9cbd-36447f2abc83 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:05.704871 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 573/1135] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:34:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:34:05.710133 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b5d74-da0d-4dc8-808c-c99e0e9650ad None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:05.710534 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b5d74-da0d-4dc8-808c-c99e0e9650ad None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:05.710692 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b5d74-da0d-4dc8-808c-c99e0e9650ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:05.729022 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-ef1b5d74-da0d-4dc8-808c-c99e0e9650ad None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:34:05.730483 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-ef1b5d74-da0d-4dc8-808c-c99e0e9650ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:34:05.741712 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:05.797134 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 563/1136] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:34:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:34:05.820671 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b703ba-3c22-4794-9cbd-36447f2abc83 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:05.918776 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b703ba-3c22-4794-9cbd-36447f2abc83 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:05.951816 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555bb914-0739-4e71-b6f3-3de258918620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:05.952410 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bb914-0739-4e71-b6f3-3de258918620 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:05.952689 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bb914-0739-4e71-b6f3-3de258918620 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:05.952959 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bb914-0739-4e71-b6f3-3de258918620 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:05.954126 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555bb914-0739-4e71-b6f3-3de258918620 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:05.955487 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555bb914-0739-4e71-b6f3-3de258918620 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:05.957001 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 574/1137] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:34:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:34:05.962532 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b5d74-da0d-4dc8-808c-c99e0e9650ad None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:06.056910 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b5d74-da0d-4dc8-808c-c99e0e9650ad None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:06.089795 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de3d204-0ecb-48b4-9a0e-423bd1bd9b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:06.090378 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3d204-0ecb-48b4-9a0e-423bd1bd9b1b None admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:06.090652 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3d204-0ecb-48b4-9a0e-423bd1bd9b1b None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:06.091519 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3d204-0ecb-48b4-9a0e-423bd1bd9b1b None admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:06.092202 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de3d204-0ecb-48b4-9a0e-423bd1bd9b1b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:06.093650 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de3d204-0ecb-48b4-9a0e-423bd1bd9b1b None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:06.188174 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 564/1138] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Aug 8 17:34:05 2022] POST /identity/v3/users => generated 286 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:34:08.221730 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87202c38-5c4b-430a-af63-2778394445ba None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:08.222297 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87202c38-5c4b-430a-af63-2778394445ba None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:08.222297 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87202c38-5c4b-430a-af63-2778394445ba None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:08.223607 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 575/1139] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:34:08.228825 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0522e-d380-4453-9ea3-b8a7acbb5fc6 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:08.229242 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0522e-d380-4453-9ea3-b8a7acbb5fc6 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:08.229403 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0522e-d380-4453-9ea3-b8a7acbb5fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:08.236522 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:08.248773 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-ffe0522e-d380-4453-9ea3-b8a7acbb5fc6 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:34:08.249997 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-ffe0522e-d380-4453-9ea3-b8a7acbb5fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:34:08.314508 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 565/1140] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:34:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:34:08.337553 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87202c38-5c4b-430a-af63-2778394445ba None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:08.368579 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:08.445928 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87202c38-5c4b-430a-af63-2778394445ba None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:08.478941 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed57ca5-818e-47f8-9de4-cd4a4550f182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:08.479489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed57ca5-818e-47f8-9de4-cd4a4550f182 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:08.479768 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed57ca5-818e-47f8-9de4-cd4a4550f182 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:08.480039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed57ca5-818e-47f8-9de4-cd4a4550f182 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:08.490635 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed57ca5-818e-47f8-9de4-cd4a4550f182 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:34:08.495195 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-5ed57ca5-818e-47f8-9de4-cd4a4550f182 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:34:08.495195 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:34:08.495195 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:34:08.495195 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:34:08.495195 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:34:08.495195 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:34:08.495195 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:34:08.495195 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:34:08.495195 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:34:08.495195 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:34:08.495195 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:34:08.495195 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:34:08.495195 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:34:08.495195 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:34:08.495195 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:34:08.495195 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:34:08.496406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:34:08.496406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:34:08.496406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:34:08.496406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:34:08.496406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:34:08.496406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:34:08.496406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:34:08.496406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:34:08.496406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:34:08.496406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:34:08.496406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:34:08.496406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:34:08.496406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:34:08.496406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:34:08.496406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:34:08.496406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:34:08.498092 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:34:08.498092 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:34:08.498092 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:34:08.498092 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:34:08.498092 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:34:08.498092 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:34:08.498092 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:34:08.498092 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:34:08.498092 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:34:08.498092 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:34:08.498092 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:34:08.498092 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:34:08.498092 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 576/1141] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 8 17:34:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:34:08.502977 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0522e-d380-4453-9ea3-b8a7acbb5fc6 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:08.598671 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0522e-d380-4453-9ea3-b8a7acbb5fc6 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:08.627217 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:08.631942 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008563e-fdb0-4f66-a4ba-788e2ef696c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:08.632536 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008563e-fdb0-4f66-a4ba-788e2ef696c2 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:08.632813 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008563e-fdb0-4f66-a4ba-788e2ef696c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:08.633108 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008563e-fdb0-4f66-a4ba-788e2ef696c2 None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:08.633767 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008563e-fdb0-4f66-a4ba-788e2ef696c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:34:08.644536 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008563e-fdb0-4f66-a4ba-788e2ef696c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:08.644536 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008563e-fdb0-4f66-a4ba-788e2ef696c2 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:08.644536 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 566/1142] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:34:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:34:08.648837 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed57ca5-818e-47f8-9de4-cd4a4550f182 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:08.742623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:08.751306 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed57ca5-818e-47f8-9de4-cd4a4550f182 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:08.785046 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ea2a2-b8ae-4c73-82c6-0bcc41e7581e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:08.785675 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ea2a2-b8ae-4c73-82c6-0bcc41e7581e None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:08.785953 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ea2a2-b8ae-4c73-82c6-0bcc41e7581e None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:08.786224 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ea2a2-b8ae-4c73-82c6-0bcc41e7581e None admin] PATH_INFO: `/v3/users/01e326adbaca47fd948b6562dd71fb52` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:08.799310 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5ea2a2-b8ae-4c73-82c6-0bcc41e7581e None admin] RBAC: Authorizing `identity:get_user(user_id=01e326adbaca47fd948b6562dd71fb52)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:08.800731 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5ea2a2-b8ae-4c73-82c6-0bcc41e7581e None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:08.802332 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 577/1143] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:34:08 2022] GET /identity/v3/users/01e326adbaca47fd948b6562dd71fb52 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:34:08.808052 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008563e-fdb0-4f66-a4ba-788e2ef696c2 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:08.905198 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008563e-fdb0-4f66-a4ba-788e2ef696c2 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:08.937597 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17e2a8-bf9c-4dca-a97b-1215301147fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:08.938186 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17e2a8-bf9c-4dca-a97b-1215301147fc None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:08.938469 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17e2a8-bf9c-4dca-a97b-1215301147fc None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:08.938742 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17e2a8-bf9c-4dca-a97b-1215301147fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:08.997740 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:09.004730 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17e2a8-bf9c-4dca-a97b-1215301147fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:09.006201 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17e2a8-bf9c-4dca-a97b-1215301147fc None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:09.101320 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 567/1144] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:34:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 17:34:09.108197 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ea2a2-b8ae-4c73-82c6-0bcc41e7581e None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:09.208998 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ea2a2-b8ae-4c73-82c6-0bcc41e7581e None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:09.242163 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f67a7-de52-4ee8-92f7-bdf40a4b79e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:09.242769 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f67a7-de52-4ee8-92f7-bdf40a4b79e1 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:09.243049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f67a7-de52-4ee8-92f7-bdf40a4b79e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:09.243322 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f67a7-de52-4ee8-92f7-bdf40a4b79e1 None admin] PATH_INFO: `/v3/projects/3c56e87928e946d283884b2017c5631b` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:09.244431 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f67a7-de52-4ee8-92f7-bdf40a4b79e1 None admin] RBAC: Authorizing `identity:get_project(project_id=3c56e87928e946d283884b2017c5631b)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:09.245872 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f67a7-de52-4ee8-92f7-bdf40a4b79e1 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:09.248206 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 578/1145] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:34:09 2022] GET /identity/v3/projects/3c56e87928e946d283884b2017c5631b => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:34:09.254480 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17e2a8-bf9c-4dca-a97b-1215301147fc None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:09.344769 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:09.351091 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17e2a8-bf9c-4dca-a97b-1215301147fc None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:09.383914 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0f7a1-c885-4ff7-aea9-d409c73fe00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:09.384499 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0f7a1-c885-4ff7-aea9-d409c73fe00e None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:09.384775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0f7a1-c885-4ff7-aea9-d409c73fe00e None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:09.385062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0f7a1-c885-4ff7-aea9-d409c73fe00e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:09.385781 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0f7a1-c885-4ff7-aea9-d409c73fe00e None admin] RBAC: Adding query filter params (role.id=5c25aa917ab34baabb795c54dd8a4d02, scope.project.id=3c56e87928e946d283884b2017c5631b, user.id=01e326adbaca47fd948b6562dd71fb52) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:34:09.386083 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0f7a1-c885-4ff7-aea9-d409c73fe00e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:09.387493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0f7a1-c885-4ff7-aea9-d409c73fe00e None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:09.394156 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 568/1146] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:34:09 2022] GET /identity/v3/role_assignments?user.id=01e326adbaca47fd948b6562dd71fb52&scope.project.id=3c56e87928e946d283884b2017c5631b&role.id=5c25aa917ab34baabb795c54dd8a4d02 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:34:11.362285 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baba81e-5945-48d8-96a6-9a380f4caf2e None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:11.362849 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baba81e-5945-48d8-96a6-9a380f4caf2e None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:11.362849 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baba81e-5945-48d8-96a6-9a380f4caf2e None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:11.364149 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 579/1147] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:34:11.369246 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ee22f-80f4-4ac0-a95b-2047262a285d None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:11.369687 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ee22f-80f4-4ac0-a95b-2047262a285d None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:11.369798 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ee22f-80f4-4ac0-a95b-2047262a285d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:11.388732 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-449ee22f-80f4-4ac0-a95b-2047262a285d None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:34:11.389988 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-449ee22f-80f4-4ac0-a95b-2047262a285d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:34:11.455994 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 569/1148] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:34:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:34:11.477950 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baba81e-5945-48d8-96a6-9a380f4caf2e None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:11.498111 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:11.577907 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baba81e-5945-48d8-96a6-9a380f4caf2e None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:11.611406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08129e5-dafe-4487-b794-8c8270088718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:11.612018 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08129e5-dafe-4487-b794-8c8270088718 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:11.612351 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08129e5-dafe-4487-b794-8c8270088718 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:11.612581 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08129e5-dafe-4487-b794-8c8270088718 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:11.622429 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08129e5-dafe-4487-b794-8c8270088718 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:34:11.626978 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-b08129e5-dafe-4487-b794-8c8270088718 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:34:11.626978 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:34:11.626978 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:34:11.626978 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:34:11.626978 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:34:11.626978 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:34:11.626978 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:34:11.626978 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:34:11.626978 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:34:11.626978 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:34:11.626978 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:34:11.626978 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:34:11.626978 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:34:11.626978 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:34:11.626978 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:34:11.626978 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:34:11.628082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:34:11.628082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:34:11.628082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:34:11.628082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:34:11.628082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:34:11.628082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:34:11.628082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:34:11.628082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:34:11.628082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:34:11.628082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:34:11.628082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:34:11.628082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:34:11.628082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:34:11.628082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:34:11.628082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:34:11.628082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:34:11.629224 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:34:11.629224 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:34:11.629224 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:34:11.629224 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:34:11.629224 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:34:11.629224 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:34:11.629224 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:34:11.629224 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:34:11.629224 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:34:11.629224 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:34:11.629224 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:34:11.629224 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:34:11.629224 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 580/1149] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 8 17:34:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:34:11.633906 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ee22f-80f4-4ac0-a95b-2047262a285d None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:11.719624 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:11.732243 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ee22f-80f4-4ac0-a95b-2047262a285d None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:11.765366 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d90f23-2197-468d-8a60-031cf95672b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:11.765955 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d90f23-2197-468d-8a60-031cf95672b5 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:11.766232 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d90f23-2197-468d-8a60-031cf95672b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:11.766500 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d90f23-2197-468d-8a60-031cf95672b5 None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:11.767172 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d90f23-2197-468d-8a60-031cf95672b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:34:11.767472 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d90f23-2197-468d-8a60-031cf95672b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:11.768827 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d90f23-2197-468d-8a60-031cf95672b5 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:11.776562 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 570/1150] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:34:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:34:11.783493 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08129e5-dafe-4487-b794-8c8270088718 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:11.861618 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:11.882247 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08129e5-dafe-4487-b794-8c8270088718 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:11.914812 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ede4b-045a-4a8b-8f9f-c288c7e3acf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:11.915418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ede4b-045a-4a8b-8f9f-c288c7e3acf8 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:11.915696 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ede4b-045a-4a8b-8f9f-c288c7e3acf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:11.915967 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ede4b-045a-4a8b-8f9f-c288c7e3acf8 None admin] PATH_INFO: `/v3/users/01e326adbaca47fd948b6562dd71fb52` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:11.917086 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ede4b-045a-4a8b-8f9f-c288c7e3acf8 None admin] RBAC: Authorizing `identity:get_user(user_id=01e326adbaca47fd948b6562dd71fb52)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:11.919092 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ede4b-045a-4a8b-8f9f-c288c7e3acf8 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:11.920721 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 581/1151] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:34:11 2022] GET /identity/v3/users/01e326adbaca47fd948b6562dd71fb52 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:34:11.926547 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d90f23-2197-468d-8a60-031cf95672b5 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:12.022889 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d90f23-2197-468d-8a60-031cf95672b5 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:12.055310 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc644567-99f4-47bb-b246-a04faa323f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:12.055917 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc644567-99f4-47bb-b246-a04faa323f86 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:12.056196 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc644567-99f4-47bb-b246-a04faa323f86 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:12.056469 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc644567-99f4-47bb-b246-a04faa323f86 None admin] PATH_INFO: `/v3/projects/3c56e87928e946d283884b2017c5631b` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:12.057596 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc644567-99f4-47bb-b246-a04faa323f86 None admin] RBAC: Authorizing `identity:get_project(project_id=3c56e87928e946d283884b2017c5631b)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:12.059009 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc644567-99f4-47bb-b246-a04faa323f86 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:12.060688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 571/1152] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:34:11 2022] GET /identity/v3/projects/3c56e87928e946d283884b2017c5631b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:34:12.066642 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ede4b-045a-4a8b-8f9f-c288c7e3acf8 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:12.164396 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ede4b-045a-4a8b-8f9f-c288c7e3acf8 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:12.196317 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a3424-74cf-46a1-9252-fa97c140ee9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:12.196957 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a3424-74cf-46a1-9252-fa97c140ee9f None admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:12.197265 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a3424-74cf-46a1-9252-fa97c140ee9f None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:12.197539 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a3424-74cf-46a1-9252-fa97c140ee9f None admin] PATH_INFO: `/v3/projects/3c56e87928e946d283884b2017c5631b/users/01e326adbaca47fd948b6562dd71fb52/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:12.199412 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a3424-74cf-46a1-9252-fa97c140ee9f None admin] RBAC: Authorizing `identity:create_grant(project_id=3c56e87928e946d283884b2017c5631b, user_id=01e326adbaca47fd948b6562dd71fb52, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:12.201397 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a3424-74cf-46a1-9252-fa97c140ee9f None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:12.307464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 582/1153] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 8 17:34:12 2022] PUT /identity/v3/projects/3c56e87928e946d283884b2017c5631b/users/01e326adbaca47fd948b6562dd71fb52/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:34:14.328815 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6b91f-c295-4581-825c-558f97594329 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:14.329496 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6b91f-c295-4581-825c-558f97594329 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:14.329496 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6b91f-c295-4581-825c-558f97594329 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:14.330723 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 572/1154] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:34:14.335865 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107f655-87f7-4bc0-a963-0212ecb847f8 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:14.336244 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107f655-87f7-4bc0-a963-0212ecb847f8 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:14.336413 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107f655-87f7-4bc0-a963-0212ecb847f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:14.350103 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:14.355620 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-d107f655-87f7-4bc0-a963-0212ecb847f8 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:34:14.356905 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-d107f655-87f7-4bc0-a963-0212ecb847f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:34:14.425107 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 583/1155] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:34:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:34:14.448299 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6b91f-c295-4581-825c-558f97594329 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:14.468956 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:14.549530 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6b91f-c295-4581-825c-558f97594329 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:14.583400 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306923ce-8c33-4022-976e-e5042be1f0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:14.583986 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306923ce-8c33-4022-976e-e5042be1f0ce None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:14.584268 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306923ce-8c33-4022-976e-e5042be1f0ce None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:14.584542 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306923ce-8c33-4022-976e-e5042be1f0ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:14.594527 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306923ce-8c33-4022-976e-e5042be1f0ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:34:14.599110 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-306923ce-8c33-4022-976e-e5042be1f0ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:34:14.599110 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:34:14.599110 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:34:14.599110 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:34:14.599110 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:34:14.599110 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:34:14.599110 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:34:14.599110 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:34:14.599110 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:34:14.599110 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:34:14.599110 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:34:14.599110 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:34:14.599110 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:34:14.599110 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:34:14.599110 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:34:14.599110 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:34:14.600216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:34:14.600216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:34:14.600216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:34:14.600216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:34:14.600216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:34:14.600216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:34:14.600216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:34:14.600216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:34:14.600216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:34:14.600216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:34:14.600216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:34:14.600216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:34:14.600216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:34:14.600216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:34:14.600216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:34:14.600216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:34:14.601296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:34:14.601296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:34:14.601296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:34:14.601296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:34:14.601296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:34:14.601296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:34:14.601296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:34:14.601296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:34:14.601296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:34:14.601296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:34:14.601296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:34:14.601296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:34:14.601296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 573/1156] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 8 17:34:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:34:14.606769 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107f655-87f7-4bc0-a963-0212ecb847f8 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:14.703705 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107f655-87f7-4bc0-a963-0212ecb847f8 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:14.736597 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e6064-a8a6-499d-9cff-444b2862b8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:14.737220 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e6064-a8a6-499d-9cff-444b2862b8e2 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:14.737503 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e6064-a8a6-499d-9cff-444b2862b8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:14.737775 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e6064-a8a6-499d-9cff-444b2862b8e2 None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:14.738432 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e6064-a8a6-499d-9cff-444b2862b8e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:34:14.738733 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e6064-a8a6-499d-9cff-444b2862b8e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:14.740122 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e6064-a8a6-499d-9cff-444b2862b8e2 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:14.742258 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:14.749307 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 584/1157] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:34:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:34:14.755205 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306923ce-8c33-4022-976e-e5042be1f0ce None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:14.833852 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:14.854445 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306923ce-8c33-4022-976e-e5042be1f0ce None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:14.888666 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b3d68-52d3-4048-a68e-6cdfe7ed7b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:14.889293 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b3d68-52d3-4048-a68e-6cdfe7ed7b6c None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:14.889569 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b3d68-52d3-4048-a68e-6cdfe7ed7b6c None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:14.889835 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b3d68-52d3-4048-a68e-6cdfe7ed7b6c None admin] PATH_INFO: `/v3/users/01e326adbaca47fd948b6562dd71fb52` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:14.890926 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b3d68-52d3-4048-a68e-6cdfe7ed7b6c None admin] RBAC: Authorizing `identity:get_user(user_id=01e326adbaca47fd948b6562dd71fb52)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:14.892335 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b3d68-52d3-4048-a68e-6cdfe7ed7b6c None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:14.893891 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 574/1158] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:34:14 2022] GET /identity/v3/users/01e326adbaca47fd948b6562dd71fb52 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:34:14.899649 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e6064-a8a6-499d-9cff-444b2862b8e2 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:14.998692 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e6064-a8a6-499d-9cff-444b2862b8e2 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:15.033234 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f347f-9d04-4397-af7a-d2591258134a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:15.033825 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f347f-9d04-4397-af7a-d2591258134a None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:15.034103 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f347f-9d04-4397-af7a-d2591258134a None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:15.034378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f347f-9d04-4397-af7a-d2591258134a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:15.102573 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:15.102573 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f347f-9d04-4397-af7a-d2591258134a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:15.102573 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f347f-9d04-4397-af7a-d2591258134a None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:15.198165 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 585/1159] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:34:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 17:34:15.204219 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b3d68-52d3-4048-a68e-6cdfe7ed7b6c None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:15.300423 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b3d68-52d3-4048-a68e-6cdfe7ed7b6c None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:15.333048 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96725b8c-10f4-4516-b468-677df488208e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:15.333672 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96725b8c-10f4-4516-b468-677df488208e None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:15.333952 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96725b8c-10f4-4516-b468-677df488208e None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:15.334221 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96725b8c-10f4-4516-b468-677df488208e None admin] PATH_INFO: `/v3/projects/3c56e87928e946d283884b2017c5631b` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:15.335319 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96725b8c-10f4-4516-b468-677df488208e None admin] RBAC: Authorizing `identity:get_project(project_id=3c56e87928e946d283884b2017c5631b)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:15.336734 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96725b8c-10f4-4516-b468-677df488208e None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:15.338353 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 575/1160] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:34:15 2022] GET /identity/v3/projects/3c56e87928e946d283884b2017c5631b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:34:15.345062 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f347f-9d04-4397-af7a-d2591258134a None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:15.438880 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:15.442350 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f347f-9d04-4397-af7a-d2591258134a None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:15.475217 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788c080-4b8c-4a4f-a263-0fc63fc2eb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:15.475811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788c080-4b8c-4a4f-a263-0fc63fc2eb61 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:15.476090 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788c080-4b8c-4a4f-a263-0fc63fc2eb61 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:15.476361 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788c080-4b8c-4a4f-a263-0fc63fc2eb61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:15.477115 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788c080-4b8c-4a4f-a263-0fc63fc2eb61 None admin] RBAC: Adding query filter params (role.id=5c25aa917ab34baabb795c54dd8a4d02, scope.project.id=3c56e87928e946d283884b2017c5631b, user.id=01e326adbaca47fd948b6562dd71fb52) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:34:15.477426 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788c080-4b8c-4a4f-a263-0fc63fc2eb61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:15.478841 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788c080-4b8c-4a4f-a263-0fc63fc2eb61 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:15.484644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 586/1161] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:34:15 2022] GET /identity/v3/role_assignments?user.id=01e326adbaca47fd948b6562dd71fb52&scope.project.id=3c56e87928e946d283884b2017c5631b&role.id=5c25aa917ab34baabb795c54dd8a4d02 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:34:17.490644 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c630a91-7dfa-4800-b758-14261d5be8a2 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:17.491151 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c630a91-7dfa-4800-b758-14261d5be8a2 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:17.491244 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c630a91-7dfa-4800-b758-14261d5be8a2 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:17.492538 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 576/1162] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 17:34:17.497795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc099f64-3906-410d-a3e2-c3ce9f058c26 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:17.498199 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc099f64-3906-410d-a3e2-c3ce9f058c26 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:17.498343 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc099f64-3906-410d-a3e2-c3ce9f058c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:17.516697 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-dc099f64-3906-410d-a3e2-c3ce9f058c26 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:34:17.517923 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-dc099f64-3906-410d-a3e2-c3ce9f058c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:34:17.582908 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 587/1163] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:34:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:34:17.604435 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c630a91-7dfa-4800-b758-14261d5be8a2 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:17.620196 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:17.704403 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c630a91-7dfa-4800-b758-14261d5be8a2 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:17.737336 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee38d3e-5f76-43fc-8390-bf6b77efd52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:17.737927 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee38d3e-5f76-43fc-8390-bf6b77efd52d None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:17.738207 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee38d3e-5f76-43fc-8390-bf6b77efd52d None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:17.738480 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee38d3e-5f76-43fc-8390-bf6b77efd52d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:17.802657 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee38d3e-5f76-43fc-8390-bf6b77efd52d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:17.804088 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee38d3e-5f76-43fc-8390-bf6b77efd52d None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:17.818270 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:17.898835 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 577/1164] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:34:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 17:34:17.905563 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc099f64-3906-410d-a3e2-c3ce9f058c26 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:17.993104 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:18.001740 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc099f64-3906-410d-a3e2-c3ce9f058c26 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:18.035995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677adad-6146-4baa-ba3b-8043965ca087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:18.036600 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677adad-6146-4baa-ba3b-8043965ca087 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:18.036876 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677adad-6146-4baa-ba3b-8043965ca087 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:18.037173 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677adad-6146-4baa-ba3b-8043965ca087 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:18.043941 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677adad-6146-4baa-ba3b-8043965ca087 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:18.045387 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677adad-6146-4baa-ba3b-8043965ca087 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:18.056090 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-b677adad-6146-4baa-ba3b-8043965ca087 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 08 17:34:18.056090 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:34:18.056090 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 08 17:34:18.056090 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 08 17:34:18.056090 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:34:18.056090 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:34:18.056090 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:34:18.056090 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:34:18.056090 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 08 17:34:18.056090 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:34:18.056090 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 17:34:18.056090 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:34:18.056090 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:34:18.056090 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:34:18.056090 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:34:18.056090 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:34:18.056090 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:34:18.057307 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:34:18.057307 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:34:18.057307 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:34:18.057307 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:34:18.057307 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:34:18.057307 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:34:18.057307 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:34:18.057307 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:34:18.057307 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:34:18.057307 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:34:18.057307 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:34:18.057307 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:34:18.057307 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:34:18.057307 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:34:18.057307 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:34:18.057307 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:34:18.058378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:34:18.058378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:34:18.058378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:34:18.058378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:34:18.058378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:34:18.058378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:34:18.058378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:34:18.058378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:34:18.058378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:34:18.058378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:34:18.058378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 08 17:34:18.058378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:34:18.058378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 08 17:34:18.058378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:34:18.058378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 588/1165] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Aug 8 17:34:17 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:34:18.063053 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee38d3e-5f76-43fc-8390-bf6b77efd52d None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:18.160555 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee38d3e-5f76-43fc-8390-bf6b77efd52d None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:18.173638 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:18.192698 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cce659-a43f-4a45-ada4-0f242b67a99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:18.193323 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cce659-a43f-4a45-ada4-0f242b67a99a None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:18.193606 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cce659-a43f-4a45-ada4-0f242b67a99a None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:18.193881 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cce659-a43f-4a45-ada4-0f242b67a99a None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:18.194514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cce659-a43f-4a45-ada4-0f242b67a99a None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:34:18.194819 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cce659-a43f-4a45-ada4-0f242b67a99a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:18.196193 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cce659-a43f-4a45-ada4-0f242b67a99a None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:18.204571 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 578/1166] 10.222.0.70 () {56 vars in 1115 bytes} [Mon Aug 8 17:34:18 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:34:20.188262 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5c6c0-18de-4313-8628-a2b7f3405549 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:20.188799 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5c6c0-18de-4313-8628-a2b7f3405549 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:20.188799 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5c6c0-18de-4313-8628-a2b7f3405549 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:20.190213 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 589/1167] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:34:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:34:20.195250 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad8a7c-ec53-4590-a8e5-62145aa53f8d None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:20.195661 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad8a7c-ec53-4590-a8e5-62145aa53f8d None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:20.195771 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad8a7c-ec53-4590-a8e5-62145aa53f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:20.214021 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-39ad8a7c-ec53-4590-a8e5-62145aa53f8d None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:34:20.215207 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-39ad8a7c-ec53-4590-a8e5-62145aa53f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:34:20.280164 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 579/1168] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:34:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:34:20.303083 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5c6c0-18de-4313-8628-a2b7f3405549 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:20.401852 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5c6c0-18de-4313-8628-a2b7f3405549 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:20.436604 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d34bf-5c0d-473e-801e-370f9e6b6431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:20.437233 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d34bf-5c0d-473e-801e-370f9e6b6431 None admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:20.437514 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d34bf-5c0d-473e-801e-370f9e6b6431 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:20.437782 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d34bf-5c0d-473e-801e-370f9e6b6431 None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:20.438474 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d34bf-5c0d-473e-801e-370f9e6b6431 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:20.439773 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d34bf-5c0d-473e-801e-370f9e6b6431 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:20.579358 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 590/1169] 10.222.0.70 () {60 vars in 1138 bytes} [Mon Aug 8 17:34:20 2022] POST /identity/v3/domains => generated 267 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:34:22.582740 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498cb05-0cdb-4a99-8ac9-6dec9815cea5 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:22.583307 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498cb05-0cdb-4a99-8ac9-6dec9815cea5 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:22.583307 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498cb05-0cdb-4a99-8ac9-6dec9815cea5 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:22.584607 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 580/1170] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:34:22.590403 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95475e4-813b-45a1-973a-1bd5764bcf22 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:22.590837 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95475e4-813b-45a1-973a-1bd5764bcf22 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:22.590943 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95475e4-813b-45a1-973a-1bd5764bcf22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:22.608764 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-b95475e4-813b-45a1-973a-1bd5764bcf22 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:34:22.610054 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-b95475e4-813b-45a1-973a-1bd5764bcf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:34:22.617091 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:22.674684 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 591/1171] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:34:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:34:22.697612 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498cb05-0cdb-4a99-8ac9-6dec9815cea5 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:22.796674 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498cb05-0cdb-4a99-8ac9-6dec9815cea5 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:22.805560 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:22.830498 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4bff0-05e6-40c6-9b8b-b1d572194e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:22.831125 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4bff0-05e6-40c6-9b8b-b1d572194e78 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:22.831405 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4bff0-05e6-40c6-9b8b-b1d572194e78 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:22.831677 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4bff0-05e6-40c6-9b8b-b1d572194e78 None admin] PATH_INFO: `/v3/domains/383dda1d3cd146c380ef13194e2ba363` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:22.842364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4bff0-05e6-40c6-9b8b-b1d572194e78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=383dda1d3cd146c380ef13194e2ba363)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:22.843800 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4bff0-05e6-40c6-9b8b-b1d572194e78 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:22.845414 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 581/1172] 10.222.0.70 () {56 vars in 1183 bytes} [Mon Aug 8 17:34:22 2022] GET /identity/v3/domains/383dda1d3cd146c380ef13194e2ba363 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:34:22.851229 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95475e4-813b-45a1-973a-1bd5764bcf22 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:22.947571 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95475e4-813b-45a1-973a-1bd5764bcf22 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:22.992907 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd0f6c-7414-4dbc-a95b-960ced585d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:22.993661 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd0f6c-7414-4dbc-a95b-960ced585d2d None admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:22.993952 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd0f6c-7414-4dbc-a95b-960ced585d2d None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:22.994231 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd0f6c-7414-4dbc-a95b-960ced585d2d None admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:22.994893 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd0f6c-7414-4dbc-a95b-960ced585d2d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:22.996379 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd0f6c-7414-4dbc-a95b-960ced585d2d None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:23.013106 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:23.074944 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 592/1173] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Aug 8 17:34:22 2022] POST /identity/v3/projects => generated 361 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:34:25.165231 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d145ed-12d5-4225-b937-a42906f226b1 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:25.165768 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d145ed-12d5-4225-b937-a42906f226b1 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:25.165768 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d145ed-12d5-4225-b937-a42906f226b1 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:25.167110 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 582/1174] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:34:25.172507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f9b67-b973-4d2a-8d12-56930b8f4f0b None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:25.172942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f9b67-b973-4d2a-8d12-56930b8f4f0b None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:25.173090 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f9b67-b973-4d2a-8d12-56930b8f4f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:25.191606 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-9b6f9b67-b973-4d2a-8d12-56930b8f4f0b None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:34:25.192780 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-9b6f9b67-b973-4d2a-8d12-56930b8f4f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:34:25.257718 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 593/1175] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:34:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:34:25.282647 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d145ed-12d5-4225-b937-a42906f226b1 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:25.381599 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d145ed-12d5-4225-b937-a42906f226b1 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:25.415029 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c69f89-517b-4c68-a3b8-010d962d097f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:25.415701 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c69f89-517b-4c68-a3b8-010d962d097f None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:25.415927 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c69f89-517b-4c68-a3b8-010d962d097f None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:25.416195 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c69f89-517b-4c68-a3b8-010d962d097f None admin] PATH_INFO: `/v3/domains/383dda1d3cd146c380ef13194e2ba363` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:25.418358 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c69f89-517b-4c68-a3b8-010d962d097f None admin] RBAC: Authorizing `identity:get_domain(domain_id=383dda1d3cd146c380ef13194e2ba363)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:25.419801 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c69f89-517b-4c68-a3b8-010d962d097f None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:25.421394 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 583/1176] 10.222.0.70 () {56 vars in 1183 bytes} [Mon Aug 8 17:34:25 2022] GET /identity/v3/domains/383dda1d3cd146c380ef13194e2ba363 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:34:25.427130 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f9b67-b973-4d2a-8d12-56930b8f4f0b None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:25.523152 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f9b67-b973-4d2a-8d12-56930b8f4f0b None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:25.546550 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:25.556680 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2446b-01fc-41a9-9672-e515a48506bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:25.557312 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2446b-01fc-41a9-9672-e515a48506bc None admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:25.557597 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2446b-01fc-41a9-9672-e515a48506bc None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:25.557933 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2446b-01fc-41a9-9672-e515a48506bc None admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:25.558538 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2446b-01fc-41a9-9672-e515a48506bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:25.559956 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2446b-01fc-41a9-9672-e515a48506bc None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:25.655526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 594/1177] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Aug 8 17:34:25 2022] POST /identity/v3/users => generated 311 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:34:27.763528 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb6dfe-0e90-41d1-95ed-78ae296669b0 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:27.764056 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb6dfe-0e90-41d1-95ed-78ae296669b0 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:27.764056 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb6dfe-0e90-41d1-95ed-78ae296669b0 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:27.765476 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 584/1178] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:34:27.770643 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e73b1-3c7b-45d9-8458-e8d4a7446d5d None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:27.771058 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e73b1-3c7b-45d9-8458-e8d4a7446d5d None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:27.771202 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e73b1-3c7b-45d9-8458-e8d4a7446d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:27.789492 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-203e73b1-3c7b-45d9-8458-e8d4a7446d5d None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:34:27.790683 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-203e73b1-3c7b-45d9-8458-e8d4a7446d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:34:27.856542 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 595/1179] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:34:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:34:27.879328 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb6dfe-0e90-41d1-95ed-78ae296669b0 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:27.915678 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:27.980237 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb6dfe-0e90-41d1-95ed-78ae296669b0 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:28.012923 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7285ae0-2c6e-4f6b-a8f3-d66e2f7df8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:28.013611 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7285ae0-2c6e-4f6b-a8f3-d66e2f7df8e6 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:28.013843 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7285ae0-2c6e-4f6b-a8f3-d66e2f7df8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:28.014118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7285ae0-2c6e-4f6b-a8f3-d66e2f7df8e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:28.023832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7285ae0-2c6e-4f6b-a8f3-d66e2f7df8e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:34:28.029375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-f7285ae0-2c6e-4f6b-a8f3-d66e2f7df8e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:34:28.029375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:34:28.029375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:34:28.029375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:34:28.029375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:34:28.029375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:34:28.029375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:34:28.029375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:34:28.029375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:34:28.029375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:34:28.029375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:34:28.029375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:34:28.029375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:34:28.029375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:34:28.029375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:34:28.029375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:34:28.030577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:34:28.030577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:34:28.030577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:34:28.030577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:34:28.030577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:34:28.030577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:34:28.030577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:34:28.030577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:34:28.030577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:34:28.030577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:34:28.030577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:34:28.030577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:34:28.030577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:34:28.030577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:34:28.030577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:34:28.030577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:34:28.031541 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:34:28.031541 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:34:28.031541 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:34:28.031541 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:34:28.031541 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:34:28.031541 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:34:28.031541 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:34:28.031541 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:34:28.031541 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:34:28.031541 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:34:28.031541 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:34:28.031541 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:34:28.031541 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 585/1180] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 8 17:34:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:34:28.036381 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e73b1-3c7b-45d9-8458-e8d4a7446d5d None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:28.133730 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e73b1-3c7b-45d9-8458-e8d4a7446d5d None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:28.144638 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:28.167268 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c7b43-dbf0-4e0f-842c-e019d845bfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:28.167899 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c7b43-dbf0-4e0f-842c-e019d845bfa0 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:28.168176 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c7b43-dbf0-4e0f-842c-e019d845bfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:28.168450 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c7b43-dbf0-4e0f-842c-e019d845bfa0 None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:28.169139 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c7b43-dbf0-4e0f-842c-e019d845bfa0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:34:28.169445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c7b43-dbf0-4e0f-842c-e019d845bfa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:28.170814 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c7b43-dbf0-4e0f-842c-e019d845bfa0 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:28.179104 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 596/1181] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:34:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:34:28.185564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7285ae0-2c6e-4f6b-a8f3-d66e2f7df8e6 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:28.278154 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:28.283713 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7285ae0-2c6e-4f6b-a8f3-d66e2f7df8e6 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:28.317981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3d48b-1337-4d99-9d40-dbb90659959f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:28.318598 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3d48b-1337-4d99-9d40-dbb90659959f None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:28.318878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3d48b-1337-4d99-9d40-dbb90659959f None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:28.319154 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3d48b-1337-4d99-9d40-dbb90659959f None admin] PATH_INFO: `/v3/users/48ccdbd86ec249c686de54973cd7d273` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:28.333238 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3d48b-1337-4d99-9d40-dbb90659959f None admin] RBAC: Authorizing `identity:get_user(user_id=48ccdbd86ec249c686de54973cd7d273)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:28.334669 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3d48b-1337-4d99-9d40-dbb90659959f None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:28.336245 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 586/1182] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:34:28 2022] GET /identity/v3/users/48ccdbd86ec249c686de54973cd7d273 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:34:28.342147 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c7b43-dbf0-4e0f-842c-e019d845bfa0 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:28.440877 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c7b43-dbf0-4e0f-842c-e019d845bfa0 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:28.473771 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835400c2-0db8-430e-9375-250e1f2029f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:28.474362 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835400c2-0db8-430e-9375-250e1f2029f9 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:28.474638 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835400c2-0db8-430e-9375-250e1f2029f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:28.474905 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835400c2-0db8-430e-9375-250e1f2029f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:28.517232 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:28.543287 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835400c2-0db8-430e-9375-250e1f2029f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:28.544664 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835400c2-0db8-430e-9375-250e1f2029f9 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:28.642872 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 597/1183] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:34:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 17:34:28.648914 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3d48b-1337-4d99-9d40-dbb90659959f None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:28.748223 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3d48b-1337-4d99-9d40-dbb90659959f None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:28.783394 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe462b-9eea-4300-945f-38dd1765a2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:28.784098 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe462b-9eea-4300-945f-38dd1765a2b9 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:28.784318 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe462b-9eea-4300-945f-38dd1765a2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:28.784588 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe462b-9eea-4300-945f-38dd1765a2b9 None admin] PATH_INFO: `/v3/projects/1ab7667252894f25b2c3b2cb194a03f5` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:28.785728 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe462b-9eea-4300-945f-38dd1765a2b9 None admin] RBAC: Authorizing `identity:get_project(project_id=1ab7667252894f25b2c3b2cb194a03f5)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:28.787147 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe462b-9eea-4300-945f-38dd1765a2b9 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:28.788801 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 587/1184] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:34:28 2022] GET /identity/v3/projects/1ab7667252894f25b2c3b2cb194a03f5 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:34:28.796648 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835400c2-0db8-430e-9375-250e1f2029f9 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:28.868023 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:28.896253 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835400c2-0db8-430e-9375-250e1f2029f9 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:28.931607 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc873b-19bd-4073-b745-45511681ec81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:28.932197 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc873b-19bd-4073-b745-45511681ec81 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:28.932478 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc873b-19bd-4073-b745-45511681ec81 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:28.932883 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc873b-19bd-4073-b745-45511681ec81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:28.933661 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc873b-19bd-4073-b745-45511681ec81 None admin] RBAC: Adding query filter params (role.id=5c25aa917ab34baabb795c54dd8a4d02, scope.project.id=1ab7667252894f25b2c3b2cb194a03f5, user.id=48ccdbd86ec249c686de54973cd7d273) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:34:28.933972 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc873b-19bd-4073-b745-45511681ec81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:28.935390 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc873b-19bd-4073-b745-45511681ec81 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:28.940648 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 598/1185] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:34:28 2022] GET /identity/v3/role_assignments?user.id=48ccdbd86ec249c686de54973cd7d273&scope.project.id=1ab7667252894f25b2c3b2cb194a03f5&role.id=5c25aa917ab34baabb795c54dd8a4d02 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:34:30.949569 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b55c4e-7d95-40bb-8c77-0b5d522c2e4f None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:30.950138 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b55c4e-7d95-40bb-8c77-0b5d522c2e4f None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:30.950138 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b55c4e-7d95-40bb-8c77-0b5d522c2e4f None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:30.951459 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 588/1186] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:34:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:34:30.956742 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82050a11-ab67-4da2-802f-cec81fbd02af None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:30.957152 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82050a11-ab67-4da2-802f-cec81fbd02af None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:30.957324 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82050a11-ab67-4da2-802f-cec81fbd02af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:30.975699 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-82050a11-ab67-4da2-802f-cec81fbd02af None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:34:30.976895 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-82050a11-ab67-4da2-802f-cec81fbd02af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:34:31.043539 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 599/1187] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:34:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:34:31.066725 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b55c4e-7d95-40bb-8c77-0b5d522c2e4f None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:31.091647 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:31.168018 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b55c4e-7d95-40bb-8c77-0b5d522c2e4f None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:31.201643 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98712e5d-1e7c-4662-bf73-694c2fb141c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:31.202197 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98712e5d-1e7c-4662-bf73-694c2fb141c5 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:31.202474 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98712e5d-1e7c-4662-bf73-694c2fb141c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:31.202747 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98712e5d-1e7c-4662-bf73-694c2fb141c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:31.212384 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98712e5d-1e7c-4662-bf73-694c2fb141c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:34:31.217181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-98712e5d-1e7c-4662-bf73-694c2fb141c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:34:31.217181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:34:31.217181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:34:31.217181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:34:31.217181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:34:31.217181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:34:31.217181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:34:31.217181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:34:31.217181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:34:31.217181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:34:31.217181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:34:31.217181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:34:31.217181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:34:31.217181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:34:31.217181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:34:31.217181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:34:31.218283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:34:31.218283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:34:31.218283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:34:31.218283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:34:31.218283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:34:31.218283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:34:31.218283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:34:31.218283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:34:31.218283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:34:31.218283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:34:31.218283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:34:31.218283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:34:31.218283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:34:31.218283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:34:31.218283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:34:31.218283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:34:31.219328 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:34:31.219328 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:34:31.219328 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:34:31.219328 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:34:31.219328 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:34:31.219328 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:34:31.219328 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:34:31.219328 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:34:31.219328 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:34:31.219328 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:34:31.219328 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:34:31.219328 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:34:31.219328 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 589/1188] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 8 17:34:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:34:31.224239 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82050a11-ab67-4da2-802f-cec81fbd02af None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:31.287469 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:31.321474 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82050a11-ab67-4da2-802f-cec81fbd02af None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:31.354997 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d69435-0f09-48a0-bea8-00f94c2872e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:31.355602 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d69435-0f09-48a0-bea8-00f94c2872e4 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:31.355878 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d69435-0f09-48a0-bea8-00f94c2872e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:31.356150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d69435-0f09-48a0-bea8-00f94c2872e4 None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:31.356803 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d69435-0f09-48a0-bea8-00f94c2872e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:34:31.357134 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d69435-0f09-48a0-bea8-00f94c2872e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:31.358493 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d69435-0f09-48a0-bea8-00f94c2872e4 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:31.366223 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 600/1189] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:34:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:34:31.372377 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98712e5d-1e7c-4662-bf73-694c2fb141c5 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:31.452489 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:31.470117 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98712e5d-1e7c-4662-bf73-694c2fb141c5 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:31.503031 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a734b6-e8c1-4946-820d-97713e0b4c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:31.503640 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a734b6-e8c1-4946-820d-97713e0b4c20 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:31.503917 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a734b6-e8c1-4946-820d-97713e0b4c20 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:31.504187 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a734b6-e8c1-4946-820d-97713e0b4c20 None admin] PATH_INFO: `/v3/users/48ccdbd86ec249c686de54973cd7d273` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:31.505321 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a734b6-e8c1-4946-820d-97713e0b4c20 None admin] RBAC: Authorizing `identity:get_user(user_id=48ccdbd86ec249c686de54973cd7d273)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:31.506757 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a734b6-e8c1-4946-820d-97713e0b4c20 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:31.508349 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 590/1190] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:34:31 2022] GET /identity/v3/users/48ccdbd86ec249c686de54973cd7d273 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:34:31.514816 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d69435-0f09-48a0-bea8-00f94c2872e4 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:31.612146 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d69435-0f09-48a0-bea8-00f94c2872e4 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:31.637510 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:31.645019 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3bc4a-b11a-4bbc-93fa-0aefb0616a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:31.649812 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3bc4a-b11a-4bbc-93fa-0aefb0616a89 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:31.649812 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3bc4a-b11a-4bbc-93fa-0aefb0616a89 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:31.649812 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3bc4a-b11a-4bbc-93fa-0aefb0616a89 None admin] PATH_INFO: `/v3/projects/1ab7667252894f25b2c3b2cb194a03f5` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:31.649812 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3bc4a-b11a-4bbc-93fa-0aefb0616a89 None admin] RBAC: Authorizing `identity:get_project(project_id=1ab7667252894f25b2c3b2cb194a03f5)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:31.649812 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3bc4a-b11a-4bbc-93fa-0aefb0616a89 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:31.650470 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 601/1191] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:34:31 2022] GET /identity/v3/projects/1ab7667252894f25b2c3b2cb194a03f5 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:34:31.657055 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a734b6-e8c1-4946-820d-97713e0b4c20 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:31.752037 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a734b6-e8c1-4946-820d-97713e0b4c20 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:31.785358 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0c3d3-65a3-492f-a067-27eaada0c24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:31.785987 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0c3d3-65a3-492f-a067-27eaada0c24a None admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:31.786267 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0c3d3-65a3-492f-a067-27eaada0c24a None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:31.786540 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0c3d3-65a3-492f-a067-27eaada0c24a None admin] PATH_INFO: `/v3/projects/1ab7667252894f25b2c3b2cb194a03f5/users/48ccdbd86ec249c686de54973cd7d273/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:31.788401 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d0c3d3-65a3-492f-a067-27eaada0c24a None admin] RBAC: Authorizing `identity:create_grant(project_id=1ab7667252894f25b2c3b2cb194a03f5, user_id=48ccdbd86ec249c686de54973cd7d273, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:31.789840 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d0c3d3-65a3-492f-a067-27eaada0c24a None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:31.854676 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 591/1192] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 8 17:34:31 2022] PUT /identity/v3/projects/1ab7667252894f25b2c3b2cb194a03f5/users/48ccdbd86ec249c686de54973cd7d273/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:34:33.843142 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09416c4-4cea-4abd-9c7e-2866ba1c8855 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:33.843694 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09416c4-4cea-4abd-9c7e-2866ba1c8855 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:33.843694 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09416c4-4cea-4abd-9c7e-2866ba1c8855 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:33.845024 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 602/1193] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:34:33.850104 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7d11f-e628-4f2f-a1f7-a1131e6eb09d None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:33.850528 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7d11f-e628-4f2f-a1f7-a1131e6eb09d None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:33.850678 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7d11f-e628-4f2f-a1f7-a1131e6eb09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:33.868912 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-cab7d11f-e628-4f2f-a1f7-a1131e6eb09d None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:34:33.870916 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-cab7d11f-e628-4f2f-a1f7-a1131e6eb09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:34:33.873629 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:33.935335 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 592/1194] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:34:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:34:33.958267 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09416c4-4cea-4abd-9c7e-2866ba1c8855 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:34.058216 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09416c4-4cea-4abd-9c7e-2866ba1c8855 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:34.091078 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b38a65-a7f5-4d7b-9245-adb1b35755c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:34.091692 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b38a65-a7f5-4d7b-9245-adb1b35755c1 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:34.096276 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b38a65-a7f5-4d7b-9245-adb1b35755c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:34.096276 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b38a65-a7f5-4d7b-9245-adb1b35755c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:34.102780 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b38a65-a7f5-4d7b-9245-adb1b35755c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:34:34.108297 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-a9b38a65-a7f5-4d7b-9245-adb1b35755c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:34:34.108297 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:34:34.108297 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:34:34.108297 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:34:34.108297 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:34:34.108297 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:34:34.108297 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:34:34.108297 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:34:34.108297 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:34:34.108297 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:34:34.108297 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:34:34.108297 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:34:34.108297 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:34:34.108297 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:34:34.108297 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:34:34.108297 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:34:34.109451 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:34:34.109451 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:34:34.109451 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:34:34.109451 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:34:34.109451 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:34:34.109451 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:34:34.109451 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:34:34.109451 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:34:34.109451 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:34:34.109451 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:34:34.109451 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:34:34.109451 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:34:34.109451 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:34:34.109451 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:34:34.109451 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:34:34.109451 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:34:34.110672 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:34:34.110672 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:34:34.110672 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:34:34.110672 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:34:34.110672 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:34:34.110672 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:34:34.110672 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:34:34.110672 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:34:34.110672 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:34:34.110672 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:34:34.110672 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:34:34.110672 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:34:34.110672 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 603/1195] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 8 17:34:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:34:34.115408 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7d11f-e628-4f2f-a1f7-a1131e6eb09d None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:34.211815 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7d11f-e628-4f2f-a1f7-a1131e6eb09d None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:34.245334 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19d898-bbf2-46d8-8e04-bb3dcef8cbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:34.245919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19d898-bbf2-46d8-8e04-bb3dcef8cbc1 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:34.246197 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19d898-bbf2-46d8-8e04-bb3dcef8cbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:34.246467 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19d898-bbf2-46d8-8e04-bb3dcef8cbc1 None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:34.247121 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19d898-bbf2-46d8-8e04-bb3dcef8cbc1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:34:34.247421 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19d898-bbf2-46d8-8e04-bb3dcef8cbc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:34.248772 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19d898-bbf2-46d8-8e04-bb3dcef8cbc1 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:34.256417 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 593/1196] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:34:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:34:34.262067 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b38a65-a7f5-4d7b-9245-adb1b35755c1 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:34.317900 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:34.362251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b38a65-a7f5-4d7b-9245-adb1b35755c1 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:34.394784 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c3308-ccce-4ce3-81df-0d63066a478c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:34.395397 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c3308-ccce-4ce3-81df-0d63066a478c None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:34.395674 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c3308-ccce-4ce3-81df-0d63066a478c None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:34.395940 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c3308-ccce-4ce3-81df-0d63066a478c None admin] PATH_INFO: `/v3/users/48ccdbd86ec249c686de54973cd7d273` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:34.397053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c3308-ccce-4ce3-81df-0d63066a478c None admin] RBAC: Authorizing `identity:get_user(user_id=48ccdbd86ec249c686de54973cd7d273)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:34.398475 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c3308-ccce-4ce3-81df-0d63066a478c None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:34.400010 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 604/1197] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 8 17:34:34 2022] GET /identity/v3/users/48ccdbd86ec249c686de54973cd7d273 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:34:34.406221 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19d898-bbf2-46d8-8e04-bb3dcef8cbc1 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:34.409059 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:34.506016 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19d898-bbf2-46d8-8e04-bb3dcef8cbc1 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:34.538189 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f2e5f9-469f-4b24-8ed9-2ce796fbfe87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:34.538779 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2e5f9-469f-4b24-8ed9-2ce796fbfe87 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:34.539054 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2e5f9-469f-4b24-8ed9-2ce796fbfe87 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:34.539325 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2e5f9-469f-4b24-8ed9-2ce796fbfe87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:34.603355 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f2e5f9-469f-4b24-8ed9-2ce796fbfe87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:34.605588 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f2e5f9-469f-4b24-8ed9-2ce796fbfe87 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:34.607334 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:34.699756 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 594/1198] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:34:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 17:34:34.705745 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c3308-ccce-4ce3-81df-0d63066a478c None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:34.802753 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c3308-ccce-4ce3-81df-0d63066a478c None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:34.825780 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:34.835848 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6135b-8f63-46bd-ba4b-190923ad88c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:34.836471 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6135b-8f63-46bd-ba4b-190923ad88c5 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:34.836753 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6135b-8f63-46bd-ba4b-190923ad88c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:34.837155 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6135b-8f63-46bd-ba4b-190923ad88c5 None admin] PATH_INFO: `/v3/projects/1ab7667252894f25b2c3b2cb194a03f5` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:34.840323 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6135b-8f63-46bd-ba4b-190923ad88c5 None admin] RBAC: Authorizing `identity:get_project(project_id=1ab7667252894f25b2c3b2cb194a03f5)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:34.840323 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6135b-8f63-46bd-ba4b-190923ad88c5 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:34.841342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 605/1199] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 8 17:34:34 2022] GET /identity/v3/projects/1ab7667252894f25b2c3b2cb194a03f5 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:34:34.847448 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f2e5f9-469f-4b24-8ed9-2ce796fbfe87 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:34:34.947408 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f2e5f9-469f-4b24-8ed9-2ce796fbfe87 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:34:34.950005 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:34.982081 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd514ac-0f32-4811-8f7c-22c09201f866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:34:34.982667 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd514ac-0f32-4811-8f7c-22c09201f866 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:34:34.982941 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd514ac-0f32-4811-8f7c-22c09201f866 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:34:34.983207 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd514ac-0f32-4811-8f7c-22c09201f866 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:34:34.983915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd514ac-0f32-4811-8f7c-22c09201f866 None admin] RBAC: Adding query filter params (role.id=5c25aa917ab34baabb795c54dd8a4d02, scope.project.id=1ab7667252894f25b2c3b2cb194a03f5, user.id=48ccdbd86ec249c686de54973cd7d273) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:34:34.984219 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd514ac-0f32-4811-8f7c-22c09201f866 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:34:34.985663 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd514ac-0f32-4811-8f7c-22c09201f866 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:34:34.991152 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 595/1200] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:34:34 2022] GET /identity/v3/role_assignments?user.id=48ccdbd86ec249c686de54973cd7d273&scope.project.id=1ab7667252894f25b2c3b2cb194a03f5&role.id=5c25aa917ab34baabb795c54dd8a4d02 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:34:44.859996 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=4 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:34:44.988620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=17 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:35:46.944240 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142d2ce-370c-448d-8adf-fa6297d5d1df None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:46.944906 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142d2ce-370c-448d-8adf-fa6297d5d1df None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:46.944906 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142d2ce-370c-448d-8adf-fa6297d5d1df None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:46.946128 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 606/1201] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:35:46.951425 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0688b4-02a9-46d8-8816-d8ffa9a85052 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:46.951835 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0688b4-02a9-46d8-8816-d8ffa9a85052 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:46.951967 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0688b4-02a9-46d8-8816-d8ffa9a85052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:46.969930 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-df0688b4-02a9-46d8-8816-d8ffa9a85052 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:35:46.971111 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-df0688b4-02a9-46d8-8816-d8ffa9a85052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:35:47.037389 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 596/1202] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:35:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:35:47.062927 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142d2ce-370c-448d-8adf-fa6297d5d1df None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:47.166195 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142d2ce-370c-448d-8adf-fa6297d5d1df None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:35:47.199176 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e9753-771f-474e-98ec-68a2030dfc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:35:47.199735 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e9753-771f-474e-98ec-68a2030dfc31 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:47.200019 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e9753-771f-474e-98ec-68a2030dfc31 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:47.200295 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e9753-771f-474e-98ec-68a2030dfc31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:47.211073 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2e9753-771f-474e-98ec-68a2030dfc31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:35:47.212507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2e9753-771f-474e-98ec-68a2030dfc31 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:35:47.227022 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-fb2e9753-771f-474e-98ec-68a2030dfc31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:35:47.227022 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:35:47.227022 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:35:47.227022 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:35:47.227022 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:35:47.227022 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:35:47.227022 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:35:47.227022 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:35:47.227022 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:35:47.227022 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:35:47.227022 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:35:47.227022 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:35:47.227022 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:35:47.227022 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:35:47.227022 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:35:47.227022 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:35:47.228283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:35:47.228283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:35:47.228283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:35:47.228283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:35:47.228283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:35:47.228283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:35:47.228283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:35:47.228283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:35:47.228283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:35:47.228283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:35:47.228283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:35:47.228283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:35:47.228283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:35:47.228283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:35:47.228283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:35:47.228283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:35:47.228283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:35:47.229642 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:35:47.229642 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:35:47.229642 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:35:47.229642 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 607/1203] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:35:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:35:47.234168 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0688b4-02a9-46d8-8816-d8ffa9a85052 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:47.330476 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0688b4-02a9-46d8-8816-d8ffa9a85052 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:35:47.360926 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:35:47.367372 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b5389-6cbd-42f0-b9da-bf89419fa7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:35:47.367973 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b5389-6cbd-42f0-b9da-bf89419fa7a6 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:47.368251 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b5389-6cbd-42f0-b9da-bf89419fa7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:47.368521 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b5389-6cbd-42f0-b9da-bf89419fa7a6 None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:47.369234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b5389-6cbd-42f0-b9da-bf89419fa7a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:35:47.369536 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b5389-6cbd-42f0-b9da-bf89419fa7a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:35:47.371020 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b5389-6cbd-42f0-b9da-bf89419fa7a6 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:35:47.382304 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 597/1204] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:35:47.388069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e9753-771f-474e-98ec-68a2030dfc31 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:47.442501 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:35:47.488843 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e9753-771f-474e-98ec-68a2030dfc31 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:35:47.522119 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b260a-b8d9-48e1-88f2-ca163ffa54ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:35:47.523442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b260a-b8d9-48e1-88f2-ca163ffa54ba None admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:47.523580 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b260a-b8d9-48e1-88f2-ca163ffa54ba None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:47.523825 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b260a-b8d9-48e1-88f2-ca163ffa54ba None admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:47.524455 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b260a-b8d9-48e1-88f2-ca163ffa54ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:35:47.525901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b260a-b8d9-48e1-88f2-ca163ffa54ba None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:35:47.636480 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 608/1205] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Aug 8 17:35:47 2022] POST /identity/v3/users => generated 251 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:35:49.756133 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050060c-3688-4c12-a049-c61c38afed6e None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:49.757214 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050060c-3688-4c12-a049-c61c38afed6e None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:49.757214 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050060c-3688-4c12-a049-c61c38afed6e None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:49.758579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 598/1206] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:35:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:35:49.763901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197547e8-8e2f-47b3-bef2-8b7353db7ac4 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:49.764379 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197547e8-8e2f-47b3-bef2-8b7353db7ac4 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:49.764486 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197547e8-8e2f-47b3-bef2-8b7353db7ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:49.783075 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-197547e8-8e2f-47b3-bef2-8b7353db7ac4 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:35:49.784262 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-197547e8-8e2f-47b3-bef2-8b7353db7ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:35:49.854238 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 609/1207] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:35:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:35:49.877561 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050060c-3688-4c12-a049-c61c38afed6e None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:49.979529 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050060c-3688-4c12-a049-c61c38afed6e None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:35:50.013166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888a78d-bc6e-4cfb-87d1-2b4f38ec445d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:35:50.013724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888a78d-bc6e-4cfb-87d1-2b4f38ec445d None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:50.014003 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888a78d-bc6e-4cfb-87d1-2b4f38ec445d None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:50.014276 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888a78d-bc6e-4cfb-87d1-2b4f38ec445d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:50.024246 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888a78d-bc6e-4cfb-87d1-2b4f38ec445d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:35:50.028878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-9888a78d-bc6e-4cfb-87d1-2b4f38ec445d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:35:50.028878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:35:50.028878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:35:50.028878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:35:50.028878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:35:50.028878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:35:50.028878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:35:50.028878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:35:50.028878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:35:50.028878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:35:50.028878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:35:50.028878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:35:50.028878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:35:50.028878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:35:50.028878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:35:50.028878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:35:50.031695 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:35:50.031695 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:35:50.031695 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:35:50.031695 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:35:50.031695 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:35:50.031695 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:35:50.031695 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:35:50.031695 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:35:50.031695 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:35:50.031695 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:35:50.031695 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:35:50.031695 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:35:50.031695 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:35:50.031695 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:35:50.031695 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:35:50.031695 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:35:50.032772 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:35:50.032772 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:35:50.032772 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:35:50.032772 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:35:50.032772 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:35:50.032772 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:35:50.032772 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:35:50.032772 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:35:50.032772 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:35:50.032772 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:35:50.032772 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:35:50.032772 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:35:50.032772 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 599/1208] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 8 17:35:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:35:50.036194 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197547e8-8e2f-47b3-bef2-8b7353db7ac4 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:50.077014 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:35:50.137037 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197547e8-8e2f-47b3-bef2-8b7353db7ac4 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:35:50.170150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b2350-ea12-4545-8d16-479116d39dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:35:50.170766 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b2350-ea12-4545-8d16-479116d39dde None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:50.171038 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b2350-ea12-4545-8d16-479116d39dde None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:50.171312 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b2350-ea12-4545-8d16-479116d39dde None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:50.171971 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b2350-ea12-4545-8d16-479116d39dde None admin] RBAC: Adding query filter params (name=service) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:35:50.172306 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b2350-ea12-4545-8d16-479116d39dde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:35:50.173696 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b2350-ea12-4545-8d16-479116d39dde None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:35:50.181886 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 610/1209] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 8 17:35:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:35:50.188041 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888a78d-bc6e-4cfb-87d1-2b4f38ec445d None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:50.238581 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:35:50.287015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888a78d-bc6e-4cfb-87d1-2b4f38ec445d None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:35:50.321299 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c8d23-4684-4138-80d8-1406487f6f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:35:50.321912 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c8d23-4684-4138-80d8-1406487f6f07 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:50.322190 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c8d23-4684-4138-80d8-1406487f6f07 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:50.322460 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c8d23-4684-4138-80d8-1406487f6f07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:50.332188 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c8d23-4684-4138-80d8-1406487f6f07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:35:50.333652 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c8d23-4684-4138-80d8-1406487f6f07 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:35:50.347808 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-a75c8d23-4684-4138-80d8-1406487f6f07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:35:50.347808 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:35:50.347808 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:35:50.347808 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:35:50.347808 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:35:50.347808 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:35:50.347808 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:35:50.347808 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:35:50.347808 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:35:50.347808 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:35:50.347808 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:35:50.347808 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:35:50.347808 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:35:50.347808 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:35:50.347808 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:35:50.347808 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:35:50.348933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:35:50.348933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:35:50.348933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:35:50.348933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:35:50.348933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:35:50.348933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:35:50.348933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:35:50.348933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:35:50.348933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:35:50.348933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:35:50.348933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:35:50.348933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:35:50.348933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:35:50.348933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:35:50.348933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:35:50.348933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:35:50.348933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:35:50.350500 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:35:50.350500 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:35:50.350500 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:35:50.350500 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 600/1210] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:35:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:35:50.355007 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b2350-ea12-4545-8d16-479116d39dde None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:50.453726 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:35:50.456704 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b2350-ea12-4545-8d16-479116d39dde None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:35:50.490973 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a3206-f505-4626-8465-95bb9f8675cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:35:50.491578 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a3206-f505-4626-8465-95bb9f8675cc None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:50.491857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a3206-f505-4626-8465-95bb9f8675cc None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:50.492171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a3206-f505-4626-8465-95bb9f8675cc None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:50.492879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a3206-f505-4626-8465-95bb9f8675cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:35:50.493222 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a3206-f505-4626-8465-95bb9f8675cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:35:50.494584 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a3206-f505-4626-8465-95bb9f8675cc None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:35:50.506028 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 611/1211] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:35:50.512326 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c8d23-4684-4138-80d8-1406487f6f07 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:50.619461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c8d23-4684-4138-80d8-1406487f6f07 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:35:50.620915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:35:50.653728 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc9bba-d445-4988-9c72-b3ca3793f556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:35:50.654343 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc9bba-d445-4988-9c72-b3ca3793f556 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:50.654623 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc9bba-d445-4988-9c72-b3ca3793f556 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:50.654892 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc9bba-d445-4988-9c72-b3ca3793f556 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:50.662044 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc9bba-d445-4988-9c72-b3ca3793f556 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:35:50.663490 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc9bba-d445-4988-9c72-b3ca3793f556 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:35:50.674688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-53fc9bba-d445-4988-9c72-b3ca3793f556 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 08 17:35:50.674688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:35:50.674688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:35:50.674688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:35:50.674688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:35:50.674688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:35:50.674688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:35:50.674688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:35:50.674688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:35:50.674688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:35:50.674688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:35:50.674688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:35:50.674688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:35:50.674688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:35:50.674688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:35:50.674688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:35:50.676062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:35:50.676062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:35:50.676062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:35:50.676062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:35:50.676062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:35:50.676062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:35:50.676062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:35:50.676062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:35:50.676062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:35:50.676062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:35:50.676062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:35:50.676062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:35:50.676062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:35:50.676062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:35:50.676062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:35:50.676062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:35:50.676062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:35:50.676062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:35:50.677353 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:35:50.677353 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:35:50.677353 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:35:50.677353 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:35:50.677353 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:35:50.677353 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:35:50.677353 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:35:50.677353 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:35:50.677353 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 08 17:35:50.677353 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:35:50.677353 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 601/1212] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:35:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:35:50.682200 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a3206-f505-4626-8465-95bb9f8675cc None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:50.781922 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a3206-f505-4626-8465-95bb9f8675cc None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:35:50.816475 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab03e7-7e7f-4146-a452-d4a9e8e36353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:35:50.817245 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab03e7-7e7f-4146-a452-d4a9e8e36353 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:50.817554 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab03e7-7e7f-4146-a452-d4a9e8e36353 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:50.817829 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab03e7-7e7f-4146-a452-d4a9e8e36353 None admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:50.818553 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab03e7-7e7f-4146-a452-d4a9e8e36353 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:35:50.818856 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab03e7-7e7f-4146-a452-d4a9e8e36353 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:35:50.820766 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab03e7-7e7f-4146-a452-d4a9e8e36353 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:35:50.838838 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 612/1213] 10.222.0.70 () {56 vars in 1143 bytes} [Mon Aug 8 17:35:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:35:50.844764 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc9bba-d445-4988-9c72-b3ca3793f556 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:50.949248 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc9bba-d445-4988-9c72-b3ca3793f556 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:35:50.982942 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d20897-c790-4559-99f6-9d5e9b7c4082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:35:50.983538 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d20897-c790-4559-99f6-9d5e9b7c4082 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:50.983814 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d20897-c790-4559-99f6-9d5e9b7c4082 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:50.984082 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d20897-c790-4559-99f6-9d5e9b7c4082 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:51.013642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:35:51.049641 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d20897-c790-4559-99f6-9d5e9b7c4082 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:35:51.051079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d20897-c790-4559-99f6-9d5e9b7c4082 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:35:51.151116 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 602/1214] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:35:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 17:35:51.156949 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab03e7-7e7f-4146-a452-d4a9e8e36353 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:51.175561 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:35:51.255234 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab03e7-7e7f-4146-a452-d4a9e8e36353 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:35:51.289761 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f7152-6ef4-4b35-beaa-85d06fc46b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:35:51.290385 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f7152-6ef4-4b35-beaa-85d06fc46b33 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:51.290669 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f7152-6ef4-4b35-beaa-85d06fc46b33 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:51.290944 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f7152-6ef4-4b35-beaa-85d06fc46b33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:51.300994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f7152-6ef4-4b35-beaa-85d06fc46b33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:35:51.304499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f7152-6ef4-4b35-beaa-85d06fc46b33 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:35:51.317724 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-812f7152-6ef4-4b35-beaa-85d06fc46b33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:35:51.317724 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:35:51.317724 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:35:51.317724 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:35:51.317724 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:35:51.317724 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:35:51.317724 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:35:51.317724 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:35:51.317724 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:35:51.317724 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:35:51.317724 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:35:51.317724 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:35:51.317724 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:35:51.317724 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:35:51.317724 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:35:51.317724 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:35:51.318857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:35:51.318857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:35:51.318857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:35:51.318857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:35:51.318857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:35:51.318857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:35:51.318857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:35:51.318857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:35:51.318857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:35:51.318857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:35:51.318857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:35:51.318857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:35:51.318857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:35:51.318857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:35:51.318857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:35:51.318857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:35:51.318857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:35:51.320033 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:35:51.320033 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:35:51.320033 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:35:51.320033 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 613/1215] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:35:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:35:51.324864 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d20897-c790-4559-99f6-9d5e9b7c4082 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:51.386255 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:35:51.424742 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d20897-c790-4559-99f6-9d5e9b7c4082 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:35:51.458100 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d939ca-c33d-43c0-97f8-ec3c0f4683ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:35:51.458742 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d939ca-c33d-43c0-97f8-ec3c0f4683ad None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:51.459297 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d939ca-c33d-43c0-97f8-ec3c0f4683ad None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:51.460489 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d939ca-c33d-43c0-97f8-ec3c0f4683ad None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:51.461639 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d939ca-c33d-43c0-97f8-ec3c0f4683ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:35:51.461946 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d939ca-c33d-43c0-97f8-ec3c0f4683ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:35:51.463368 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d939ca-c33d-43c0-97f8-ec3c0f4683ad None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:35:51.475429 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 603/1216] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:35:51.481288 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f7152-6ef4-4b35-beaa-85d06fc46b33 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:51.551133 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:35:51.581751 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f7152-6ef4-4b35-beaa-85d06fc46b33 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:35:51.615259 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4973f8-d8a1-4b49-857a-a7b8a12b6e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:35:51.616418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4973f8-d8a1-4b49-857a-a7b8a12b6e83 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:51.616799 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4973f8-d8a1-4b49-857a-a7b8a12b6e83 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:51.617096 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4973f8-d8a1-4b49-857a-a7b8a12b6e83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:51.623623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4973f8-d8a1-4b49-857a-a7b8a12b6e83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:35:51.625203 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4973f8-d8a1-4b49-857a-a7b8a12b6e83 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:35:51.637372 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-3c4973f8-d8a1-4b49-857a-a7b8a12b6e83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:35:51.637372 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:35:51.637372 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:35:51.637372 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:35:51.637372 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:35:51.637372 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:35:51.637372 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:35:51.637372 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:35:51.637372 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:35:51.637372 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:35:51.637372 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:35:51.637372 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:35:51.637372 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:35:51.637372 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:35:51.637372 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:35:51.638445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:35:51.638445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:35:51.638445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:35:51.638445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:35:51.638445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:35:51.638445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:35:51.638445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:35:51.638445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:35:51.638445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:35:51.638445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:35:51.638445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:35:51.638445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:35:51.638445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:35:51.638445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:35:51.638445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:35:51.638445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:35:51.638445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:35:51.639568 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:35:51.639568 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:35:51.639568 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:35:51.639568 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:35:51.639568 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:35:51.639568 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:35:51.639568 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:35:51.639568 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:35:51.639568 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 614/1217] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:35:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:35:51.644408 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d939ca-c33d-43c0-97f8-ec3c0f4683ad None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:51.744334 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d939ca-c33d-43c0-97f8-ec3c0f4683ad None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:35:51.767191 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:35:51.778862 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8b3c9-d2f4-4aaf-af32-4bbf94619ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:35:51.779453 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8b3c9-d2f4-4aaf-af32-4bbf94619ac0 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:51.779728 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8b3c9-d2f4-4aaf-af32-4bbf94619ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:51.779993 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8b3c9-d2f4-4aaf-af32-4bbf94619ac0 None admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:51.780666 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8b3c9-d2f4-4aaf-af32-4bbf94619ac0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:35:51.780964 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8b3c9-d2f4-4aaf-af32-4bbf94619ac0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:35:51.782402 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8b3c9-d2f4-4aaf-af32-4bbf94619ac0 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:35:51.793835 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 604/1218] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 8 17:35:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:35:51.799858 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4973f8-d8a1-4b49-857a-a7b8a12b6e83 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:51.904274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4973f8-d8a1-4b49-857a-a7b8a12b6e83 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:35:51.932486 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:35:51.938295 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5855fa-6c3f-44ac-a0da-32dcefbaad7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:35:51.938950 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5855fa-6c3f-44ac-a0da-32dcefbaad7f None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:51.939236 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5855fa-6c3f-44ac-a0da-32dcefbaad7f None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:51.939509 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5855fa-6c3f-44ac-a0da-32dcefbaad7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:51.940241 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5855fa-6c3f-44ac-a0da-32dcefbaad7f None admin] RBAC: Adding query filter params (role.id=6d5d281c40dd4e69803141f48615b386, scope.project.id=047a28b7cd11486da9d330723a384812, user.id=68717c19e74e434da825d9b1d6ca202a) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:35:51.940542 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5855fa-6c3f-44ac-a0da-32dcefbaad7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:35:51.942044 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5855fa-6c3f-44ac-a0da-32dcefbaad7f None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:35:51.948304 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 615/1219] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:35:51 2022] GET /identity/v3/role_assignments?user.id=68717c19e74e434da825d9b1d6ca202a&scope.project.id=047a28b7cd11486da9d330723a384812&role.id=6d5d281c40dd4e69803141f48615b386 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:35:53.977478 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2eac91-8c74-4cb8-8694-7f174255a21d None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:53.978067 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2eac91-8c74-4cb8-8694-7f174255a21d None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:53.978067 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2eac91-8c74-4cb8-8694-7f174255a21d None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:53.979343 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 605/1220] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:35:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:35:53.984472 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2b51e-5ffc-46e8-b744-8711a49b1ae8 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:53.984881 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2b51e-5ffc-46e8-b744-8711a49b1ae8 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:53.985012 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2b51e-5ffc-46e8-b744-8711a49b1ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:54.003298 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-7ca2b51e-5ffc-46e8-b744-8711a49b1ae8 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:35:54.004469 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-7ca2b51e-5ffc-46e8-b744-8711a49b1ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:35:54.073358 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 616/1221] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:35:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:35:54.095837 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2eac91-8c74-4cb8-8694-7f174255a21d None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:54.198773 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2eac91-8c74-4cb8-8694-7f174255a21d None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:35:54.232553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cccd62-2a2d-400b-8d5c-44883de45d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:35:54.233138 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cccd62-2a2d-400b-8d5c-44883de45d43 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:54.233420 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cccd62-2a2d-400b-8d5c-44883de45d43 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:54.233690 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cccd62-2a2d-400b-8d5c-44883de45d43 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:54.244303 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cccd62-2a2d-400b-8d5c-44883de45d43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:35:54.248947 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-95cccd62-2a2d-400b-8d5c-44883de45d43 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:35:54.248947 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:35:54.248947 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:35:54.248947 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:35:54.248947 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:35:54.248947 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:35:54.248947 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:35:54.248947 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:35:54.248947 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:35:54.248947 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:35:54.248947 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:35:54.248947 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:35:54.248947 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:35:54.248947 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:35:54.248947 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:35:54.248947 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:35:54.250174 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:35:54.250174 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:35:54.250174 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:35:54.250174 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:35:54.250174 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:35:54.250174 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:35:54.250174 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:35:54.250174 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:35:54.250174 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:35:54.250174 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:35:54.250174 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:35:54.250174 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:35:54.250174 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:35:54.250174 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:35:54.250174 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:35:54.250174 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:35:54.251325 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:35:54.251325 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:35:54.251325 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:35:54.251325 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:35:54.251325 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:35:54.251325 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:35:54.251325 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:35:54.251325 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:35:54.251325 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:35:54.251325 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:35:54.251325 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:35:54.251325 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:35:54.251325 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 606/1222] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 8 17:35:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:35:54.256931 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2b51e-5ffc-46e8-b744-8711a49b1ae8 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:54.356808 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2b51e-5ffc-46e8-b744-8711a49b1ae8 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:35:54.380022 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:35:54.390950 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59151c1-0a60-4c35-ad34-05972cd8b26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:35:54.391583 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59151c1-0a60-4c35-ad34-05972cd8b26a None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:54.391860 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59151c1-0a60-4c35-ad34-05972cd8b26a None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:54.392128 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59151c1-0a60-4c35-ad34-05972cd8b26a None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:54.392790 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59151c1-0a60-4c35-ad34-05972cd8b26a None admin] RBAC: Adding query filter params (name=service) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:35:54.393113 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59151c1-0a60-4c35-ad34-05972cd8b26a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:35:54.394466 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59151c1-0a60-4c35-ad34-05972cd8b26a None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:35:54.403071 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 617/1223] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 8 17:35:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:35:54.408965 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cccd62-2a2d-400b-8d5c-44883de45d43 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:54.455091 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:35:54.512587 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cccd62-2a2d-400b-8d5c-44883de45d43 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:35:54.546802 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d4c76-a4f1-4a03-882a-aa4262eb6ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:35:54.547427 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d4c76-a4f1-4a03-882a-aa4262eb6ccc None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:54.547699 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d4c76-a4f1-4a03-882a-aa4262eb6ccc None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:54.547969 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d4c76-a4f1-4a03-882a-aa4262eb6ccc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:54.558806 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d4c76-a4f1-4a03-882a-aa4262eb6ccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:35:54.560435 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d4c76-a4f1-4a03-882a-aa4262eb6ccc None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:35:54.574342 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-799d4c76-a4f1-4a03-882a-aa4262eb6ccc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:35:54.574342 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:35:54.574342 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:35:54.574342 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:35:54.574342 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:35:54.574342 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:35:54.574342 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:35:54.574342 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:35:54.574342 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:35:54.574342 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:35:54.574342 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:35:54.574342 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:35:54.574342 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:35:54.574342 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:35:54.574342 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:35:54.574342 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:35:54.575497 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:35:54.575497 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:35:54.575497 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:35:54.575497 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:35:54.575497 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:35:54.575497 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:35:54.575497 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:35:54.575497 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:35:54.575497 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:35:54.575497 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:35:54.575497 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:35:54.575497 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:35:54.575497 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:35:54.575497 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:35:54.575497 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:35:54.575497 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:35:54.575497 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:35:54.576715 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:35:54.576715 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:35:54.576715 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:35:54.576715 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 607/1224] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:35:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:35:54.581439 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59151c1-0a60-4c35-ad34-05972cd8b26a None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:54.682128 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59151c1-0a60-4c35-ad34-05972cd8b26a None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:35:54.715197 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910f457-9cc5-4b6a-9456-c7dc767b5e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:35:54.715811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910f457-9cc5-4b6a-9456-c7dc767b5e3c None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:54.716086 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910f457-9cc5-4b6a-9456-c7dc767b5e3c None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:54.716362 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910f457-9cc5-4b6a-9456-c7dc767b5e3c None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:54.716997 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910f457-9cc5-4b6a-9456-c7dc767b5e3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:35:54.717333 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910f457-9cc5-4b6a-9456-c7dc767b5e3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:35:54.718721 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910f457-9cc5-4b6a-9456-c7dc767b5e3c None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:35:54.730919 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 618/1225] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:35:54.736721 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d4c76-a4f1-4a03-882a-aa4262eb6ccc None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:54.829500 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:35:54.836861 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d4c76-a4f1-4a03-882a-aa4262eb6ccc None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:35:54.870709 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c879e3d-6043-4c71-bbed-f4766b11678c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:35:54.871320 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c879e3d-6043-4c71-bbed-f4766b11678c None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:54.871596 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c879e3d-6043-4c71-bbed-f4766b11678c None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:54.871862 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c879e3d-6043-4c71-bbed-f4766b11678c None admin] PATH_INFO: `/v3/users/placement` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:54.878631 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c879e3d-6043-4c71-bbed-f4766b11678c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:35:54.880059 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c879e3d-6043-4c71-bbed-f4766b11678c None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:35:54.891305 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-5c879e3d-6043-4c71-bbed-f4766b11678c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 08 17:35:54.891305 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:35:54.891305 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:35:54.891305 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:35:54.891305 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:35:54.891305 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:35:54.891305 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:35:54.891305 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:35:54.891305 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:35:54.891305 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:35:54.891305 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:35:54.891305 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:35:54.891305 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:35:54.891305 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:35:54.891305 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:35:54.891305 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:35:54.892482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:35:54.892482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:35:54.892482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:35:54.892482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:35:54.892482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:35:54.892482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:35:54.892482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:35:54.892482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:35:54.892482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:35:54.892482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:35:54.892482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:35:54.892482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:35:54.892482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:35:54.892482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:35:54.892482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:35:54.892482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:35:54.892482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:35:54.892482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:35:54.893579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:35:54.893579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:35:54.893579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:35:54.893579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:35:54.893579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:35:54.893579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:35:54.893579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:35:54.893579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:35:54.893579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 08 17:35:54.893579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:35:54.893579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 608/1226] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:35:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:35:54.899166 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910f457-9cc5-4b6a-9456-c7dc767b5e3c None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:54.946344 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:35:54.997911 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910f457-9cc5-4b6a-9456-c7dc767b5e3c None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:35:55.031142 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3824c53-9a17-41bd-a630-d5b990df2b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:35:55.031735 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3824c53-9a17-41bd-a630-d5b990df2b9a None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:55.032013 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3824c53-9a17-41bd-a630-d5b990df2b9a None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:55.032280 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3824c53-9a17-41bd-a630-d5b990df2b9a None admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:55.032994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3824c53-9a17-41bd-a630-d5b990df2b9a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:35:55.033325 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3824c53-9a17-41bd-a630-d5b990df2b9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:35:55.034733 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3824c53-9a17-41bd-a630-d5b990df2b9a None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:35:55.051481 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 619/1227] 10.222.0.70 () {56 vars in 1143 bytes} [Mon Aug 8 17:35:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:35:55.057767 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c879e3d-6043-4c71-bbed-f4766b11678c None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:55.158593 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c879e3d-6043-4c71-bbed-f4766b11678c None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:35:55.192643 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443922d4-6bbb-4066-80c0-798b362325fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:35:55.193279 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443922d4-6bbb-4066-80c0-798b362325fd None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:55.193557 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443922d4-6bbb-4066-80c0-798b362325fd None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:55.193824 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443922d4-6bbb-4066-80c0-798b362325fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:55.205162 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443922d4-6bbb-4066-80c0-798b362325fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:35:55.206588 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443922d4-6bbb-4066-80c0-798b362325fd None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:35:55.220951 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-443922d4-6bbb-4066-80c0-798b362325fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:35:55.220951 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:35:55.220951 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:35:55.220951 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:35:55.220951 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:35:55.220951 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:35:55.220951 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:35:55.220951 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:35:55.220951 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:35:55.220951 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:35:55.220951 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:35:55.220951 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:35:55.220951 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:35:55.220951 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:35:55.220951 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:35:55.220951 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:35:55.222118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:35:55.222118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:35:55.222118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:35:55.222118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:35:55.222118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:35:55.222118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:35:55.222118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:35:55.222118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:35:55.222118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:35:55.222118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:35:55.222118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:35:55.222118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:35:55.222118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:35:55.222118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:35:55.222118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:35:55.222118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:35:55.222118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:35:55.223414 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:35:55.223414 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:35:55.223414 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:35:55.223414 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 609/1228] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:35:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:35:55.229196 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3824c53-9a17-41bd-a630-d5b990df2b9a None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:55.328651 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3824c53-9a17-41bd-a630-d5b990df2b9a None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:35:55.331076 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:35:55.362713 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0709c-6235-484b-92c3-0ac18b013c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:35:55.363307 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0709c-6235-484b-92c3-0ac18b013c19 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:55.363582 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0709c-6235-484b-92c3-0ac18b013c19 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:55.363846 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0709c-6235-484b-92c3-0ac18b013c19 None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:55.364476 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd0709c-6235-484b-92c3-0ac18b013c19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:35:55.364769 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd0709c-6235-484b-92c3-0ac18b013c19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:35:55.367130 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd0709c-6235-484b-92c3-0ac18b013c19 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:35:55.378102 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 620/1229] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:35:55.384513 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443922d4-6bbb-4066-80c0-798b362325fd None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:55.393982 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:35:55.485633 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443922d4-6bbb-4066-80c0-798b362325fd None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:35:55.521118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cff4f4-3901-4b0e-9a54-6702f652fb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:35:55.521766 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cff4f4-3901-4b0e-9a54-6702f652fb0f None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:55.522154 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cff4f4-3901-4b0e-9a54-6702f652fb0f None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:55.522154 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cff4f4-3901-4b0e-9a54-6702f652fb0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:55.528729 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cff4f4-3901-4b0e-9a54-6702f652fb0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:35:55.530189 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cff4f4-3901-4b0e-9a54-6702f652fb0f None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:35:55.541128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-b7cff4f4-3901-4b0e-9a54-6702f652fb0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:35:55.541128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:35:55.541128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:35:55.541128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:35:55.541128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:35:55.541128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:35:55.541128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:35:55.541128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:35:55.541128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:35:55.541128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:35:55.541128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:35:55.541128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:35:55.541128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:35:55.541128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:35:55.541128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:35:55.544364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:35:55.544364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:35:55.544364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:35:55.544364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:35:55.544364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:35:55.544364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:35:55.544364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:35:55.544364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:35:55.544364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:35:55.544364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:35:55.544364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:35:55.544364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:35:55.544364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:35:55.544364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:35:55.544364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:35:55.544364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:35:55.544364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:35:55.545568 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:35:55.545568 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:35:55.545568 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:35:55.545568 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:35:55.545568 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:35:55.545568 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:35:55.545568 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:35:55.545568 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:35:55.545568 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 610/1230] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:35:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:35:55.548218 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0709c-6235-484b-92c3-0ac18b013c19 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:55.647969 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0709c-6235-484b-92c3-0ac18b013c19 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:35:55.680862 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84c32e-971b-4f5e-af62-17e7cecd9e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:35:55.681417 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84c32e-971b-4f5e-af62-17e7cecd9e0a None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:55.681695 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84c32e-971b-4f5e-af62-17e7cecd9e0a None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:55.681968 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84c32e-971b-4f5e-af62-17e7cecd9e0a None admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:55.682653 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84c32e-971b-4f5e-af62-17e7cecd9e0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:35:55.682973 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84c32e-971b-4f5e-af62-17e7cecd9e0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:35:55.684402 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84c32e-971b-4f5e-af62-17e7cecd9e0a None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:35:55.696855 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 621/1231] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 8 17:35:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:35:55.703251 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cff4f4-3901-4b0e-9a54-6702f652fb0f None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:55.769002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:35:55.802807 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cff4f4-3901-4b0e-9a54-6702f652fb0f None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:35:55.836387 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8230ba-a780-498a-bb32-104b826603e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:35:55.837047 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8230ba-a780-498a-bb32-104b826603e5 None admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:55.837331 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8230ba-a780-498a-bb32-104b826603e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:55.837605 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8230ba-a780-498a-bb32-104b826603e5 None admin] PATH_INFO: `/v3/projects/047a28b7cd11486da9d330723a384812/users/68717c19e74e434da825d9b1d6ca202a/roles/6d5d281c40dd4e69803141f48615b386` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:55.852324 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8230ba-a780-498a-bb32-104b826603e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=047a28b7cd11486da9d330723a384812, user_id=68717c19e74e434da825d9b1d6ca202a, role_id=6d5d281c40dd4e69803141f48615b386)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:35:55.853837 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8230ba-a780-498a-bb32-104b826603e5 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:35:55.985750 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 611/1232] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 8 17:35:55 2022] PUT /identity/v3/projects/047a28b7cd11486da9d330723a384812/users/68717c19e74e434da825d9b1d6ca202a/roles/6d5d281c40dd4e69803141f48615b386 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:35:57.984626 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8fd37-ecfd-45c2-8fbe-177e5703c9e3 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:57.985215 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8fd37-ecfd-45c2-8fbe-177e5703c9e3 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:57.985215 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8fd37-ecfd-45c2-8fbe-177e5703c9e3 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:57.986568 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 622/1233] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:35:57.991827 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbabd6-57d9-42f0-91d2-3995f989432e None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:57.992236 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbabd6-57d9-42f0-91d2-3995f989432e None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:57.992373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbabd6-57d9-42f0-91d2-3995f989432e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:58.010987 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-52fbabd6-57d9-42f0-91d2-3995f989432e None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:35:58.017234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-52fbabd6-57d9-42f0-91d2-3995f989432e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:35:58.080831 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 612/1234] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:35:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:35:58.105634 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8fd37-ecfd-45c2-8fbe-177e5703c9e3 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:58.131778 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:35:58.206067 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8fd37-ecfd-45c2-8fbe-177e5703c9e3 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:35:58.240163 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e08b0d-a18d-4982-ada2-eb131c58b5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:35:58.242484 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e08b0d-a18d-4982-ada2-eb131c58b5e5 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:58.242766 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e08b0d-a18d-4982-ada2-eb131c58b5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:58.243039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e08b0d-a18d-4982-ada2-eb131c58b5e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:58.253552 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e08b0d-a18d-4982-ada2-eb131c58b5e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:35:58.258579 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-64e08b0d-a18d-4982-ada2-eb131c58b5e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:35:58.258579 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:35:58.258579 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:35:58.258579 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:35:58.258579 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:35:58.258579 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:35:58.258579 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:35:58.258579 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:35:58.258579 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:35:58.258579 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:35:58.258579 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:35:58.258579 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:35:58.258579 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:35:58.258579 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:35:58.258579 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:35:58.258579 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:35:58.259763 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:35:58.259763 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:35:58.259763 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:35:58.259763 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:35:58.259763 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:35:58.259763 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:35:58.259763 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:35:58.259763 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:35:58.259763 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:35:58.259763 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:35:58.259763 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:35:58.259763 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:35:58.259763 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:35:58.259763 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:35:58.259763 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:35:58.259763 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:35:58.260826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:35:58.260826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:35:58.260826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:35:58.260826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:35:58.260826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:35:58.260826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:35:58.260826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:35:58.260826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:35:58.260826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:35:58.260826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:35:58.260826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 17:35:58.260826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:35:58.260826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 623/1235] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 8 17:35:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:35:58.265957 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fbabd6-57d9-42f0-91d2-3995f989432e None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:58.313374 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:35:58.365471 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fbabd6-57d9-42f0-91d2-3995f989432e None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:35:58.400519 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad72f9-8463-473c-8a7f-5586bc90d1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:35:58.401258 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad72f9-8463-473c-8a7f-5586bc90d1f8 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:58.401517 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad72f9-8463-473c-8a7f-5586bc90d1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:58.401790 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad72f9-8463-473c-8a7f-5586bc90d1f8 None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:58.402451 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad72f9-8463-473c-8a7f-5586bc90d1f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:35:58.402752 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad72f9-8463-473c-8a7f-5586bc90d1f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:35:58.404114 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad72f9-8463-473c-8a7f-5586bc90d1f8 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:35:58.413283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 613/1236] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 8 17:35:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:35:58.418953 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e08b0d-a18d-4982-ada2-eb131c58b5e5 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:58.503744 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:35:58.523923 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e08b0d-a18d-4982-ada2-eb131c58b5e5 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:35:58.559053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d5e83-84d4-475d-bac2-df5e6ccd2e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:35:58.559663 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d5e83-84d4-475d-bac2-df5e6ccd2e50 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:58.559940 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d5e83-84d4-475d-bac2-df5e6ccd2e50 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:58.560207 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d5e83-84d4-475d-bac2-df5e6ccd2e50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:58.571853 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d5e83-84d4-475d-bac2-df5e6ccd2e50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:35:58.573342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d5e83-84d4-475d-bac2-df5e6ccd2e50 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:35:58.588834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-ac3d5e83-84d4-475d-bac2-df5e6ccd2e50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:35:58.588834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:35:58.588834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:35:58.588834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:35:58.588834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:35:58.588834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:35:58.588834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:35:58.588834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:35:58.588834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:35:58.588834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:35:58.588834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:35:58.588834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:35:58.588834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:35:58.588834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:35:58.588834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:35:58.588834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:35:58.593405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:35:58.593405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:35:58.593405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:35:58.593405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:35:58.593405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:35:58.593405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:35:58.593405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:35:58.593405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:35:58.593405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:35:58.593405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:35:58.593405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:35:58.593405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:35:58.593405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:35:58.593405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:35:58.593405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:35:58.593405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:35:58.593405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:35:58.594371 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:35:58.594371 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:35:58.594371 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:35:58.594371 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 624/1237] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:35:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:35:58.596426 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad72f9-8463-473c-8a7f-5586bc90d1f8 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:58.696476 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad72f9-8463-473c-8a7f-5586bc90d1f8 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:35:58.705318 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:35:58.730418 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fa132-3008-49cb-98f7-665fdd87f672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:35:58.731130 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fa132-3008-49cb-98f7-665fdd87f672 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:58.731409 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fa132-3008-49cb-98f7-665fdd87f672 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:58.731681 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fa132-3008-49cb-98f7-665fdd87f672 None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:58.732311 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70fa132-3008-49cb-98f7-665fdd87f672 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:35:58.732610 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70fa132-3008-49cb-98f7-665fdd87f672 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:35:58.733996 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70fa132-3008-49cb-98f7-665fdd87f672 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:35:58.745498 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 614/1238] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:35:58.751370 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d5e83-84d4-475d-bac2-df5e6ccd2e50 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:58.851551 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d5e83-84d4-475d-bac2-df5e6ccd2e50 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:35:58.885399 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d8295-be41-407b-ac8a-f26cda7f5d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:35:58.886010 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d8295-be41-407b-ac8a-f26cda7f5d4f None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:58.886289 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d8295-be41-407b-ac8a-f26cda7f5d4f None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:58.886562 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d8295-be41-407b-ac8a-f26cda7f5d4f None admin] PATH_INFO: `/v3/users/placement` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:58.889194 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:35:58.894091 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d8295-be41-407b-ac8a-f26cda7f5d4f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:35:58.895513 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d8295-be41-407b-ac8a-f26cda7f5d4f None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:35:58.908647 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-0a4d8295-be41-407b-ac8a-f26cda7f5d4f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 08 17:35:58.908647 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:35:58.908647 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:35:58.908647 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:35:58.908647 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:35:58.908647 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:35:58.908647 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:35:58.908647 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:35:58.908647 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:35:58.908647 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:35:58.908647 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:35:58.908647 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:35:58.908647 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:35:58.908647 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:35:58.908647 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:35:58.908647 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:35:58.909720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:35:58.909720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:35:58.909720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:35:58.909720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:35:58.909720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:35:58.909720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:35:58.909720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:35:58.909720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:35:58.909720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:35:58.909720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:35:58.909720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:35:58.909720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:35:58.909720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:35:58.909720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:35:58.909720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:35:58.909720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:35:58.909720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:35:58.909720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:35:58.911201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:35:58.911201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:35:58.911201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:35:58.911201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:35:58.911201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:35:58.911201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:35:58.911201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:35:58.911201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:35:58.911201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 08 17:35:58.911201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:35:58.911201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 625/1239] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:35:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:35:58.916087 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fa132-3008-49cb-98f7-665fdd87f672 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:59.017316 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fa132-3008-49cb-98f7-665fdd87f672 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:35:59.051303 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8e063-bc36-499b-bf6c-421faa2b4c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:35:59.051901 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8e063-bc36-499b-bf6c-421faa2b4c1e None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:59.052228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8e063-bc36-499b-bf6c-421faa2b4c1e None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:59.052561 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8e063-bc36-499b-bf6c-421faa2b4c1e None admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:59.054008 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8e063-bc36-499b-bf6c-421faa2b4c1e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:35:59.054213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8e063-bc36-499b-bf6c-421faa2b4c1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:35:59.055647 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8e063-bc36-499b-bf6c-421faa2b4c1e None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:35:59.072815 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 615/1240] 10.222.0.70 () {56 vars in 1143 bytes} [Mon Aug 8 17:35:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:35:59.078708 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d8295-be41-407b-ac8a-f26cda7f5d4f None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:59.180305 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d8295-be41-407b-ac8a-f26cda7f5d4f None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:35:59.215113 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66885a39-372e-40d7-8464-6562cbb19a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:35:59.215714 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66885a39-372e-40d7-8464-6562cbb19a81 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:59.215995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66885a39-372e-40d7-8464-6562cbb19a81 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:59.216269 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66885a39-372e-40d7-8464-6562cbb19a81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:59.277818 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:35:59.284415 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66885a39-372e-40d7-8464-6562cbb19a81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:35:59.285934 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66885a39-372e-40d7-8464-6562cbb19a81 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:35:59.383206 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 626/1241] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:35:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 17:35:59.388973 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8e063-bc36-499b-bf6c-421faa2b4c1e None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:59.416974 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:35:59.487969 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8e063-bc36-499b-bf6c-421faa2b4c1e None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:35:59.522919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098eaa73-56b5-4a59-8632-6c0be37bafcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:35:59.523543 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098eaa73-56b5-4a59-8632-6c0be37bafcc None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:59.523823 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098eaa73-56b5-4a59-8632-6c0be37bafcc None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:59.524087 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098eaa73-56b5-4a59-8632-6c0be37bafcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:59.533738 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098eaa73-56b5-4a59-8632-6c0be37bafcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:35:59.535166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098eaa73-56b5-4a59-8632-6c0be37bafcc None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:35:59.549220 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-098eaa73-56b5-4a59-8632-6c0be37bafcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:35:59.549220 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:35:59.549220 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:35:59.549220 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:35:59.549220 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:35:59.549220 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:35:59.549220 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:35:59.549220 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:35:59.549220 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:35:59.549220 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:35:59.549220 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:35:59.549220 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:35:59.549220 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:35:59.549220 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:35:59.549220 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:35:59.549220 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:35:59.550369 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:35:59.550369 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:35:59.550369 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:35:59.550369 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:35:59.550369 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:35:59.550369 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:35:59.550369 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:35:59.550369 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:35:59.550369 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:35:59.550369 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:35:59.550369 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:35:59.550369 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:35:59.550369 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:35:59.550369 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:35:59.550369 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:35:59.550369 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:35:59.550369 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:35:59.551717 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:35:59.551717 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:35:59.551717 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:35:59.551717 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 616/1242] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:35:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:35:59.556470 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66885a39-372e-40d7-8464-6562cbb19a81 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:59.652294 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:35:59.658849 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66885a39-372e-40d7-8464-6562cbb19a81 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:35:59.692780 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced0204-926e-4c54-80a4-f9dd8b8387be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:35:59.693416 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced0204-926e-4c54-80a4-f9dd8b8387be None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:59.694188 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced0204-926e-4c54-80a4-f9dd8b8387be None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:59.694459 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced0204-926e-4c54-80a4-f9dd8b8387be None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:59.695127 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced0204-926e-4c54-80a4-f9dd8b8387be None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:35:59.695430 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced0204-926e-4c54-80a4-f9dd8b8387be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:35:59.696785 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced0204-926e-4c54-80a4-f9dd8b8387be None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:35:59.708241 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 627/1243] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:35:59.714529 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098eaa73-56b5-4a59-8632-6c0be37bafcc None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:59.794044 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:35:59.815160 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098eaa73-56b5-4a59-8632-6c0be37bafcc None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:35:59.849744 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecefac-34d9-4918-9e22-06e4a10f6ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:35:59.850370 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecefac-34d9-4918-9e22-06e4a10f6ff9 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:35:59.850653 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecefac-34d9-4918-9e22-06e4a10f6ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:35:59.850930 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecefac-34d9-4918-9e22-06e4a10f6ff9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:35:59.857287 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ecefac-34d9-4918-9e22-06e4a10f6ff9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:35:59.858818 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ecefac-34d9-4918-9e22-06e4a10f6ff9 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:35:59.870210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-90ecefac-34d9-4918-9e22-06e4a10f6ff9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:35:59.870210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:35:59.870210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:35:59.870210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:35:59.870210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:35:59.870210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:35:59.870210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:35:59.870210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:35:59.870210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:35:59.870210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:35:59.870210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:35:59.870210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:35:59.870210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:35:59.870210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:35:59.870210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:35:59.871283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:35:59.871283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:35:59.871283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:35:59.871283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:35:59.871283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:35:59.871283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:35:59.871283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:35:59.871283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:35:59.871283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:35:59.871283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:35:59.871283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:35:59.871283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:35:59.871283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:35:59.871283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:35:59.871283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:35:59.871283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:35:59.871283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:35:59.872384 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:35:59.872384 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:35:59.872384 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:35:59.872384 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:35:59.872384 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:35:59.872384 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:35:59.872384 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:35:59.872384 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:35:59.872384 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 617/1244] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:35:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:35:59.877132 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced0204-926e-4c54-80a4-f9dd8b8387be None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:35:59.978379 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced0204-926e-4c54-80a4-f9dd8b8387be None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:00.012462 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccff6f4-4dca-47d0-a478-1b9b76f3f410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:00.013074 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccff6f4-4dca-47d0-a478-1b9b76f3f410 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:00.013362 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccff6f4-4dca-47d0-a478-1b9b76f3f410 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:00.013634 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccff6f4-4dca-47d0-a478-1b9b76f3f410 None admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:00.014322 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccff6f4-4dca-47d0-a478-1b9b76f3f410 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:36:00.014626 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccff6f4-4dca-47d0-a478-1b9b76f3f410 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:00.016091 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccff6f4-4dca-47d0-a478-1b9b76f3f410 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:00.027843 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 628/1245] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 8 17:35:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:36:00.033927 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecefac-34d9-4918-9e22-06e4a10f6ff9 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:00.136070 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecefac-34d9-4918-9e22-06e4a10f6ff9 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:00.169255 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76e656-9e87-489a-89a0-9982a1a1492f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:00.169847 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76e656-9e87-489a-89a0-9982a1a1492f None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:00.170122 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76e656-9e87-489a-89a0-9982a1a1492f None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:00.170388 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76e656-9e87-489a-89a0-9982a1a1492f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:00.171091 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76e656-9e87-489a-89a0-9982a1a1492f None admin] RBAC: Adding query filter params (role.id=6d5d281c40dd4e69803141f48615b386, scope.project.id=047a28b7cd11486da9d330723a384812, user.id=68717c19e74e434da825d9b1d6ca202a) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:36:00.171394 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76e656-9e87-489a-89a0-9982a1a1492f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:00.172802 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76e656-9e87-489a-89a0-9982a1a1492f None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:00.179467 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 618/1246] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:36:00 2022] GET /identity/v3/role_assignments?user.id=68717c19e74e434da825d9b1d6ca202a&scope.project.id=047a28b7cd11486da9d330723a384812&role.id=6d5d281c40dd4e69803141f48615b386 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:36:02.237919 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ecd63-d3ac-4e46-9f54-5e2340d3da25 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:02.238486 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ecd63-d3ac-4e46-9f54-5e2340d3da25 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:02.238486 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ecd63-d3ac-4e46-9f54-5e2340d3da25 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:02.239826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 629/1247] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:36:02.245168 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24b178-4caf-4299-9c7d-c2d56431f1c5 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:02.245576 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24b178-4caf-4299-9c7d-c2d56431f1c5 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:02.245725 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24b178-4caf-4299-9c7d-c2d56431f1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:02.252159 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:02.264258 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-3d24b178-4caf-4299-9c7d-c2d56431f1c5 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:36:02.265478 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-3d24b178-4caf-4299-9c7d-c2d56431f1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:36:02.333140 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 619/1248] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:36:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:36:02.358102 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ecd63-d3ac-4e46-9f54-5e2340d3da25 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:02.376413 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:02.462459 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ecd63-d3ac-4e46-9f54-5e2340d3da25 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:02.497168 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdb806-bda5-47ba-85a7-587848af422e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:02.497771 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdb806-bda5-47ba-85a7-587848af422e None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:02.498053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdb806-bda5-47ba-85a7-587848af422e None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:02.498344 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdb806-bda5-47ba-85a7-587848af422e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:02.508900 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fdb806-bda5-47ba-85a7-587848af422e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:36:02.513623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-15fdb806-bda5-47ba-85a7-587848af422e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:36:02.513623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:36:02.513623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:36:02.513623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:36:02.513623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:36:02.513623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:36:02.513623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:36:02.513623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:36:02.513623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:36:02.513623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:36:02.513623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:36:02.513623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:36:02.513623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:36:02.513623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:36:02.513623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:36:02.513623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:36:02.514720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:36:02.514720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:36:02.514720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:36:02.514720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:36:02.514720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:36:02.514720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:36:02.514720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:36:02.514720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:36:02.514720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:36:02.514720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:36:02.514720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:36:02.514720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:36:02.514720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:36:02.514720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:36:02.514720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:36:02.514720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:36:02.515703 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:36:02.515703 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:36:02.515703 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:36:02.515703 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:36:02.515703 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:36:02.515703 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:36:02.515703 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:36:02.515703 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:36:02.515703 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:36:02.515703 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:36:02.515703 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:36:02.515703 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:36:02.515703 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 630/1249] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 8 17:36:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:36:02.520983 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d24b178-4caf-4299-9c7d-c2d56431f1c5 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:02.619949 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d24b178-4caf-4299-9c7d-c2d56431f1c5 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:02.650124 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:02.654912 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf65ea-043a-4063-b1c5-fb67d634291a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:02.655511 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf65ea-043a-4063-b1c5-fb67d634291a None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:02.655791 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf65ea-043a-4063-b1c5-fb67d634291a None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:02.656061 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf65ea-043a-4063-b1c5-fb67d634291a None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:02.656755 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf65ea-043a-4063-b1c5-fb67d634291a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:36:02.657079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf65ea-043a-4063-b1c5-fb67d634291a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:02.658447 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf65ea-043a-4063-b1c5-fb67d634291a None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:02.666290 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 620/1250] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:36:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:36:02.672884 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdb806-bda5-47ba-85a7-587848af422e None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:02.752248 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:02.775284 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdb806-bda5-47ba-85a7-587848af422e None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:02.807998 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0e3b8-ec91-48f9-8283-769d9248fc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:02.808640 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0e3b8-ec91-48f9-8283-769d9248fc12 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:02.808923 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0e3b8-ec91-48f9-8283-769d9248fc12 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:02.809223 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0e3b8-ec91-48f9-8283-769d9248fc12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:02.819678 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb0e3b8-ec91-48f9-8283-769d9248fc12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:02.821142 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb0e3b8-ec91-48f9-8283-769d9248fc12 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:02.836109 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-ecb0e3b8-ec91-48f9-8283-769d9248fc12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:36:02.836109 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:36:02.836109 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:36:02.836109 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:36:02.836109 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:36:02.836109 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:36:02.836109 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:36:02.836109 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:36:02.836109 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:36:02.836109 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:36:02.836109 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:36:02.836109 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:36:02.836109 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:36:02.836109 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:36:02.836109 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:36:02.836109 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:36:02.837142 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:36:02.837142 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:36:02.837142 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:36:02.837142 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:36:02.837142 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:36:02.837142 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:36:02.837142 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:36:02.837142 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:36:02.837142 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:36:02.837142 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:36:02.837142 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:36:02.837142 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:36:02.837142 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:36:02.837142 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:36:02.837142 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:36:02.837142 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:36:02.837142 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:36:02.838069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:36:02.838069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:36:02.838069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:36:02.841182 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 631/1251] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:36:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:36:02.853891 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf65ea-043a-4063-b1c5-fb67d634291a None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:02.941388 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf65ea-043a-4063-b1c5-fb67d634291a None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:02.974824 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443e386-1f15-4e57-99be-7483043b9c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:02.975433 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443e386-1f15-4e57-99be-7483043b9c83 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:02.975708 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443e386-1f15-4e57-99be-7483043b9c83 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:02.975978 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443e386-1f15-4e57-99be-7483043b9c83 None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:02.976665 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443e386-1f15-4e57-99be-7483043b9c83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:36:02.976964 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443e386-1f15-4e57-99be-7483043b9c83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:02.978354 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443e386-1f15-4e57-99be-7483043b9c83 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:02.990731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 621/1252] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:36:02.996433 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0e3b8-ec91-48f9-8283-769d9248fc12 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:03.096024 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0e3b8-ec91-48f9-8283-769d9248fc12 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:03.122939 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:03.130589 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1e308-c551-4b5e-9ba9-ee9ecdd2eec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:03.131988 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1e308-c551-4b5e-9ba9-ee9ecdd2eec6 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:03.133506 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1e308-c551-4b5e-9ba9-ee9ecdd2eec6 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:03.133506 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1e308-c551-4b5e-9ba9-ee9ecdd2eec6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:03.141112 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d1e308-c551-4b5e-9ba9-ee9ecdd2eec6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:03.142639 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d1e308-c551-4b5e-9ba9-ee9ecdd2eec6 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:03.153623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-e1d1e308-c551-4b5e-9ba9-ee9ecdd2eec6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 08 17:36:03.153623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:36:03.153623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:36:03.153623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:36:03.153623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:36:03.153623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:36:03.153623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:36:03.153623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:36:03.153623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:36:03.153623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:36:03.153623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:36:03.153623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:36:03.153623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:36:03.153623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:36:03.153623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:36:03.153623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:36:03.154853 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:36:03.154853 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:36:03.154853 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:36:03.154853 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:36:03.154853 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:36:03.154853 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:36:03.154853 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:36:03.154853 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:36:03.154853 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:36:03.154853 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:36:03.154853 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:36:03.154853 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:36:03.154853 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:36:03.154853 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:36:03.154853 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:36:03.154853 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:36:03.154853 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:36:03.154853 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:36:03.156098 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:36:03.156098 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:36:03.156098 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:36:03.156098 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:36:03.156098 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:36:03.156098 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:36:03.156098 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:36:03.156098 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:36:03.156098 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 08 17:36:03.156098 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:36:03.156098 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 632/1253] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:36:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:36:03.160635 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443e386-1f15-4e57-99be-7483043b9c83 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:03.216833 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:03.260836 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443e386-1f15-4e57-99be-7483043b9c83 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:03.297380 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d59ab-3c1f-43a9-8265-0ac6b4eb475b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:03.297976 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d59ab-3c1f-43a9-8265-0ac6b4eb475b None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:03.298270 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d59ab-3c1f-43a9-8265-0ac6b4eb475b None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:03.298573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d59ab-3c1f-43a9-8265-0ac6b4eb475b None admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:03.299288 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d59ab-3c1f-43a9-8265-0ac6b4eb475b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:36:03.299590 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d59ab-3c1f-43a9-8265-0ac6b4eb475b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:03.301009 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d59ab-3c1f-43a9-8265-0ac6b4eb475b None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:03.318705 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 622/1254] 10.222.0.70 () {56 vars in 1143 bytes} [Mon Aug 8 17:36:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:36:03.324354 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1e308-c551-4b5e-9ba9-ee9ecdd2eec6 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:03.429258 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1e308-c551-4b5e-9ba9-ee9ecdd2eec6 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:03.464298 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f397d27-8449-4e73-9ac8-33a372a2381b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:03.464898 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f397d27-8449-4e73-9ac8-33a372a2381b None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:03.465213 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f397d27-8449-4e73-9ac8-33a372a2381b None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:03.465490 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f397d27-8449-4e73-9ac8-33a372a2381b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:03.521805 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:03.533694 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f397d27-8449-4e73-9ac8-33a372a2381b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:03.535143 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f397d27-8449-4e73-9ac8-33a372a2381b None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:03.634719 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 633/1255] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:36:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 17:36:03.640697 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d59ab-3c1f-43a9-8265-0ac6b4eb475b None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:03.739456 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d59ab-3c1f-43a9-8265-0ac6b4eb475b None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:03.752504 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:03.772831 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc9349-aa58-458e-85e5-d21fc0f3e242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:03.773477 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc9349-aa58-458e-85e5-d21fc0f3e242 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:03.773761 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc9349-aa58-458e-85e5-d21fc0f3e242 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:03.774036 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc9349-aa58-458e-85e5-d21fc0f3e242 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:03.783628 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc9349-aa58-458e-85e5-d21fc0f3e242 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:03.785132 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc9349-aa58-458e-85e5-d21fc0f3e242 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:03.799954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-d0cc9349-aa58-458e-85e5-d21fc0f3e242 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:36:03.799954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:36:03.799954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:36:03.799954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:36:03.799954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:36:03.799954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:36:03.799954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:36:03.799954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:36:03.799954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:36:03.799954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:36:03.799954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:36:03.799954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:36:03.799954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:36:03.799954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:36:03.799954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:36:03.799954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:36:03.801169 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:36:03.801169 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:36:03.801169 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:36:03.801169 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:36:03.801169 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:36:03.801169 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:36:03.801169 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:36:03.801169 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:36:03.801169 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:36:03.801169 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:36:03.801169 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:36:03.801169 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:36:03.801169 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:36:03.801169 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:36:03.801169 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:36:03.801169 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:36:03.801169 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:36:03.802549 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:36:03.802549 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:36:03.802549 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:36:03.802549 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 623/1256] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:36:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:36:03.806826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f397d27-8449-4e73-9ac8-33a372a2381b None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:03.895635 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:03.908681 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f397d27-8449-4e73-9ac8-33a372a2381b None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:03.944199 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9dface-fd86-4ef3-a129-a743d9f23cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:03.944803 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9dface-fd86-4ef3-a129-a743d9f23cd2 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:03.945115 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9dface-fd86-4ef3-a129-a743d9f23cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:03.945393 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9dface-fd86-4ef3-a129-a743d9f23cd2 None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:03.946031 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9dface-fd86-4ef3-a129-a743d9f23cd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:36:03.946337 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9dface-fd86-4ef3-a129-a743d9f23cd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:03.947760 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9dface-fd86-4ef3-a129-a743d9f23cd2 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:03.959565 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 634/1257] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:36:03.965345 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc9349-aa58-458e-85e5-d21fc0f3e242 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:04.068958 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc9349-aa58-458e-85e5-d21fc0f3e242 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:04.102913 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edfb7e8-03d3-43df-9b8c-b68a81accb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:04.103538 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfb7e8-03d3-43df-9b8c-b68a81accb61 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:04.103818 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfb7e8-03d3-43df-9b8c-b68a81accb61 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:04.104091 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfb7e8-03d3-43df-9b8c-b68a81accb61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:04.110533 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edfb7e8-03d3-43df-9b8c-b68a81accb61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:04.111968 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edfb7e8-03d3-43df-9b8c-b68a81accb61 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:04.122856 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-6edfb7e8-03d3-43df-9b8c-b68a81accb61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:36:04.122856 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:36:04.122856 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:36:04.122856 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:36:04.122856 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:36:04.122856 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:36:04.122856 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:36:04.122856 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:36:04.122856 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:36:04.122856 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:36:04.122856 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:36:04.122856 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:36:04.122856 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:36:04.122856 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:36:04.122856 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:36:04.123841 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:36:04.123841 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:36:04.123841 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:36:04.123841 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:36:04.123841 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:36:04.123841 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:36:04.123841 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:36:04.123841 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:36:04.123841 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:36:04.123841 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:36:04.123841 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:36:04.123841 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:36:04.123841 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:36:04.123841 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:36:04.123841 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:36:04.123841 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:36:04.123841 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:36:04.125205 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:36:04.125205 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:36:04.125205 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:36:04.125205 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:36:04.125205 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:36:04.125205 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:36:04.125205 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:36:04.125205 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:36:04.125205 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 624/1258] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:36:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:36:04.130035 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9dface-fd86-4ef3-a129-a743d9f23cd2 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:04.229976 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9dface-fd86-4ef3-a129-a743d9f23cd2 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:04.262869 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351293e9-a777-4244-b591-17f7f14c81e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:04.263470 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351293e9-a777-4244-b591-17f7f14c81e2 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:04.263819 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351293e9-a777-4244-b591-17f7f14c81e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:04.264034 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351293e9-a777-4244-b591-17f7f14c81e2 None admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:04.264721 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351293e9-a777-4244-b591-17f7f14c81e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:36:04.265047 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351293e9-a777-4244-b591-17f7f14c81e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:04.266460 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351293e9-a777-4244-b591-17f7f14c81e2 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:04.279527 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 635/1259] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 8 17:36:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:36:04.285818 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edfb7e8-03d3-43df-9b8c-b68a81accb61 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:04.311067 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:04.387521 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edfb7e8-03d3-43df-9b8c-b68a81accb61 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:04.422436 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6565ef6-9f3b-406a-ad88-d13082a13691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:04.423033 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6565ef6-9f3b-406a-ad88-d13082a13691 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:04.423309 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6565ef6-9f3b-406a-ad88-d13082a13691 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:04.423579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6565ef6-9f3b-406a-ad88-d13082a13691 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:04.424293 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6565ef6-9f3b-406a-ad88-d13082a13691 None admin] RBAC: Adding query filter params (role.id=5c25aa917ab34baabb795c54dd8a4d02, scope.project.id=047a28b7cd11486da9d330723a384812, user.id=68717c19e74e434da825d9b1d6ca202a) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:36:04.424598 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6565ef6-9f3b-406a-ad88-d13082a13691 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:04.426126 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6565ef6-9f3b-406a-ad88-d13082a13691 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:04.431956 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 625/1260] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:36:04 2022] GET /identity/v3/role_assignments?user.id=68717c19e74e434da825d9b1d6ca202a&scope.project.id=047a28b7cd11486da9d330723a384812&role.id=5c25aa917ab34baabb795c54dd8a4d02 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:36:06.434669 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130352cd-8248-4f12-8098-3571cf741f00 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:06.435095 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130352cd-8248-4f12-8098-3571cf741f00 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:06.435224 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130352cd-8248-4f12-8098-3571cf741f00 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:06.436670 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 636/1261] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:36:06.441865 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41126ee3-0e63-49b2-8a26-7b375e8a414e None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:06.442320 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41126ee3-0e63-49b2-8a26-7b375e8a414e None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:06.442443 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41126ee3-0e63-49b2-8a26-7b375e8a414e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:06.460209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-41126ee3-0e63-49b2-8a26-7b375e8a414e None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:36:06.461454 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-41126ee3-0e63-49b2-8a26-7b375e8a414e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:36:06.529952 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 626/1262] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:36:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:36:06.553746 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130352cd-8248-4f12-8098-3571cf741f00 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:06.564841 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:06.658518 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130352cd-8248-4f12-8098-3571cf741f00 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:06.692671 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14869a97-f15d-47df-9a30-a4b52d14980b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:06.693418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14869a97-f15d-47df-9a30-a4b52d14980b None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:06.693603 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14869a97-f15d-47df-9a30-a4b52d14980b None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:06.693874 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14869a97-f15d-47df-9a30-a4b52d14980b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:06.703868 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14869a97-f15d-47df-9a30-a4b52d14980b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:36:06.709338 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-14869a97-f15d-47df-9a30-a4b52d14980b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:36:06.709338 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:36:06.709338 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:36:06.709338 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:36:06.709338 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:36:06.709338 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:36:06.709338 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:36:06.709338 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:36:06.709338 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:36:06.709338 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:36:06.709338 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:36:06.709338 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:36:06.709338 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:36:06.709338 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:36:06.709338 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:36:06.709338 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:36:06.712185 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:36:06.712185 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:36:06.712185 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:36:06.712185 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:36:06.712185 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:36:06.712185 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:36:06.712185 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:36:06.712185 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:36:06.712185 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:36:06.712185 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:36:06.712185 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:36:06.712185 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:36:06.712185 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:36:06.712185 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:36:06.712185 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:36:06.712185 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:36:06.713309 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:36:06.713309 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:36:06.713309 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:36:06.713309 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:36:06.713309 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:36:06.713309 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:36:06.713309 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:36:06.713309 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:36:06.713309 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:36:06.713309 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:36:06.713309 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:36:06.713309 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:36:06.713309 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 637/1263] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 8 17:36:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:36:06.717774 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41126ee3-0e63-49b2-8a26-7b375e8a414e None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:06.737101 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:06.818203 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41126ee3-0e63-49b2-8a26-7b375e8a414e None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:06.853343 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f7c98-c88a-4ff1-8b6f-13678d684e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:06.853952 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f7c98-c88a-4ff1-8b6f-13678d684e9e None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:06.854236 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f7c98-c88a-4ff1-8b6f-13678d684e9e None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:06.854510 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f7c98-c88a-4ff1-8b6f-13678d684e9e None admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:06.855173 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f7c98-c88a-4ff1-8b6f-13678d684e9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:36:06.855477 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f7c98-c88a-4ff1-8b6f-13678d684e9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:06.856846 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f7c98-c88a-4ff1-8b6f-13678d684e9e None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:06.865309 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 627/1264] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:36:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:36:06.871535 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14869a97-f15d-47df-9a30-a4b52d14980b None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:06.939422 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:06.971536 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14869a97-f15d-47df-9a30-a4b52d14980b None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:07.004618 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2a6c9-113d-442b-833e-3fa7fe2a1104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:07.005260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2a6c9-113d-442b-833e-3fa7fe2a1104 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:07.006432 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2a6c9-113d-442b-833e-3fa7fe2a1104 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:07.007396 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2a6c9-113d-442b-833e-3fa7fe2a1104 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:07.017750 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2a6c9-113d-442b-833e-3fa7fe2a1104 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:07.019184 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2a6c9-113d-442b-833e-3fa7fe2a1104 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:07.034395 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-fea2a6c9-113d-442b-833e-3fa7fe2a1104 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:36:07.034395 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:36:07.034395 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:36:07.034395 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:36:07.034395 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:36:07.034395 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:36:07.034395 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:36:07.034395 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:36:07.034395 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:36:07.034395 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:36:07.034395 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:36:07.034395 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:36:07.034395 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:36:07.034395 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:36:07.034395 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:36:07.034395 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:36:07.035578 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:36:07.035578 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:36:07.035578 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:36:07.035578 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:36:07.035578 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:36:07.035578 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:36:07.035578 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:36:07.035578 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:36:07.035578 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:36:07.035578 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:36:07.035578 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:36:07.035578 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:36:07.035578 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:36:07.035578 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:36:07.035578 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:36:07.035578 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:36:07.035578 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:36:07.036746 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:36:07.036746 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:36:07.036746 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:36:07.036746 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 638/1265] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:36:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:36:07.041217 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f7c98-c88a-4ff1-8b6f-13678d684e9e None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:07.121863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:07.140969 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f7c98-c88a-4ff1-8b6f-13678d684e9e None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:07.175555 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea88524-80d3-4bfc-8bec-85d5cfb7d98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:07.176144 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea88524-80d3-4bfc-8bec-85d5cfb7d98d None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:07.176422 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea88524-80d3-4bfc-8bec-85d5cfb7d98d None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:07.176692 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea88524-80d3-4bfc-8bec-85d5cfb7d98d None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:07.177986 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea88524-80d3-4bfc-8bec-85d5cfb7d98d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:36:07.178319 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea88524-80d3-4bfc-8bec-85d5cfb7d98d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:07.179688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea88524-80d3-4bfc-8bec-85d5cfb7d98d None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:07.190553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 628/1266] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:36:07.196809 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2a6c9-113d-442b-833e-3fa7fe2a1104 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:07.298456 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2a6c9-113d-442b-833e-3fa7fe2a1104 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:07.318864 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:07.332386 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fce55-8250-416f-81ad-1e903d36780d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:07.333011 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fce55-8250-416f-81ad-1e903d36780d None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:07.333325 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fce55-8250-416f-81ad-1e903d36780d None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:07.333786 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fce55-8250-416f-81ad-1e903d36780d None admin] PATH_INFO: `/v3/users/placement` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:07.341168 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fce55-8250-416f-81ad-1e903d36780d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:07.342724 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fce55-8250-416f-81ad-1e903d36780d None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:07.354118 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-245fce55-8250-416f-81ad-1e903d36780d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 08 17:36:07.354118 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:36:07.354118 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:36:07.354118 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:36:07.354118 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:36:07.354118 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:36:07.354118 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:36:07.354118 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:36:07.354118 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:36:07.354118 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:36:07.354118 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:36:07.354118 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:36:07.354118 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:36:07.354118 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:36:07.354118 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:36:07.354118 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:36:07.357557 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:36:07.357557 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:36:07.357557 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:36:07.357557 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:36:07.357557 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:36:07.357557 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:36:07.357557 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:36:07.357557 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:36:07.357557 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:36:07.357557 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:36:07.357557 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:36:07.357557 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:36:07.357557 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:36:07.357557 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:36:07.357557 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:36:07.357557 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:36:07.357557 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:36:07.357557 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:36:07.358705 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:36:07.358705 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:36:07.358705 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:36:07.358705 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:36:07.358705 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:36:07.358705 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:36:07.358705 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:36:07.358705 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:36:07.358705 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 08 17:36:07.358705 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:36:07.358705 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 639/1267] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:36:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:36:07.361186 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea88524-80d3-4bfc-8bec-85d5cfb7d98d None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:07.463926 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea88524-80d3-4bfc-8bec-85d5cfb7d98d None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:07.498127 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895ab7b-a465-40ed-ab11-659319fca185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:07.498719 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895ab7b-a465-40ed-ab11-659319fca185 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:07.498998 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895ab7b-a465-40ed-ab11-659319fca185 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:07.499271 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895ab7b-a465-40ed-ab11-659319fca185 None admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:07.499986 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895ab7b-a465-40ed-ab11-659319fca185 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:36:07.500290 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895ab7b-a465-40ed-ab11-659319fca185 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:07.501752 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895ab7b-a465-40ed-ab11-659319fca185 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:07.510633 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:07.518530 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 629/1268] 10.222.0.70 () {56 vars in 1143 bytes} [Mon Aug 8 17:36:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:36:07.524926 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fce55-8250-416f-81ad-1e903d36780d None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:07.622850 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fce55-8250-416f-81ad-1e903d36780d None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:07.655484 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed276ce-b415-476b-91f3-7461314e8e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:07.656113 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed276ce-b415-476b-91f3-7461314e8e21 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:07.656390 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed276ce-b415-476b-91f3-7461314e8e21 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:07.656659 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed276ce-b415-476b-91f3-7461314e8e21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:07.667490 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed276ce-b415-476b-91f3-7461314e8e21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:07.668924 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed276ce-b415-476b-91f3-7461314e8e21 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:07.682644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-5ed276ce-b415-476b-91f3-7461314e8e21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:36:07.682644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:36:07.682644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:36:07.682644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:36:07.682644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:36:07.682644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:36:07.682644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:36:07.682644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:36:07.682644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:36:07.682644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:36:07.682644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:36:07.682644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:36:07.682644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:36:07.682644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:36:07.682644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:36:07.682644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:36:07.683871 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:36:07.683871 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:36:07.683871 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:36:07.683871 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:36:07.683871 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:36:07.683871 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:36:07.683871 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:36:07.683871 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:36:07.683871 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:36:07.683871 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:36:07.683871 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:36:07.683871 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:36:07.683871 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:36:07.683871 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:36:07.683871 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:36:07.683871 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:36:07.683871 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:36:07.685211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:36:07.685211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:36:07.685211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:36:07.685211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 640/1269] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:36:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:36:07.689820 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895ab7b-a465-40ed-ab11-659319fca185 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:07.790642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895ab7b-a465-40ed-ab11-659319fca185 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:07.824236 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1cd74-fb7d-4ac8-b8dc-9687af324773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:07.824837 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1cd74-fb7d-4ac8-b8dc-9687af324773 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:07.825146 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1cd74-fb7d-4ac8-b8dc-9687af324773 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:07.825418 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1cd74-fb7d-4ac8-b8dc-9687af324773 None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:07.826056 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c1cd74-fb7d-4ac8-b8dc-9687af324773 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:36:07.826357 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c1cd74-fb7d-4ac8-b8dc-9687af324773 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:07.827744 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c1cd74-fb7d-4ac8-b8dc-9687af324773 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:07.839834 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 630/1270] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:36:07.845644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed276ce-b415-476b-91f3-7461314e8e21 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:07.879413 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:07.952851 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed276ce-b415-476b-91f3-7461314e8e21 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:07.987306 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf342bd-8e7c-43c1-9651-f7b7b7629a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:07.987997 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf342bd-8e7c-43c1-9651-f7b7b7629a03 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:07.988325 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf342bd-8e7c-43c1-9651-f7b7b7629a03 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:07.988598 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf342bd-8e7c-43c1-9651-f7b7b7629a03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:07.995584 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf342bd-8e7c-43c1-9651-f7b7b7629a03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:07.997097 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf342bd-8e7c-43c1-9651-f7b7b7629a03 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:08.008792 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-9cf342bd-8e7c-43c1-9651-f7b7b7629a03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:36:08.008792 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:36:08.008792 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:36:08.008792 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:36:08.008792 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:36:08.008792 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:36:08.008792 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:36:08.008792 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:36:08.008792 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:36:08.008792 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:36:08.008792 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:36:08.008792 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:36:08.008792 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:36:08.008792 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:36:08.008792 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:36:08.015239 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:36:08.015239 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:36:08.015239 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:36:08.015239 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:36:08.015239 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:36:08.015239 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:36:08.015239 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:36:08.015239 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:36:08.015239 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:36:08.015239 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:36:08.015239 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:36:08.015239 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:36:08.015239 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:36:08.015239 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:36:08.015239 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:36:08.015239 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:36:08.015239 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:36:08.016153 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:36:08.016153 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:36:08.016153 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:36:08.016153 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:36:08.016153 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:36:08.016153 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:36:08.016153 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:36:08.016153 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:36:08.016153 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 641/1271] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:36:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 17:36:08.016648 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1cd74-fb7d-4ac8-b8dc-9687af324773 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:08.073547 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:08.114060 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1cd74-fb7d-4ac8-b8dc-9687af324773 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:08.146288 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02a633-a29e-46eb-adaa-07322a23577a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:08.146813 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02a633-a29e-46eb-adaa-07322a23577a None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:08.147088 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02a633-a29e-46eb-adaa-07322a23577a None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:08.147356 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02a633-a29e-46eb-adaa-07322a23577a None admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:08.148080 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02a633-a29e-46eb-adaa-07322a23577a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:36:08.148387 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02a633-a29e-46eb-adaa-07322a23577a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:08.149828 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02a633-a29e-46eb-adaa-07322a23577a None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:08.162134 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 631/1272] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 8 17:36:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:36:08.168397 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf342bd-8e7c-43c1-9651-f7b7b7629a03 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:08.261263 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:08.269926 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf342bd-8e7c-43c1-9651-f7b7b7629a03 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:08.306515 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c976b86-a335-4db6-9df3-db03d4e99ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:08.307263 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c976b86-a335-4db6-9df3-db03d4e99ef3 None admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:08.307548 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c976b86-a335-4db6-9df3-db03d4e99ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:08.307822 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c976b86-a335-4db6-9df3-db03d4e99ef3 None admin] PATH_INFO: `/v3/projects/047a28b7cd11486da9d330723a384812/users/68717c19e74e434da825d9b1d6ca202a/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:08.309729 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c976b86-a335-4db6-9df3-db03d4e99ef3 None admin] RBAC: Authorizing `identity:create_grant(project_id=047a28b7cd11486da9d330723a384812, user_id=68717c19e74e434da825d9b1d6ca202a, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:08.311218 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c976b86-a335-4db6-9df3-db03d4e99ef3 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:08.550377 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 642/1273] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 8 17:36:08 2022] PUT /identity/v3/projects/047a28b7cd11486da9d330723a384812/users/68717c19e74e434da825d9b1d6ca202a/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:36:10.556608 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7c690-d083-46dc-90db-af6a50aae01b None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:10.557192 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7c690-d083-46dc-90db-af6a50aae01b None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:10.557192 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7c690-d083-46dc-90db-af6a50aae01b None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:10.558613 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 632/1274] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:36:10.563707 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c604c1-c0dc-4c5c-983b-eb54f7120d94 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:10.564107 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c604c1-c0dc-4c5c-983b-eb54f7120d94 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:10.564252 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c604c1-c0dc-4c5c-983b-eb54f7120d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:10.583589 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-d5c604c1-c0dc-4c5c-983b-eb54f7120d94 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:36:10.584814 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-d5c604c1-c0dc-4c5c-983b-eb54f7120d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:36:10.652962 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 643/1275] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:36:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:36:10.676238 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7c690-d083-46dc-90db-af6a50aae01b None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:10.778958 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7c690-d083-46dc-90db-af6a50aae01b None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:10.796240 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:10.812801 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacbe0d-4711-4018-b285-7edfc1054f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:10.813458 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacbe0d-4711-4018-b285-7edfc1054f2f None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:10.813737 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacbe0d-4711-4018-b285-7edfc1054f2f None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:10.814008 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacbe0d-4711-4018-b285-7edfc1054f2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:10.823745 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbacbe0d-4711-4018-b285-7edfc1054f2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 17:36:10.828293 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-bbacbe0d-4711-4018-b285-7edfc1054f2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:36:10.828293 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:36:10.828293 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:36:10.828293 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:36:10.828293 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:36:10.828293 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:36:10.828293 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:36:10.828293 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:36:10.828293 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:36:10.828293 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:36:10.828293 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:36:10.828293 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:36:10.828293 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 17:36:10.828293 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 17:36:10.828293 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 17:36:10.828293 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 17:36:10.829280 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 17:36:10.829280 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 17:36:10.829280 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 17:36:10.829280 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 17:36:10.829280 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:36:10.829280 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:36:10.829280 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:36:10.829280 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:36:10.829280 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:36:10.829280 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:36:10.829280 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:36:10.829280 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:36:10.829280 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:36:10.829280 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:36:10.829280 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:36:10.829280 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:36:10.830180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:36:10.830180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:36:10.830180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:36:10.830180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:36:10.830180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 17:36:10.830180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 17:36:10.830180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 17:36:10.830180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 17:36:10.830180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 17:36:10.830180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 17:36:10.830180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 17:36:10.830180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:36:10.830180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 633/1276] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 8 17:36:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:36:10.835911 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c604c1-c0dc-4c5c-983b-eb54f7120d94 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:10.915985 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:10.934085 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c604c1-c0dc-4c5c-983b-eb54f7120d94 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:10.966823 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0931b-f911-470f-9fb7-fd8d9ed954fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:10.967428 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0931b-f911-470f-9fb7-fd8d9ed954fd None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:10.967708 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0931b-f911-470f-9fb7-fd8d9ed954fd None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:10.967980 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0931b-f911-470f-9fb7-fd8d9ed954fd None admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:10.968685 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b0931b-f911-470f-9fb7-fd8d9ed954fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:36:10.968979 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b0931b-f911-470f-9fb7-fd8d9ed954fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:10.970485 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b0931b-f911-470f-9fb7-fd8d9ed954fd None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:10.979294 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 644/1277] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 8 17:36:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:36:10.985157 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacbe0d-4711-4018-b285-7edfc1054f2f None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:11.088300 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacbe0d-4711-4018-b285-7edfc1054f2f None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:11.123759 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524711a0-522e-4d7e-952c-8885ea471a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:11.124540 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524711a0-522e-4d7e-952c-8885ea471a6f None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:11.124823 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524711a0-522e-4d7e-952c-8885ea471a6f None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:11.125124 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524711a0-522e-4d7e-952c-8885ea471a6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:11.134946 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524711a0-522e-4d7e-952c-8885ea471a6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:11.136478 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524711a0-522e-4d7e-952c-8885ea471a6f None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:11.151166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-524711a0-522e-4d7e-952c-8885ea471a6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:36:11.151166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:36:11.151166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:36:11.151166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:36:11.151166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:36:11.151166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:36:11.151166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:36:11.151166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:36:11.151166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:36:11.151166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:36:11.151166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:36:11.151166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:36:11.151166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:36:11.151166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:36:11.151166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:36:11.151166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:36:11.154616 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:36:11.154616 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:36:11.154616 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:36:11.154616 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:36:11.154616 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:36:11.154616 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:36:11.154616 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:36:11.154616 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:36:11.154616 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:36:11.154616 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:36:11.154616 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:36:11.154616 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:36:11.154616 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:36:11.154616 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:36:11.154616 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:36:11.154616 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:36:11.154616 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:36:11.155784 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:36:11.155784 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:36:11.155784 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:36:11.155784 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 634/1278] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:36:11.157989 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0931b-f911-470f-9fb7-fd8d9ed954fd None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:11.257116 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0931b-f911-470f-9fb7-fd8d9ed954fd None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:11.291189 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2691b2-2194-4035-bebb-f7176e22c78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:11.291785 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2691b2-2194-4035-bebb-f7176e22c78e None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:11.292062 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2691b2-2194-4035-bebb-f7176e22c78e None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:11.292331 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2691b2-2194-4035-bebb-f7176e22c78e None admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:11.292960 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2691b2-2194-4035-bebb-f7176e22c78e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:36:11.293286 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2691b2-2194-4035-bebb-f7176e22c78e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:11.294627 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2691b2-2194-4035-bebb-f7176e22c78e None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:11.305931 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 645/1279] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:36:11.312605 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524711a0-522e-4d7e-952c-8885ea471a6f None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:11.343750 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:11.414944 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524711a0-522e-4d7e-952c-8885ea471a6f None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:11.447982 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba6fc1-e848-47e7-9d58-cbb3c1789f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:11.448602 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba6fc1-e848-47e7-9d58-cbb3c1789f2c None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:11.448882 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba6fc1-e848-47e7-9d58-cbb3c1789f2c None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:11.449187 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba6fc1-e848-47e7-9d58-cbb3c1789f2c None admin] PATH_INFO: `/v3/users/placement` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:11.456014 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba6fc1-e848-47e7-9d58-cbb3c1789f2c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:11.457498 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba6fc1-e848-47e7-9d58-cbb3c1789f2c None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:11.469249 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-13ba6fc1-e848-47e7-9d58-cbb3c1789f2c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 08 17:36:11.469249 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:36:11.469249 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:36:11.469249 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:36:11.469249 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:36:11.469249 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:36:11.469249 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:36:11.469249 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:36:11.469249 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:36:11.469249 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:36:11.469249 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:36:11.469249 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:36:11.469249 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 17:36:11.469249 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 17:36:11.469249 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 17:36:11.469249 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 17:36:11.470393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:36:11.470393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:36:11.470393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 17:36:11.470393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:36:11.470393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 17:36:11.470393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 17:36:11.470393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:36:11.470393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:36:11.470393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:36:11.470393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:36:11.470393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:36:11.470393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:36:11.470393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:36:11.470393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:36:11.470393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:36:11.470393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:36:11.470393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:36:11.470393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:36:11.471730 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:36:11.471730 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:36:11.471730 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 17:36:11.471730 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 17:36:11.471730 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 17:36:11.471730 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 17:36:11.471730 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 17:36:11.471730 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 17:36:11.471730 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 08 17:36:11.471730 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:36:11.471730 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 635/1280] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:36:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:36:11.477014 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2691b2-2194-4035-bebb-f7176e22c78e None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:11.480691 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:11.575565 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2691b2-2194-4035-bebb-f7176e22c78e None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:11.610201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1620d-680c-451f-9805-06dbd62ac3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:11.615576 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1620d-680c-451f-9805-06dbd62ac3fe None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:11.615576 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1620d-680c-451f-9805-06dbd62ac3fe None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:11.615576 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1620d-680c-451f-9805-06dbd62ac3fe None admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:11.615576 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f1620d-680c-451f-9805-06dbd62ac3fe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:36:11.615576 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f1620d-680c-451f-9805-06dbd62ac3fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:11.615576 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f1620d-680c-451f-9805-06dbd62ac3fe None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:11.631293 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 646/1281] 10.222.0.70 () {56 vars in 1143 bytes} [Mon Aug 8 17:36:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:36:11.637225 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba6fc1-e848-47e7-9d58-cbb3c1789f2c None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:11.727392 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:11.736668 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba6fc1-e848-47e7-9d58-cbb3c1789f2c None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:11.770157 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db4046-279d-4406-bef6-824c153812e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:11.771425 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db4046-279d-4406-bef6-824c153812e9 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:11.771873 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db4046-279d-4406-bef6-824c153812e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:11.772148 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db4046-279d-4406-bef6-824c153812e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:11.840763 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db4046-279d-4406-bef6-824c153812e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:11.842209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db4046-279d-4406-bef6-824c153812e9 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:11.930547 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:11.940486 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 636/1282] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 8 17:36:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 17:36:11.947172 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1620d-680c-451f-9805-06dbd62ac3fe None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:12.012462 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:12.050495 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1620d-680c-451f-9805-06dbd62ac3fe None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:12.086809 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee84715-43e9-4320-8501-59081642d608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:12.087463 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee84715-43e9-4320-8501-59081642d608 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:12.087784 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee84715-43e9-4320-8501-59081642d608 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:12.088055 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee84715-43e9-4320-8501-59081642d608 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:12.098080 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee84715-43e9-4320-8501-59081642d608 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:12.099932 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee84715-43e9-4320-8501-59081642d608 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:12.115545 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-2ee84715-43e9-4320-8501-59081642d608 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:36:12.115545 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:36:12.115545 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:36:12.115545 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:36:12.115545 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:36:12.115545 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:36:12.115545 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:36:12.115545 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:36:12.115545 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:36:12.115545 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:36:12.115545 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:36:12.115545 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:36:12.115545 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 17:36:12.115545 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 17:36:12.115545 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 17:36:12.115545 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 17:36:12.117985 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:36:12.117985 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:36:12.117985 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:36:12.117985 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:36:12.117985 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:36:12.117985 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:36:12.117985 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:36:12.117985 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:36:12.117985 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:36:12.117985 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:36:12.117985 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:36:12.117985 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:36:12.117985 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:36:12.117985 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:36:12.117985 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:36:12.117985 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:36:12.117985 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 17:36:12.119135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 17:36:12.119135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 17:36:12.119135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:36:12.119135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 647/1283] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:36:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:36:12.122579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db4046-279d-4406-bef6-824c153812e9 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:12.221884 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db4046-279d-4406-bef6-824c153812e9 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:12.256544 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9358a9c-7308-460a-8081-0e26bbc8249b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:12.257202 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9358a9c-7308-460a-8081-0e26bbc8249b None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:12.257481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9358a9c-7308-460a-8081-0e26bbc8249b None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:12.257749 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9358a9c-7308-460a-8081-0e26bbc8249b None admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:12.258379 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9358a9c-7308-460a-8081-0e26bbc8249b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:36:12.258675 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9358a9c-7308-460a-8081-0e26bbc8249b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:12.260023 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9358a9c-7308-460a-8081-0e26bbc8249b None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:12.270929 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 637/1284] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 8 17:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:36:12.276727 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee84715-43e9-4320-8501-59081642d608 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:12.388827 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee84715-43e9-4320-8501-59081642d608 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:12.405170 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:12.429298 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1655b2-8360-466c-90e0-6e35dbeb9d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:12.429950 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1655b2-8360-466c-90e0-6e35dbeb9d44 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:12.430234 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1655b2-8360-466c-90e0-6e35dbeb9d44 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:12.430507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1655b2-8360-466c-90e0-6e35dbeb9d44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:12.437911 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1655b2-8360-466c-90e0-6e35dbeb9d44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:12.439373 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1655b2-8360-466c-90e0-6e35dbeb9d44 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:12.452264 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application [None req-fb1655b2-8360-466c-90e0-6e35dbeb9d44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:36:12.452264 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:36:12.452264 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:36:12.452264 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:36:12.452264 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:36:12.452264 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:36:12.452264 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:36:12.452264 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:36:12.452264 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:36:12.452264 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:36:12.452264 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:36:12.452264 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:36:12.452264 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 17:36:12.452264 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 17:36:12.452264 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 17:36:12.453465 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 17:36:12.453465 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:36:12.453465 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:36:12.453465 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:36:12.453465 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:36:12.453465 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:36:12.453465 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:36:12.453465 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:36:12.453465 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application with Lock( Aug 08 17:36:12.453465 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:36:12.453465 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:36:12.453465 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:36:12.453465 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:36:12.453465 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:36:12.453465 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:36:12.453465 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:36:12.453465 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:36:12.454619 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 17:36:12.454619 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 17:36:12.454619 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 17:36:12.454619 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 17:36:12.454619 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 17:36:12.454619 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 17:36:12.454619 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 17:36:12.454619 dv-cinder-852364-1-smb devstack@keystone.service[86919]: ERROR keystone.server.flask.application Aug 08 17:36:12.454619 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 648/1285] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 8 17:36:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:36:12.459641 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9358a9c-7308-460a-8081-0e26bbc8249b None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:12.514865 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:12.568235 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9358a9c-7308-460a-8081-0e26bbc8249b None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:12.604142 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d2e9c-29d7-4f2b-b795-982a62a43c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:12.604754 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d2e9c-29d7-4f2b-b795-982a62a43c9b None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:12.605054 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d2e9c-29d7-4f2b-b795-982a62a43c9b None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:12.605330 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d2e9c-29d7-4f2b-b795-982a62a43c9b None admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:12.606028 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d2e9c-29d7-4f2b-b795-982a62a43c9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:36:12.606330 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d2e9c-29d7-4f2b-b795-982a62a43c9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:12.607767 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d2e9c-29d7-4f2b-b795-982a62a43c9b None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:12.622640 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 638/1286] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 8 17:36:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:36:12.628334 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1655b2-8360-466c-90e0-6e35dbeb9d44 None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:12.735386 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1655b2-8360-466c-90e0-6e35dbeb9d44 None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:12.770122 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26b6c2-cb0d-4ae3-a7b1-ba31ce65b43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:12.771773 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26b6c2-cb0d-4ae3-a7b1-ba31ce65b43b None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:12.772057 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26b6c2-cb0d-4ae3-a7b1-ba31ce65b43b None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:12.772327 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26b6c2-cb0d-4ae3-a7b1-ba31ce65b43b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:12.773066 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26b6c2-cb0d-4ae3-a7b1-ba31ce65b43b None admin] RBAC: Adding query filter params (role.id=5c25aa917ab34baabb795c54dd8a4d02, scope.project.id=047a28b7cd11486da9d330723a384812, user.id=68717c19e74e434da825d9b1d6ca202a) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:36:12.773491 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26b6c2-cb0d-4ae3-a7b1-ba31ce65b43b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:12.774896 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26b6c2-cb0d-4ae3-a7b1-ba31ce65b43b None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:12.780810 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 649/1287] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 8 17:36:12 2022] GET /identity/v3/role_assignments?user.id=68717c19e74e434da825d9b1d6ca202a&scope.project.id=047a28b7cd11486da9d330723a384812&role.id=5c25aa917ab34baabb795c54dd8a4d02 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:36:14.815843 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a8409-d3c6-4c70-8fac-322408b89b34 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:14.816382 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a8409-d3c6-4c70-8fac-322408b89b34 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:14.816382 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a8409-d3c6-4c70-8fac-322408b89b34 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:14.817998 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 639/1288] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:36:14.823071 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135e1fe-cb73-496c-9810-822b79b4bd02 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:14.823495 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135e1fe-cb73-496c-9810-822b79b4bd02 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:14.823635 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135e1fe-cb73-496c-9810-822b79b4bd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:14.841870 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-d135e1fe-cb73-496c-9810-822b79b4bd02 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:36:14.843075 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-d135e1fe-cb73-496c-9810-822b79b4bd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:36:14.873886 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:14.912282 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 650/1289] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:36:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:36:14.934581 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a8409-d3c6-4c70-8fac-322408b89b34 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:15.036948 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a8409-d3c6-4c70-8fac-322408b89b34 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:15.047556 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:15.070449 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243dd95e-760c-4103-ab25-ddf0597f28c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:15.071029 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243dd95e-760c-4103-ab25-ddf0597f28c1 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:15.071309 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243dd95e-760c-4103-ab25-ddf0597f28c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:15.071582 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243dd95e-760c-4103-ab25-ddf0597f28c1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:15.072155 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243dd95e-760c-4103-ab25-ddf0597f28c1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:15.073610 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243dd95e-760c-4103-ab25-ddf0597f28c1 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:15.082028 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-243dd95e-760c-4103-ab25-ddf0597f28c1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 17:36:15.082028 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:36:15.082028 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 17:36:15.082028 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 17:36:15.082028 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 17:36:15.082028 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 17:36:15.082028 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 17:36:15.082028 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:36:15.082028 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 17:36:15.082028 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:36:15.082028 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 17:36:15.082028 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:36:15.082028 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:36:15.082028 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:36:15.082028 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:36:15.082028 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:36:15.082028 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:36:15.083908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:36:15.083908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:36:15.083908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:36:15.083908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:36:15.083908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:36:15.083908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:36:15.083908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 17:36:15.083908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 17:36:15.083908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 17:36:15.083908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 17:36:15.083908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:36:15.083908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:36:15.083908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:36:15.083908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:36:15.083908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:36:15.083908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:36:15.084776 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:36:15.084776 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:36:15.084776 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:36:15.084776 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:36:15.084776 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:36:15.084776 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:36:15.084776 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:36:15.084776 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:36:15.084776 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:36:15.084776 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:36:15.084776 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 17:36:15.084776 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:36:15.084776 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 17:36:15.084776 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:36:15.084776 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 640/1290] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Aug 8 17:36:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:36:15.089904 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135e1fe-cb73-496c-9810-822b79b4bd02 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:15.187472 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135e1fe-cb73-496c-9810-822b79b4bd02 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:15.221004 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367e1f8-4def-4add-a57f-c9a0462e3e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:15.221657 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367e1f8-4def-4add-a57f-c9a0462e3e7a None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:15.221941 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367e1f8-4def-4add-a57f-c9a0462e3e7a None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:15.222319 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367e1f8-4def-4add-a57f-c9a0462e3e7a None admin] PATH_INFO: `/v3/services` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:15.222948 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367e1f8-4def-4add-a57f-c9a0462e3e7a None admin] RBAC: Adding query filter params (name=placement) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:36:15.224121 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367e1f8-4def-4add-a57f-c9a0462e3e7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:15.225520 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367e1f8-4def-4add-a57f-c9a0462e3e7a None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:15.230245 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 651/1291] 10.222.0.70 () {56 vars in 1116 bytes} [Mon Aug 8 17:36:15 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:36:15.236008 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243dd95e-760c-4103-ab25-ddf0597f28c1 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:15.336062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243dd95e-760c-4103-ab25-ddf0597f28c1 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:15.371350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40140ada-f411-4186-ba82-b45f5cd4b13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:15.371953 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40140ada-f411-4186-ba82-b45f5cd4b13b None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:15.372240 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40140ada-f411-4186-ba82-b45f5cd4b13b None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:15.372516 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40140ada-f411-4186-ba82-b45f5cd4b13b None admin] PATH_INFO: `/v3/services` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:15.373185 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40140ada-f411-4186-ba82-b45f5cd4b13b None admin] RBAC: Adding query filter params (type=placement) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:36:15.373486 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40140ada-f411-4186-ba82-b45f5cd4b13b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:15.374855 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40140ada-f411-4186-ba82-b45f5cd4b13b None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:15.379566 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 641/1292] 10.222.0.70 () {56 vars in 1116 bytes} [Mon Aug 8 17:36:15 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:36:17.391080 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a77b98-cdf6-4fec-ab2e-908ec87c5557 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:17.391627 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a77b98-cdf6-4fec-ab2e-908ec87c5557 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:17.391627 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a77b98-cdf6-4fec-ab2e-908ec87c5557 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:17.392951 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 652/1293] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:36:17.398623 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800db091-cb46-4983-97ea-60dd39a7fb5e None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:17.399038 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800db091-cb46-4983-97ea-60dd39a7fb5e None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:17.399173 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800db091-cb46-4983-97ea-60dd39a7fb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:17.417643 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-800db091-cb46-4983-97ea-60dd39a7fb5e None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:36:17.422132 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-800db091-cb46-4983-97ea-60dd39a7fb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:36:17.448698 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:17.484926 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 642/1294] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:36:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:36:17.507890 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a77b98-cdf6-4fec-ab2e-908ec87c5557 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:17.539858 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:17.611663 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a77b98-cdf6-4fec-ab2e-908ec87c5557 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:17.646164 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429bceb-013b-4697-b19c-cdf9388777a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:17.646704 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429bceb-013b-4697-b19c-cdf9388777a4 None admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:17.646981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429bceb-013b-4697-b19c-cdf9388777a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:17.647251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429bceb-013b-4697-b19c-cdf9388777a4 None admin] PATH_INFO: `/v3/services` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:17.647899 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8429bceb-013b-4697-b19c-cdf9388777a4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:17.649299 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8429bceb-013b-4697-b19c-cdf9388777a4 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:17.766845 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 653/1295] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Aug 8 17:36:17 2022] POST /identity/v3/services => generated 246 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:36:19.795400 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73052dd4-bd15-4198-b12f-cd729be85323 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:19.795935 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73052dd4-bd15-4198-b12f-cd729be85323 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:19.795935 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73052dd4-bd15-4198-b12f-cd729be85323 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:19.797332 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 643/1296] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:36:19.802572 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea662f-1299-415a-97e5-72159942800c None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:19.802998 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea662f-1299-415a-97e5-72159942800c None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:19.803104 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea662f-1299-415a-97e5-72159942800c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:19.821690 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-abea662f-1299-415a-97e5-72159942800c None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:36:19.823041 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-abea662f-1299-415a-97e5-72159942800c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:36:19.895559 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 654/1297] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:36:19 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:36:19.918066 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73052dd4-bd15-4198-b12f-cd729be85323 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:20.019605 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73052dd4-bd15-4198-b12f-cd729be85323 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:20.052896 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07d917-f90d-4517-a873-bfdeb1ac7419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:20.053468 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07d917-f90d-4517-a873-bfdeb1ac7419 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:20.053745 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07d917-f90d-4517-a873-bfdeb1ac7419 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:20.054015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07d917-f90d-4517-a873-bfdeb1ac7419 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:20.054583 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07d917-f90d-4517-a873-bfdeb1ac7419 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:20.055982 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07d917-f90d-4517-a873-bfdeb1ac7419 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:20.064723 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-4c07d917-f90d-4517-a873-bfdeb1ac7419 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 17:36:20.064723 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:36:20.064723 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 17:36:20.064723 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 17:36:20.064723 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 17:36:20.064723 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 17:36:20.064723 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 17:36:20.064723 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:36:20.064723 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 17:36:20.064723 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:36:20.064723 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 17:36:20.064723 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:36:20.064723 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:36:20.064723 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:36:20.064723 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:36:20.064723 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:36:20.064723 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:36:20.066019 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:36:20.066019 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:36:20.066019 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:36:20.066019 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:36:20.066019 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:36:20.066019 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:36:20.066019 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 17:36:20.066019 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 17:36:20.066019 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 17:36:20.066019 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 17:36:20.066019 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:36:20.066019 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:36:20.066019 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:36:20.066019 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:36:20.066019 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:36:20.066019 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:36:20.067798 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:36:20.067798 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:36:20.067798 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:36:20.067798 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:36:20.067798 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:36:20.067798 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:36:20.067798 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:36:20.067798 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:36:20.067798 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:36:20.067798 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:36:20.067798 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 17:36:20.067798 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:36:20.067798 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 17:36:20.067798 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:36:20.067798 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 644/1298] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Aug 8 17:36:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:36:20.072464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea662f-1299-415a-97e5-72159942800c None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:20.091475 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:20.168946 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea662f-1299-415a-97e5-72159942800c None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:20.203836 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583dd1f-030e-4465-9420-56cd8f63235f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:20.204436 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583dd1f-030e-4465-9420-56cd8f63235f None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:20.204715 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583dd1f-030e-4465-9420-56cd8f63235f None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:20.205049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583dd1f-030e-4465-9420-56cd8f63235f None admin] PATH_INFO: `/v3/services` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:20.205700 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6583dd1f-030e-4465-9420-56cd8f63235f None admin] RBAC: Adding query filter params (name=placement) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:36:20.206186 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6583dd1f-030e-4465-9420-56cd8f63235f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:20.207854 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6583dd1f-030e-4465-9420-56cd8f63235f None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:20.213639 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 655/1299] 10.222.0.70 () {56 vars in 1116 bytes} [Mon Aug 8 17:36:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:36:20.219553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07d917-f90d-4517-a873-bfdeb1ac7419 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:20.251312 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:20.318427 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07d917-f90d-4517-a873-bfdeb1ac7419 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:20.353233 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367437d-4d24-44ff-8e0f-d16b5bd35c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:20.353832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367437d-4d24-44ff-8e0f-d16b5bd35c67 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:20.354114 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367437d-4d24-44ff-8e0f-d16b5bd35c67 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:20.354387 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367437d-4d24-44ff-8e0f-d16b5bd35c67 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:20.355087 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367437d-4d24-44ff-8e0f-d16b5bd35c67 None admin] RBAC: Adding query filter params (interface=public, service_id=a784aa60a56a492c83a3e24d6d97a50b, region_id=RegionOne) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:36:20.355393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367437d-4d24-44ff-8e0f-d16b5bd35c67 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:20.356752 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367437d-4d24-44ff-8e0f-d16b5bd35c67 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:20.361792 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 645/1300] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Aug 8 17:36:20 2022] GET /identity/v3/endpoints?service_id=a784aa60a56a492c83a3e24d6d97a50b&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:36:20.367510 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583dd1f-030e-4465-9420-56cd8f63235f None admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:20.449826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:20.467670 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583dd1f-030e-4465-9420-56cd8f63235f None admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:20.502093 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb59dd64-c224-4458-bc68-35f1822f69f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:20.502692 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59dd64-c224-4458-bc68-35f1822f69f0 None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:20.502978 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59dd64-c224-4458-bc68-35f1822f69f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:20.503251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59dd64-c224-4458-bc68-35f1822f69f0 None admin] PATH_INFO: `/v3/services` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:20.503850 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb59dd64-c224-4458-bc68-35f1822f69f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:20.505833 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb59dd64-c224-4458-bc68-35f1822f69f0 None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:20.512507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 656/1301] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Aug 8 17:36:20 2022] GET /identity/v3/services => generated 2191 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:36:22.531101 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e256ae-475d-4b26-8d33-b98301107236 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:22.531621 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e256ae-475d-4b26-8d33-b98301107236 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:22.531621 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e256ae-475d-4b26-8d33-b98301107236 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:22.532984 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 646/1302] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 17:36:22.538325 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0d921-bf90-4f46-9eb0-8a984f49a5fd None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:22.538771 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0d921-bf90-4f46-9eb0-8a984f49a5fd None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:22.538880 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0d921-bf90-4f46-9eb0-8a984f49a5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:22.557307 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-e4d0d921-bf90-4f46-9eb0-8a984f49a5fd None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:36:22.558536 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-e4d0d921-bf90-4f46-9eb0-8a984f49a5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:36:22.625234 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 657/1303] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:36:22 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 17:36:22.648456 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e256ae-475d-4b26-8d33-b98301107236 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:22.743789 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:22.750278 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e256ae-475d-4b26-8d33-b98301107236 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:22.782869 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291d9ac-c9f0-4ace-9173-a7edc16c2d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:22.783491 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291d9ac-c9f0-4ace-9173-a7edc16c2d34 None admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:22.783767 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291d9ac-c9f0-4ace-9173-a7edc16c2d34 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:22.784033 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291d9ac-c9f0-4ace-9173-a7edc16c2d34 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:22.784634 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291d9ac-c9f0-4ace-9173-a7edc16c2d34 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:22.786565 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291d9ac-c9f0-4ace-9173-a7edc16c2d34 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:22.794919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application [None req-b291d9ac-c9f0-4ace-9173-a7edc16c2d34 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 17:36:22.794919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:36:22.794919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 17:36:22.794919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 17:36:22.794919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 17:36:22.794919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 17:36:22.794919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 17:36:22.794919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:36:22.794919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 17:36:22.794919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:36:22.794919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 17:36:22.794919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:36:22.794919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 17:36:22.794919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 17:36:22.794919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 17:36:22.794919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 17:36:22.794919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 17:36:22.796117 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 17:36:22.796117 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 17:36:22.796117 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 17:36:22.796117 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 17:36:22.796117 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 17:36:22.796117 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 17:36:22.796117 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 17:36:22.796117 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 17:36:22.796117 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 17:36:22.796117 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 17:36:22.796117 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 17:36:22.796117 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 17:36:22.796117 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 17:36:22.796117 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 17:36:22.796117 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 17:36:22.796117 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 17:36:22.797072 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 17:36:22.797072 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application with Lock( Aug 08 17:36:22.797072 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 17:36:22.797072 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self._enter() Aug 08 17:36:22.797072 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 17:36:22.797072 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 17:36:22.797072 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 17:36:22.797072 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application return self.creator() Aug 08 17:36:22.797072 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 17:36:22.797072 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application created_value = creator( Aug 08 17:36:22.797072 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 17:36:22.797072 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 17:36:22.797072 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 17:36:22.797072 dv-cinder-852364-1-smb devstack@keystone.service[86920]: ERROR keystone.server.flask.application Aug 08 17:36:22.797072 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 647/1304] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Aug 8 17:36:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 17:36:22.802667 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0d921-bf90-4f46-9eb0-8a984f49a5fd None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:22.878711 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:22.901079 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0d921-bf90-4f46-9eb0-8a984f49a5fd None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:22.934686 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c944e-1328-410b-be8f-fe526645271f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:22.935277 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c944e-1328-410b-be8f-fe526645271f None admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:22.935556 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c944e-1328-410b-be8f-fe526645271f None admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:22.935821 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c944e-1328-410b-be8f-fe526645271f None admin] PATH_INFO: `/v3/services` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:22.936438 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c944e-1328-410b-be8f-fe526645271f None admin] RBAC: Adding query filter params (name=placement) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:36:22.936735 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c944e-1328-410b-be8f-fe526645271f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:22.938113 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c944e-1328-410b-be8f-fe526645271f None admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:22.943168 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 658/1305] 10.222.0.70 () {56 vars in 1116 bytes} [Mon Aug 8 17:36:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:36:22.948897 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291d9ac-c9f0-4ace-9173-a7edc16c2d34 None admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:36:23.049469 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291d9ac-c9f0-4ace-9173-a7edc16c2d34 None admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:36:23.083190 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495c7a9-1d56-46db-8920-95c68a724f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:36:23.083798 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495c7a9-1d56-46db-8920-95c68a724f29 None admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:36:23.084056 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495c7a9-1d56-46db-8920-95c68a724f29 None admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:36:23.084324 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495c7a9-1d56-46db-8920-95c68a724f29 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:36:23.085009 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a495c7a9-1d56-46db-8920-95c68a724f29 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:36:23.086466 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a495c7a9-1d56-46db-8920-95c68a724f29 None admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:36:23.161166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 648/1306] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:36:22 2022] POST /identity/v3/endpoints => generated 331 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:36:32.953050 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=30 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:36:33.155826 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:42:21.787450 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562a9df-b0be-4c72-8502-3f69e9ea917e None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:21.787897 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562a9df-b0be-4c72-8502-3f69e9ea917e None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:21.787897 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562a9df-b0be-4c72-8502-3f69e9ea917e None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:21.794329 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d125b-a2a1-4f6f-87c1-c79aa9200146 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:21.794782 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d125b-a2a1-4f6f-87c1-c79aa9200146 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:21.795001 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d125b-a2a1-4f6f-87c1-c79aa9200146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:21.799824 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 659/1307] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:42:21 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:42:21.883416 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-748d125b-a2a1-4f6f-87c1-c79aa9200146 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:42:21.884726 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-748d125b-a2a1-4f6f-87c1-c79aa9200146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:22.025635 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 649/1308] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:42:22.068401 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898ea89-4862-4c86-ae75-867e6199031b None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:22.069020 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898ea89-4862-4c86-ae75-867e6199031b None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:22.069506 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898ea89-4862-4c86-ae75-867e6199031b None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:22.071095 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 660/1309] 10.222.0.70 () {54 vars in 965 bytes} [Mon Aug 8 17:42:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:42:22.077755 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f78ac-5973-497f-b662-ef492cbf9eed None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:22.078192 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f78ac-5973-497f-b662-ef492cbf9eed None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:22.078413 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f78ac-5973-497f-b662-ef492cbf9eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:22.162875 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-257f78ac-5973-497f-b662-ef492cbf9eed None None] MFA Rules not processed for user `bdb6f0f0cde24b05a34b78d48dc45c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:42:22.164066 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-257f78ac-5973-497f-b662-ef492cbf9eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:22.186722 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:42:22.244353 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 650/1310] 10.222.0.70 () {58 vars in 1062 bytes} [Mon Aug 8 17:42:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:42:22.254396 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898ea89-4862-4c86-ae75-867e6199031b None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:42:22.256245 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-f898ea89-4862-4c86-ae75-867e6199031b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:22.386185 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898ea89-4862-4c86-ae75-867e6199031b None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:42:22.482219 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe573d74-e31f-4ce2-9146-7d69f4f3984d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:42:22.482838 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe573d74-e31f-4ce2-9146-7d69f4f3984d service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:22.483121 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe573d74-e31f-4ce2-9146-7d69f4f3984d service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:22.483393 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe573d74-e31f-4ce2-9146-7d69f4f3984d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:22.485562 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-fe573d74-e31f-4ce2-9146-7d69f4f3984d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:22.550042 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:42:22.610528 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe573d74-e31f-4ce2-9146-7d69f4f3984d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:42:22.613308 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe573d74-e31f-4ce2-9146-7d69f4f3984d service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:42:22.636129 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 661/1311] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:42:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:42:24.943871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9797cf-94dd-4201-a5cd-31d77dbc3b71 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:24.944461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9797cf-94dd-4201-a5cd-31d77dbc3b71 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:24.944461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9797cf-94dd-4201-a5cd-31d77dbc3b71 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:24.946112 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 651/1312] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:42:24.951462 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b66ade-192b-4d22-b8cf-913965f4abf4 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:24.952004 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b66ade-192b-4d22-b8cf-913965f4abf4 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:24.952004 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b66ade-192b-4d22-b8cf-913965f4abf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:25.039389 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-99b66ade-192b-4d22-b8cf-913965f4abf4 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:42:25.040688 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-99b66ade-192b-4d22-b8cf-913965f4abf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:25.147552 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 662/1313] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:42:25.186706 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9797cf-94dd-4201-a5cd-31d77dbc3b71 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:42:25.188340 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-5d9797cf-94dd-4201-a5cd-31d77dbc3b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:25.301723 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9797cf-94dd-4201-a5cd-31d77dbc3b71 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:42:25.373359 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:42:25.376611 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16839c-98ef-488c-9415-a29c698080e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:42:25.377253 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16839c-98ef-488c-9415-a29c698080e0 service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:25.377576 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16839c-98ef-488c-9415-a29c698080e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:25.377852 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16839c-98ef-488c-9415-a29c698080e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:25.379724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-6d16839c-98ef-488c-9415-a29c698080e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:25.490923 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16839c-98ef-488c-9415-a29c698080e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:42:25.492288 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16839c-98ef-488c-9415-a29c698080e0 service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:42:25.509863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 652/1314] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:42:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:42:28.015639 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2142cb-1380-4022-a96c-af8ee3f79e8b None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:28.016178 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2142cb-1380-4022-a96c-af8ee3f79e8b None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:28.016178 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2142cb-1380-4022-a96c-af8ee3f79e8b None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:28.017588 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 663/1315] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:42:28.022689 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cab81-bafc-4516-8d27-7b246ae4df35 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:28.023096 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cab81-bafc-4516-8d27-7b246ae4df35 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:28.023232 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cab81-bafc-4516-8d27-7b246ae4df35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:28.088318 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-fb6cab81-bafc-4516-8d27-7b246ae4df35 None None] MFA Rules not processed for user `b6be772778914724a2fb0603b4f3373c`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:42:28.089551 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-fb6cab81-bafc-4516-8d27-7b246ae4df35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:28.140936 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:42:28.185333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 653/1316] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:42:28 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:42:28.225326 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2142cb-1380-4022-a96c-af8ee3f79e8b None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:42:28.226874 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-6b2142cb-1380-4022-a96c-af8ee3f79e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:28.236530 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:42:28.331867 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2142cb-1380-4022-a96c-af8ee3f79e8b None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:42:28.404630 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6d781-8993-4612-b7ae-19e058db2fa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:42:28.405267 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6d781-8993-4612-b7ae-19e058db2fa3 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:28.405548 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6d781-8993-4612-b7ae-19e058db2fa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:28.405822 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6d781-8993-4612-b7ae-19e058db2fa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:28.407449 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-fdf6d781-8993-4612-b7ae-19e058db2fa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:28.469263 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:42:28.515348 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6d781-8993-4612-b7ae-19e058db2fa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:42:28.516789 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6d781-8993-4612-b7ae-19e058db2fa3 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:42:28.535481 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 664/1317] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:42:28 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:42:31.322471 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81f88a-0dce-4928-940f-ed0ea6acabd0 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:31.323019 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81f88a-0dce-4928-940f-ed0ea6acabd0 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:31.323019 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81f88a-0dce-4928-940f-ed0ea6acabd0 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:31.324357 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 654/1318] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:42:31.329664 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21c6da-c4cd-433b-aa8d-aad6ef97f4b8 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:31.330090 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21c6da-c4cd-433b-aa8d-aad6ef97f4b8 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:31.330204 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21c6da-c4cd-433b-aa8d-aad6ef97f4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:31.397121 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-3a21c6da-c4cd-433b-aa8d-aad6ef97f4b8 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:42:31.398343 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-3a21c6da-c4cd-433b-aa8d-aad6ef97f4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:31.496587 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 665/1319] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:42:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:42:31.536608 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81f88a-0dce-4928-940f-ed0ea6acabd0 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:42:31.538215 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-3f81f88a-0dce-4928-940f-ed0ea6acabd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:31.640944 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81f88a-0dce-4928-940f-ed0ea6acabd0 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:42:31.714741 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9223491-3fb8-4f9d-a6cd-98999fdc32e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:42:31.715336 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9223491-3fb8-4f9d-a6cd-98999fdc32e0 service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:31.715611 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9223491-3fb8-4f9d-a6cd-98999fdc32e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:31.715876 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9223491-3fb8-4f9d-a6cd-98999fdc32e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:31.717479 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-c9223491-3fb8-4f9d-a6cd-98999fdc32e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:31.725015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:42:31.826018 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9223491-3fb8-4f9d-a6cd-98999fdc32e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:42:31.827388 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9223491-3fb8-4f9d-a6cd-98999fdc32e0 service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:42:31.845515 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 655/1320] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:42:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:42:35.009850 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22087c80-4183-45f0-bf0e-66973606df36 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:35.010451 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22087c80-4183-45f0-bf0e-66973606df36 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:35.010451 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22087c80-4183-45f0-bf0e-66973606df36 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:35.011717 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 666/1321] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:42:35.016894 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e8fbf-3300-47b3-90a8-cc43161f1fc0 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:35.017420 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e8fbf-3300-47b3-90a8-cc43161f1fc0 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:35.017579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e8fbf-3300-47b3-90a8-cc43161f1fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:35.085282 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-2a5e8fbf-3300-47b3-90a8-cc43161f1fc0 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:42:35.086480 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-2a5e8fbf-3300-47b3-90a8-cc43161f1fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:35.142627 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:42:35.182446 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 656/1322] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:42:35.219096 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22087c80-4183-45f0-bf0e-66973606df36 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:42:35.220619 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-22087c80-4183-45f0-bf0e-66973606df36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:35.240881 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:42:35.337072 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22087c80-4183-45f0-bf0e-66973606df36 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:42:35.418148 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b137c-1343-47ba-95f7-09b885909540 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:42:35.418767 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b137c-1343-47ba-95f7-09b885909540 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:35.419042 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b137c-1343-47ba-95f7-09b885909540 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:35.419310 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b137c-1343-47ba-95f7-09b885909540 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:35.420965 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-7f1b137c-1343-47ba-95f7-09b885909540 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:35.495660 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:42:35.533929 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b137c-1343-47ba-95f7-09b885909540 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:42:35.535627 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b137c-1343-47ba-95f7-09b885909540 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:42:35.555997 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 667/1323] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:42:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:42:37.616402 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178d030-3dbe-47fd-b177-9ba37e35c7d3 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:37.616972 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178d030-3dbe-47fd-b177-9ba37e35c7d3 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:37.616972 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178d030-3dbe-47fd-b177-9ba37e35c7d3 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:37.618370 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 657/1324] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:42:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:42:37.623765 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ed096-25dc-465f-84c5-cb910699b2af None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:37.624173 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ed096-25dc-465f-84c5-cb910699b2af None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:37.624341 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ed096-25dc-465f-84c5-cb910699b2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:37.695417 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-2b6ed096-25dc-465f-84c5-cb910699b2af None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:42:37.696640 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-2b6ed096-25dc-465f-84c5-cb910699b2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:37.794820 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 668/1325] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:42:37.830976 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178d030-3dbe-47fd-b177-9ba37e35c7d3 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:42:37.832511 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-7178d030-3dbe-47fd-b177-9ba37e35c7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:37.937062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178d030-3dbe-47fd-b177-9ba37e35c7d3 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:42:38.009381 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712b1b4-d329-4b2a-b936-bdbb49d1e6a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:42:38.009970 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712b1b4-d329-4b2a-b936-bdbb49d1e6a9 service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:38.010243 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712b1b4-d329-4b2a-b936-bdbb49d1e6a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:38.010510 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712b1b4-d329-4b2a-b936-bdbb49d1e6a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:38.012070 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-3712b1b4-d329-4b2a-b936-bdbb49d1e6a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:38.029177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:42:38.120720 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712b1b4-d329-4b2a-b936-bdbb49d1e6a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:42:38.122194 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712b1b4-d329-4b2a-b936-bdbb49d1e6a9 service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:42:38.141538 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 658/1326] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:42:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:42:40.211562 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13cb8e-4309-4489-9c2e-15d5a4229b19 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:40.212153 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13cb8e-4309-4489-9c2e-15d5a4229b19 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:40.212153 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13cb8e-4309-4489-9c2e-15d5a4229b19 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:40.217381 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 669/1327] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:42:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:42:40.218713 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac5e5f-b6ad-4ffc-b7be-d8b06674d1ed None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:40.219121 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac5e5f-b6ad-4ffc-b7be-d8b06674d1ed None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:40.219267 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac5e5f-b6ad-4ffc-b7be-d8b06674d1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:40.295393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-eaac5e5f-b6ad-4ffc-b7be-d8b06674d1ed None None] MFA Rules not processed for user `b6be772778914724a2fb0603b4f3373c`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:42:40.296835 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-eaac5e5f-b6ad-4ffc-b7be-d8b06674d1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:40.367889 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:42:40.408802 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 659/1328] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:42:40 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:42:40.459862 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af7db1-350f-4f3c-9147-da544e77290c None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:40.460242 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af7db1-350f-4f3c-9147-da544e77290c None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:40.460787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af7db1-350f-4f3c-9147-da544e77290c None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:40.462296 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 670/1329] 10.222.0.70 () {54 vars in 965 bytes} [Mon Aug 8 17:42:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:42:40.468220 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b347c6-a46c-47e4-b81c-bdbffb0c432c None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:40.468504 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b347c6-a46c-47e4-b81c-bdbffb0c432c None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:40.468775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b347c6-a46c-47e4-b81c-bdbffb0c432c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:40.544526 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-33b347c6-a46c-47e4-b81c-bdbffb0c432c None None] MFA Rules not processed for user `bdb6f0f0cde24b05a34b78d48dc45c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:42:40.545888 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-33b347c6-a46c-47e4-b81c-bdbffb0c432c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:40.624455 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 660/1330] 10.222.0.70 () {58 vars in 1062 bytes} [Mon Aug 8 17:42:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:42:40.635085 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af7db1-350f-4f3c-9147-da544e77290c None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:42:40.636652 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-35af7db1-350f-4f3c-9147-da544e77290c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:40.670066 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:42:40.744358 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af7db1-350f-4f3c-9147-da544e77290c None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:42:40.816622 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1e625-172e-4884-b0ae-ad200f87408b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:42:40.817249 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1e625-172e-4884-b0ae-ad200f87408b service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:40.817533 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1e625-172e-4884-b0ae-ad200f87408b service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:40.817802 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1e625-172e-4884-b0ae-ad200f87408b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:40.819948 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-4bd1e625-172e-4884-b0ae-ad200f87408b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:40.900658 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:42:40.933478 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1e625-172e-4884-b0ae-ad200f87408b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:42:40.934934 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1e625-172e-4884-b0ae-ad200f87408b service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:42:40.953230 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 671/1331] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:42:40 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:42:43.784060 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8a505-3d4d-4764-becc-ad0c8dd442ea None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:43.784712 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8a505-3d4d-4764-becc-ad0c8dd442ea None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:43.784712 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8a505-3d4d-4764-becc-ad0c8dd442ea None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:43.785970 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 661/1332] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:42:43.791475 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7151d7-c756-4216-bcbd-d07fee825169 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:43.791890 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7151d7-c756-4216-bcbd-d07fee825169 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:43.792032 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7151d7-c756-4216-bcbd-d07fee825169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:43.857380 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-7f7151d7-c756-4216-bcbd-d07fee825169 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:42:43.858651 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-7f7151d7-c756-4216-bcbd-d07fee825169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:43.960330 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 672/1333] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:42:43.996414 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8a505-3d4d-4764-becc-ad0c8dd442ea None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:42:43.997970 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-9ef8a505-3d4d-4764-becc-ad0c8dd442ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:44.067083 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:42:44.101449 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8a505-3d4d-4764-becc-ad0c8dd442ea None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:42:44.172785 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f148fbf-2f07-474b-8f13-fe2aeae067e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:42:44.173417 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f148fbf-2f07-474b-8f13-fe2aeae067e1 service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:44.173698 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f148fbf-2f07-474b-8f13-fe2aeae067e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:44.173970 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f148fbf-2f07-474b-8f13-fe2aeae067e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:44.175552 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-1f148fbf-2f07-474b-8f13-fe2aeae067e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:44.282510 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f148fbf-2f07-474b-8f13-fe2aeae067e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:42:44.284015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f148fbf-2f07-474b-8f13-fe2aeae067e1 service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:42:44.297739 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:42:44.308045 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 662/1334] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:42:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:42:46.358591 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e7615-93e9-4fb5-b427-5c52404b3060 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:46.359137 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e7615-93e9-4fb5-b427-5c52404b3060 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:46.359137 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e7615-93e9-4fb5-b427-5c52404b3060 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:46.362712 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 673/1335] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:42:46.365705 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89713eff-9c83-4587-a746-53a020864be2 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:46.366112 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89713eff-9c83-4587-a746-53a020864be2 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:46.366291 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89713eff-9c83-4587-a746-53a020864be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:46.435361 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-89713eff-9c83-4587-a746-53a020864be2 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:42:46.436559 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-89713eff-9c83-4587-a746-53a020864be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:46.532491 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 663/1336] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:42:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:42:46.573925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e7615-93e9-4fb5-b427-5c52404b3060 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:42:46.575465 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-406e7615-93e9-4fb5-b427-5c52404b3060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:46.616018 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:42:46.678588 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e7615-93e9-4fb5-b427-5c52404b3060 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:42:46.750292 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41069e72-97d8-4b0b-b9f3-88307a44da07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:42:46.750886 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41069e72-97d8-4b0b-b9f3-88307a44da07 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:46.751165 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41069e72-97d8-4b0b-b9f3-88307a44da07 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:46.751432 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41069e72-97d8-4b0b-b9f3-88307a44da07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:46.753021 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-41069e72-97d8-4b0b-b9f3-88307a44da07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:46.834751 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:42:46.860247 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41069e72-97d8-4b0b-b9f3-88307a44da07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:42:46.861705 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41069e72-97d8-4b0b-b9f3-88307a44da07 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:42:46.880449 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 674/1337] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:42:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:42:49.572422 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d30d5a-ac83-4d2e-8501-be309172dcfd None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:49.572962 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d30d5a-ac83-4d2e-8501-be309172dcfd None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:49.572962 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d30d5a-ac83-4d2e-8501-be309172dcfd None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:49.574271 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 664/1338] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:42:49.579416 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f403e-0d18-4707-bda4-bbad22905662 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:49.579797 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f403e-0d18-4707-bda4-bbad22905662 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:49.579975 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f403e-0d18-4707-bda4-bbad22905662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:49.644676 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-e12f403e-0d18-4707-bda4-bbad22905662 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:42:49.645926 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-e12f403e-0d18-4707-bda4-bbad22905662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:49.743387 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 675/1339] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:42:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:42:49.780054 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d30d5a-ac83-4d2e-8501-be309172dcfd None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:42:49.781594 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-83d30d5a-ac83-4d2e-8501-be309172dcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:49.857729 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:42:49.885406 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d30d5a-ac83-4d2e-8501-be309172dcfd None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:42:49.957676 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1a81a-e2b6-4e0b-a6d0-bcc4b08723c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:42:49.958291 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1a81a-e2b6-4e0b-a6d0-bcc4b08723c1 service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:49.958545 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1a81a-e2b6-4e0b-a6d0-bcc4b08723c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:49.958808 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1a81a-e2b6-4e0b-a6d0-bcc4b08723c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:49.960375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-eef1a81a-e2b6-4e0b-a6d0-bcc4b08723c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:50.065827 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1a81a-e2b6-4e0b-a6d0-bcc4b08723c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:42:50.067262 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1a81a-e2b6-4e0b-a6d0-bcc4b08723c1 service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:42:50.085509 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 665/1340] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:42:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:42:54.354909 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1051d1-e5df-4426-ac5b-cbe4a63ca5f7 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:54.359753 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1051d1-e5df-4426-ac5b-cbe4a63ca5f7 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:54.359753 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1051d1-e5df-4426-ac5b-cbe4a63ca5f7 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:54.359753 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 676/1341] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:42:54.362492 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8cb0d-3bfd-4962-a9b5-f2e90b211498 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:54.362915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8cb0d-3bfd-4962-a9b5-f2e90b211498 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:54.363026 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8cb0d-3bfd-4962-a9b5-f2e90b211498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:54.369157 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:42:54.435200 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-aac8cb0d-3bfd-4962-a9b5-f2e90b211498 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:42:54.436411 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-aac8cb0d-3bfd-4962-a9b5-f2e90b211498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:54.536612 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 666/1342] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:42:54.577360 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1051d1-e5df-4426-ac5b-cbe4a63ca5f7 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:42:54.578894 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-cc1051d1-e5df-4426-ac5b-cbe4a63ca5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:54.628012 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:42:54.686546 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1051d1-e5df-4426-ac5b-cbe4a63ca5f7 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:42:54.763408 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9a3e9-1e8e-42a8-9b8a-b1b111059323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:42:54.764002 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9a3e9-1e8e-42a8-9b8a-b1b111059323 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:54.764276 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9a3e9-1e8e-42a8-9b8a-b1b111059323 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:54.764542 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9a3e9-1e8e-42a8-9b8a-b1b111059323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:54.766163 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-20b9a3e9-1e8e-42a8-9b8a-b1b111059323 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:54.859718 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:42:54.875626 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9a3e9-1e8e-42a8-9b8a-b1b111059323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:42:54.877099 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9a3e9-1e8e-42a8-9b8a-b1b111059323 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:42:54.896003 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 677/1343] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:42:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:42:57.911754 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31539f12-06b8-41cf-b95d-450503382196 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:57.912314 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31539f12-06b8-41cf-b95d-450503382196 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:57.912314 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31539f12-06b8-41cf-b95d-450503382196 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:57.913662 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 667/1344] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:42:57.919923 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00ec24-1ac2-4a8b-b823-a3bda3374ea1 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:57.920351 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00ec24-1ac2-4a8b-b823-a3bda3374ea1 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:57.920484 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00ec24-1ac2-4a8b-b823-a3bda3374ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:57.989422 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-ce00ec24-1ac2-4a8b-b823-a3bda3374ea1 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:42:57.990543 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-ce00ec24-1ac2-4a8b-b823-a3bda3374ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:58.091772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 678/1345] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:42:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:42:58.129709 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31539f12-06b8-41cf-b95d-450503382196 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:42:58.131230 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-31539f12-06b8-41cf-b95d-450503382196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:58.218945 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:42:58.236248 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31539f12-06b8-41cf-b95d-450503382196 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:42:58.310969 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179514d7-f8d5-43d4-9a13-725a1ec82ae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:42:58.311584 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179514d7-f8d5-43d4-9a13-725a1ec82ae6 service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:42:58.311862 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179514d7-f8d5-43d4-9a13-725a1ec82ae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:42:58.312132 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179514d7-f8d5-43d4-9a13-725a1ec82ae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:42:58.313781 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-179514d7-f8d5-43d4-9a13-725a1ec82ae6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:42:58.436939 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179514d7-f8d5-43d4-9a13-725a1ec82ae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:42:58.438436 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179514d7-f8d5-43d4-9a13-725a1ec82ae6 service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:42:58.457608 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 668/1346] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:42:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:43:03.052154 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2866d-c0ed-4451-a58b-9ec53b4881bc None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:03.052925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2866d-c0ed-4451-a58b-9ec53b4881bc None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:03.052925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2866d-c0ed-4451-a58b-9ec53b4881bc None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:03.054231 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 679/1347] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:43:03.060993 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588363a-0830-4aea-86cf-6ce69906d42b None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:03.061542 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588363a-0830-4aea-86cf-6ce69906d42b None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:03.061656 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588363a-0830-4aea-86cf-6ce69906d42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:03.079699 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:03.134385 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-5588363a-0830-4aea-86cf-6ce69906d42b None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:43:03.136237 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-5588363a-0830-4aea-86cf-6ce69906d42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:03.238817 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 669/1348] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:43:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:43:03.283138 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2866d-c0ed-4451-a58b-9ec53b4881bc None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:43:03.284134 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-aac2866d-c0ed-4451-a58b-9ec53b4881bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:03.348384 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:03.404631 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2866d-c0ed-4451-a58b-9ec53b4881bc None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:43:03.496959 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c0ab5-39ea-4a4b-9cc2-8731530200c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:43:03.497604 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c0ab5-39ea-4a4b-9cc2-8731530200c4 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:03.497889 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c0ab5-39ea-4a4b-9cc2-8731530200c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:03.498165 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c0ab5-39ea-4a4b-9cc2-8731530200c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:03.499779 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-1d5c0ab5-39ea-4a4b-9cc2-8731530200c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:03.613604 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:03.617166 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c0ab5-39ea-4a4b-9cc2-8731530200c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:43:03.618601 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c0ab5-39ea-4a4b-9cc2-8731530200c4 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:43:03.637402 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 680/1349] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:43:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:43:08.556673 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac64234-dde1-483e-b354-2e23a437fcc5 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:08.557531 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac64234-dde1-483e-b354-2e23a437fcc5 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:08.558602 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac64234-dde1-483e-b354-2e23a437fcc5 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:08.560572 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 670/1350] 10.222.0.70 () {54 vars in 921 bytes} [Mon Aug 8 17:43:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:43:08.567518 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1506b-ec58-4fe8-bafd-0688dde850a6 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:08.568282 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1506b-ec58-4fe8-bafd-0688dde850a6 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:08.568706 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1506b-ec58-4fe8-bafd-0688dde850a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:08.655691 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-5cd1506b-ec58-4fe8-bafd-0688dde850a6 None None] MFA Rules not processed for user `68717c19e74e434da825d9b1d6ca202a`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:43:08.656898 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-5cd1506b-ec58-4fe8-bafd-0688dde850a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:08.819926 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 681/1351] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Aug 8 17:43:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:43:13.001983 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa77554-951a-41ef-9039-53afde971d56 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:13.002799 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa77554-951a-41ef-9039-53afde971d56 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:13.002799 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa77554-951a-41ef-9039-53afde971d56 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:13.004149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 671/1352] 10.222.0.70 () {54 vars in 921 bytes} [Mon Aug 8 17:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 17:43:13.010058 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9ac26-4660-406b-af57-e2b78bcc9b6e None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:13.011246 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9ac26-4660-406b-af57-e2b78bcc9b6e None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:13.012424 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9ac26-4660-406b-af57-e2b78bcc9b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:13.103035 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:13.127094 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-c6d9ac26-4660-406b-af57-e2b78bcc9b6e None None] MFA Rules not processed for user `68717c19e74e434da825d9b1d6ca202a`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:43:13.128314 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-c6d9ac26-4660-406b-af57-e2b78bcc9b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:13.236809 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=59 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:13.247590 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 682/1353] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Aug 8 17:43:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:43:14.628849 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a7e95-de29-4d99-839f-22fa6d5b6f99 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:14.629422 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a7e95-de29-4d99-839f-22fa6d5b6f99 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:14.629422 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a7e95-de29-4d99-839f-22fa6d5b6f99 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:14.630776 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 672/1354] 10.222.0.70 () {54 vars in 921 bytes} [Mon Aug 8 17:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:43:14.635846 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8cc7a-95e7-4976-a2ff-1d7c4245b010 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:14.636269 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8cc7a-95e7-4976-a2ff-1d7c4245b010 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:14.636431 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8cc7a-95e7-4976-a2ff-1d7c4245b010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:14.718147 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-72d8cc7a-95e7-4976-a2ff-1d7c4245b010 None None] MFA Rules not processed for user `68717c19e74e434da825d9b1d6ca202a`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:43:14.719366 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-72d8cc7a-95e7-4976-a2ff-1d7c4245b010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:14.761330 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:14.833906 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 683/1355] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Aug 8 17:43:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:43:18.134905 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07023be-b9a2-4f87-a0e6-128d03f16448 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:18.135427 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07023be-b9a2-4f87-a0e6-128d03f16448 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:18.135427 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07023be-b9a2-4f87-a0e6-128d03f16448 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:18.136783 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 673/1356] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:43:18.142982 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36957f-409b-43cc-a93c-00229ac3e5fb None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:18.143425 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36957f-409b-43cc-a93c-00229ac3e5fb None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:18.143532 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36957f-409b-43cc-a93c-00229ac3e5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:18.219575 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-ae36957f-409b-43cc-a93c-00229ac3e5fb None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:43:18.220800 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-ae36957f-409b-43cc-a93c-00229ac3e5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:18.328721 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 684/1357] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:43:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:43:18.384065 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3ad20-5c05-42ba-b234-3f51272cec4e None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:18.384865 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3ad20-5c05-42ba-b234-3f51272cec4e None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:18.385441 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3ad20-5c05-42ba-b234-3f51272cec4e None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:18.387938 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 674/1358] 10.222.0.70 () {54 vars in 962 bytes} [Mon Aug 8 17:43:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:43:18.398704 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4593508-b704-4e94-97a8-c23b3a8c513c None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:18.404081 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4593508-b704-4e94-97a8-c23b3a8c513c None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:18.404081 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4593508-b704-4e94-97a8-c23b3a8c513c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:18.420347 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:18.487442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-c4593508-b704-4e94-97a8-c23b3a8c513c None None] MFA Rules not processed for user `3973b8fbfbb9475896e4e110ca8aa615`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:43:18.488756 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-c4593508-b704-4e94-97a8-c23b3a8c513c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:18.625562 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 685/1359] 10.222.0.70 () {58 vars in 1059 bytes} [Mon Aug 8 17:43:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:43:18.633601 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3ad20-5c05-42ba-b234-3f51272cec4e None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:43:18.635304 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-58f3ad20-5c05-42ba-b234-3f51272cec4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:18.788973 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3ad20-5c05-42ba-b234-3f51272cec4e None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:43:18.880195 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:18.922246 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf20192-55e6-4ed3-99f1-134289441e36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:43:18.922962 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf20192-55e6-4ed3-99f1-134289441e36 service nova] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:18.923329 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf20192-55e6-4ed3-99f1-134289441e36 service nova] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:18.923666 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf20192-55e6-4ed3-99f1-134289441e36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:18.925357 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-fcf20192-55e6-4ed3-99f1-134289441e36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:19.025437 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf20192-55e6-4ed3-99f1-134289441e36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:43:19.027442 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf20192-55e6-4ed3-99f1-134289441e36 service nova] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:43:19.049173 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 675/1360] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:43:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:43:21.292629 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f0420-0fc2-4e92-912a-a1c27015a578 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:21.293275 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f0420-0fc2-4e92-912a-a1c27015a578 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:21.293275 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f0420-0fc2-4e92-912a-a1c27015a578 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:21.295699 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 686/1361] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:43:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:43:21.300731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f03813-ead4-4bfb-b794-85a3ae0a422f None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:21.301172 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f03813-ead4-4bfb-b794-85a3ae0a422f None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:21.301365 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f03813-ead4-4bfb-b794-85a3ae0a422f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:21.373164 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-48f03813-ead4-4bfb-b794-85a3ae0a422f None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:43:21.374376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-48f03813-ead4-4bfb-b794-85a3ae0a422f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:21.418578 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:21.489107 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 676/1362] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:43:21.529435 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f0420-0fc2-4e92-912a-a1c27015a578 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:43:21.530737 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-1f5f0420-0fc2-4e92-912a-a1c27015a578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:21.606373 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:21.712164 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f0420-0fc2-4e92-912a-a1c27015a578 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:43:21.850034 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d769878-1e2e-41bb-a512-957d05cd6031 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:43:21.850721 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d769878-1e2e-41bb-a512-957d05cd6031 service nova] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:21.851115 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d769878-1e2e-41bb-a512-957d05cd6031 service nova] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:21.851115 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d769878-1e2e-41bb-a512-957d05cd6031 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:21.853817 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-5d769878-1e2e-41bb-a512-957d05cd6031 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:21.877672 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:21.949315 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d769878-1e2e-41bb-a512-957d05cd6031 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:43:21.951712 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d769878-1e2e-41bb-a512-957d05cd6031 service nova] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:43:21.972677 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 687/1363] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:43:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:43:24.457889 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd40f4-6092-4fee-a210-808c1623064a None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:24.458449 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd40f4-6092-4fee-a210-808c1623064a None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:24.458449 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd40f4-6092-4fee-a210-808c1623064a None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:24.459910 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 677/1364] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:43:24.465400 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb33ddb-e955-4efc-a25b-ab9c55531149 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:24.465400 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb33ddb-e955-4efc-a25b-ab9c55531149 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:24.465989 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb33ddb-e955-4efc-a25b-ab9c55531149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:24.539184 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-2bb33ddb-e955-4efc-a25b-ab9c55531149 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:43:24.540430 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-2bb33ddb-e955-4efc-a25b-ab9c55531149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:24.647680 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:24.661319 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 688/1365] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:43:24.698840 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b69c6d-47ff-477d-9c31-b1854c70cb7e None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:24.699190 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b69c6d-47ff-477d-9c31-b1854c70cb7e None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:24.699531 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b69c6d-47ff-477d-9c31-b1854c70cb7e None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:24.702082 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 678/1366] 10.222.0.70 () {54 vars in 962 bytes} [Mon Aug 8 17:43:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:43:24.707686 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0244d4-75fe-4c54-874f-0a947f9243b2 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:24.708022 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0244d4-75fe-4c54-874f-0a947f9243b2 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:24.708589 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0244d4-75fe-4c54-874f-0a947f9243b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:24.791331 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-1f0244d4-75fe-4c54-874f-0a947f9243b2 None None] MFA Rules not processed for user `3973b8fbfbb9475896e4e110ca8aa615`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:43:24.792546 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-1f0244d4-75fe-4c54-874f-0a947f9243b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:24.918267 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 689/1367] 10.222.0.70 () {58 vars in 1059 bytes} [Mon Aug 8 17:43:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:43:24.927565 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b69c6d-47ff-477d-9c31-b1854c70cb7e None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:43:24.929348 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-a7b69c6d-47ff-477d-9c31-b1854c70cb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:25.083596 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b69c6d-47ff-477d-9c31-b1854c70cb7e None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:43:25.106223 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:25.208338 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04afd65a-9ded-41cf-9f1d-8ac6343fde0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:43:25.208945 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afd65a-9ded-41cf-9f1d-8ac6343fde0b service nova] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:25.209251 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afd65a-9ded-41cf-9f1d-8ac6343fde0b service nova] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:25.209525 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afd65a-9ded-41cf-9f1d-8ac6343fde0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:25.211143 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-04afd65a-9ded-41cf-9f1d-8ac6343fde0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:25.306737 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04afd65a-9ded-41cf-9f1d-8ac6343fde0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:43:25.308305 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04afd65a-9ded-41cf-9f1d-8ac6343fde0b service nova] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:43:25.328051 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 679/1368] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:43:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:43:26.343392 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af710df8-a875-463c-b49e-0f711107cd46 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:26.343974 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af710df8-a875-463c-b49e-0f711107cd46 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:26.343974 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af710df8-a875-463c-b49e-0f711107cd46 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:26.345527 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 690/1369] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:43:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:43:26.350788 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38dca9e-c5b3-4692-9925-dcf963e26e71 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:26.351179 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38dca9e-c5b3-4692-9925-dcf963e26e71 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:26.351358 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38dca9e-c5b3-4692-9925-dcf963e26e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:26.383778 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:26.425415 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-c38dca9e-c5b3-4692-9925-dcf963e26e71 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:43:26.426907 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-c38dca9e-c5b3-4692-9925-dcf963e26e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:26.541149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 680/1370] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:43:26.903674 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff236d-1302-4aef-a361-ee0b07e93342 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:26.903674 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff236d-1302-4aef-a361-ee0b07e93342 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:26.903674 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff236d-1302-4aef-a361-ee0b07e93342 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:26.907667 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 691/1371] 10.222.0.70 () {54 vars in 964 bytes} [Mon Aug 8 17:43:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:43:26.910533 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf0e9e-e8ee-4cac-85cb-7754b29976d2 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:26.910864 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf0e9e-e8ee-4cac-85cb-7754b29976d2 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:26.911102 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf0e9e-e8ee-4cac-85cb-7754b29976d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:26.992515 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-f5bf0e9e-e8ee-4cac-85cb-7754b29976d2 None None] MFA Rules not processed for user `44340c24b5784b58b829e2faa62ac58a`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:43:26.993767 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-f5bf0e9e-e8ee-4cac-85cb-7754b29976d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:27.042888 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:27.082719 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 681/1372] 10.222.0.70 () {58 vars in 1061 bytes} [Mon Aug 8 17:43:26 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:43:27.090370 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff236d-1302-4aef-a361-ee0b07e93342 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:43:27.093120 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-d8ff236d-1302-4aef-a361-ee0b07e93342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:27.146664 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:27.204535 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff236d-1302-4aef-a361-ee0b07e93342 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:43:27.286943 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8257d73-d354-4c09-9eb4-5397895c33e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:43:27.287553 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8257d73-d354-4c09-9eb4-5397895c33e1 service cinder] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:27.287828 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8257d73-d354-4c09-9eb4-5397895c33e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:27.288094 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8257d73-d354-4c09-9eb4-5397895c33e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:27.289748 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-f8257d73-d354-4c09-9eb4-5397895c33e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:27.401643 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:27.417074 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8257d73-d354-4c09-9eb4-5397895c33e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:43:27.417887 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8257d73-d354-4c09-9eb4-5397895c33e1 service cinder] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:43:27.445959 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 692/1373] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:43:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:43:27.529020 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c227a-4756-4e61-87bd-4dad1700cfeb None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:27.529606 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c227a-4756-4e61-87bd-4dad1700cfeb None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:27.529845 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c227a-4756-4e61-87bd-4dad1700cfeb None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:27.534253 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 682/1374] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:43:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:43:27.536458 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac1d79-f01f-453b-9232-84f27275df8a None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:27.536748 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac1d79-f01f-453b-9232-84f27275df8a None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:27.537102 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac1d79-f01f-453b-9232-84f27275df8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:27.610690 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-d6ac1d79-f01f-453b-9232-84f27275df8a None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:43:27.612460 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-d6ac1d79-f01f-453b-9232-84f27275df8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:27.731694 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 693/1375] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:43:27.778577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c227a-4756-4e61-87bd-4dad1700cfeb None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:43:27.780475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-cf4c227a-4756-4e61-87bd-4dad1700cfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:27.940203 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c227a-4756-4e61-87bd-4dad1700cfeb None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:43:27.993661 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:28.056207 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e378083-68cf-46c4-b931-f79989962603 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:43:28.056812 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e378083-68cf-46c4-b931-f79989962603 service nova] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:28.057118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e378083-68cf-46c4-b931-f79989962603 service nova] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:28.057395 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e378083-68cf-46c4-b931-f79989962603 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:28.058975 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-6e378083-68cf-46c4-b931-f79989962603 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:28.150769 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e378083-68cf-46c4-b931-f79989962603 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:43:28.152406 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e378083-68cf-46c4-b931-f79989962603 service nova] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:43:28.170918 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 683/1376] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:43:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:43:30.323579 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129df3dd-6f6d-4ae3-bbf5-f0fd4ac3d30b None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:30.324121 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129df3dd-6f6d-4ae3-bbf5-f0fd4ac3d30b None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:30.324121 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129df3dd-6f6d-4ae3-bbf5-f0fd4ac3d30b None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:30.325584 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 694/1377] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:43:30.331654 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abc8ed-f8dd-4e24-81cc-8cb1412d1345 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:30.332111 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abc8ed-f8dd-4e24-81cc-8cb1412d1345 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:30.332225 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abc8ed-f8dd-4e24-81cc-8cb1412d1345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:30.406499 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-95abc8ed-f8dd-4e24-81cc-8cb1412d1345 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:43:30.407710 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-95abc8ed-f8dd-4e24-81cc-8cb1412d1345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:30.414718 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:30.512544 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 684/1378] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:43:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:43:30.557309 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129df3dd-6f6d-4ae3-bbf5-f0fd4ac3d30b None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:43:30.558874 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-129df3dd-6f6d-4ae3-bbf5-f0fd4ac3d30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:30.635059 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:30.722252 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129df3dd-6f6d-4ae3-bbf5-f0fd4ac3d30b None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:43:30.833069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21832a0-6862-4aa1-98bb-29b4bc3542b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:43:30.833672 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21832a0-6862-4aa1-98bb-29b4bc3542b9 service nova] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:30.833950 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21832a0-6862-4aa1-98bb-29b4bc3542b9 service nova] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:30.834215 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21832a0-6862-4aa1-98bb-29b4bc3542b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:30.835785 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-f21832a0-6862-4aa1-98bb-29b4bc3542b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:30.855680 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:30.934119 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21832a0-6862-4aa1-98bb-29b4bc3542b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:43:30.936174 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21832a0-6862-4aa1-98bb-29b4bc3542b9 service nova] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:43:30.965632 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 695/1379] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:43:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:43:33.195318 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7f2d0-78ef-4784-8fce-6662df4a015d None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:33.195851 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7f2d0-78ef-4784-8fce-6662df4a015d None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:33.195851 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7f2d0-78ef-4784-8fce-6662df4a015d None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:33.197522 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 685/1380] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:43:33.203702 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a8237-93c6-4863-96b3-2392e8084791 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:33.204149 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a8237-93c6-4863-96b3-2392e8084791 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:33.204354 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a8237-93c6-4863-96b3-2392e8084791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:33.273466 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-f94a8237-93c6-4863-96b3-2392e8084791 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:43:33.274659 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-f94a8237-93c6-4863-96b3-2392e8084791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:33.371355 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:33.378650 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 696/1381] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:43:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:43:33.428255 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7f2d0-78ef-4784-8fce-6662df4a015d None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:43:33.433782 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-0cc7f2d0-78ef-4784-8fce-6662df4a015d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:33.582758 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:33.593662 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7f2d0-78ef-4784-8fce-6662df4a015d None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:43:33.728855 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c376d-86d4-4df9-ae7e-06613d868b5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:43:33.729486 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c376d-86d4-4df9-ae7e-06613d868b5a service nova] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:33.729768 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c376d-86d4-4df9-ae7e-06613d868b5a service nova] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:33.730046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c376d-86d4-4df9-ae7e-06613d868b5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:33.731635 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-098c376d-86d4-4df9-ae7e-06613d868b5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:33.883262 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c376d-86d4-4df9-ae7e-06613d868b5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:43:33.883262 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c376d-86d4-4df9-ae7e-06613d868b5a service nova] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:43:33.883262 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:33.883262 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 686/1382] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:43:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:43:36.064811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45084b2a-1fe7-4ff9-ac4e-a77f82b1d334 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:36.065420 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45084b2a-1fe7-4ff9-ac4e-a77f82b1d334 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:36.065657 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45084b2a-1fe7-4ff9-ac4e-a77f82b1d334 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:36.067376 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 697/1383] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:43:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:43:36.072421 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef377746-4a73-461a-87f6-f251784aa93d None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:36.072833 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef377746-4a73-461a-87f6-f251784aa93d None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:36.073013 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef377746-4a73-461a-87f6-f251784aa93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:36.150113 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-ef377746-4a73-461a-87f6-f251784aa93d None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:43:36.151412 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-ef377746-4a73-461a-87f6-f251784aa93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:36.262587 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 687/1384] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:43:36.305564 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45084b2a-1fe7-4ff9-ac4e-a77f82b1d334 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:43:36.307129 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-45084b2a-1fe7-4ff9-ac4e-a77f82b1d334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:36.469482 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45084b2a-1fe7-4ff9-ac4e-a77f82b1d334 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:43:36.542062 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:36.598187 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2a70c-bb4f-4f8c-8ff5-5bf8303ca099 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:43:36.598960 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2a70c-bb4f-4f8c-8ff5-5bf8303ca099 service nova] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:36.599318 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2a70c-bb4f-4f8c-8ff5-5bf8303ca099 service nova] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:36.599902 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2a70c-bb4f-4f8c-8ff5-5bf8303ca099 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:36.602036 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-6ea2a70c-bb4f-4f8c-8ff5-5bf8303ca099 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:36.720940 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2a70c-bb4f-4f8c-8ff5-5bf8303ca099 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:43:36.723547 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2a70c-bb4f-4f8c-8ff5-5bf8303ca099 service nova] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:43:36.748382 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 698/1385] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:43:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:43:38.830824 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9122e09-8847-4b37-9176-c18a19cf5f94 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:38.831380 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9122e09-8847-4b37-9176-c18a19cf5f94 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:38.831380 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9122e09-8847-4b37-9176-c18a19cf5f94 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:38.833437 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 688/1386] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:43:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:43:38.840125 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac282f-cc75-497a-b9a1-d35af91f042c None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:38.840562 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac282f-cc75-497a-b9a1-d35af91f042c None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:38.841103 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac282f-cc75-497a-b9a1-d35af91f042c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:38.913348 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-8dac282f-cc75-497a-b9a1-d35af91f042c None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:43:38.914883 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-8dac282f-cc75-497a-b9a1-d35af91f042c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:38.959015 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:39.029077 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 699/1387] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:43:39.074176 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9122e09-8847-4b37-9176-c18a19cf5f94 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:43:39.076210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-c9122e09-8847-4b37-9176-c18a19cf5f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:39.159086 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:39.231578 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9122e09-8847-4b37-9176-c18a19cf5f94 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:43:39.353329 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301178d-bef8-4623-b303-a59a585fe971 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:43:39.353873 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301178d-bef8-4623-b303-a59a585fe971 service nova] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:39.354203 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301178d-bef8-4623-b303-a59a585fe971 service nova] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:39.354408 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301178d-bef8-4623-b303-a59a585fe971 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:39.356006 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-9301178d-bef8-4623-b303-a59a585fe971 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:39.401569 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:39.456165 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301178d-bef8-4623-b303-a59a585fe971 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:43:39.457817 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301178d-bef8-4623-b303-a59a585fe971 service nova] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:43:39.478326 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 689/1388] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:43:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:43:41.697712 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890b4ed-889a-4aa1-8d9f-6c874e3e17b9 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:41.698277 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890b4ed-889a-4aa1-8d9f-6c874e3e17b9 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:41.698277 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890b4ed-889a-4aa1-8d9f-6c874e3e17b9 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:41.699599 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 700/1389] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:43:41.704730 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1180200-2d83-4456-be4c-5eb6ccb6166f None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:41.705214 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1180200-2d83-4456-be4c-5eb6ccb6166f None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:41.705321 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1180200-2d83-4456-be4c-5eb6ccb6166f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:41.771360 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-e1180200-2d83-4456-be4c-5eb6ccb6166f None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:43:41.772565 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-e1180200-2d83-4456-be4c-5eb6ccb6166f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:41.870846 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 690/1390] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:43:41.914751 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1890b4ed-889a-4aa1-8d9f-6c874e3e17b9 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:43:41.916272 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-1890b4ed-889a-4aa1-8d9f-6c874e3e17b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:42.067315 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1890b4ed-889a-4aa1-8d9f-6c874e3e17b9 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:43:42.083709 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:42.180795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a4e38-a0ed-442d-8bce-5a14f9ecc397 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:43:42.181466 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a4e38-a0ed-442d-8bce-5a14f9ecc397 service nova] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:42.181746 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a4e38-a0ed-442d-8bce-5a14f9ecc397 service nova] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:42.182018 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a4e38-a0ed-442d-8bce-5a14f9ecc397 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:42.183630 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-d48a4e38-a0ed-442d-8bce-5a14f9ecc397 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:42.273051 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a4e38-a0ed-442d-8bce-5a14f9ecc397 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:43:42.274652 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a4e38-a0ed-442d-8bce-5a14f9ecc397 service nova] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:43:42.292759 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 701/1391] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:43:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:43:42.955683 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957287d-8fcc-4e2c-b795-63af8b855e01 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:42.956254 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957287d-8fcc-4e2c-b795-63af8b855e01 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:42.956254 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957287d-8fcc-4e2c-b795-63af8b855e01 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:42.957624 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 691/1392] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:43:42.962834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4174348-069d-4a2f-b18e-f72b8ff78f3d None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:42.963301 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4174348-069d-4a2f-b18e-f72b8ff78f3d None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:42.963411 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4174348-069d-4a2f-b18e-f72b8ff78f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:42.989759 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:43.030650 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-e4174348-069d-4a2f-b18e-f72b8ff78f3d None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:43:43.032599 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-e4174348-069d-4a2f-b18e-f72b8ff78f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:43.131681 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 702/1393] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:43:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:43:43.187980 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787539f0-3314-4f62-b47b-2e5ced9d9a66 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:43.188516 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787539f0-3314-4f62-b47b-2e5ced9d9a66 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:43.188632 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787539f0-3314-4f62-b47b-2e5ced9d9a66 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:43.189972 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 692/1394] 10.222.0.70 () {54 vars in 967 bytes} [Mon Aug 8 17:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:43:43.195055 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb864a9-ce7c-4813-b7de-df186910f360 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:43.195343 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb864a9-ce7c-4813-b7de-df186910f360 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:43.195615 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb864a9-ce7c-4813-b7de-df186910f360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:43.272880 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-bcb864a9-ce7c-4813-b7de-df186910f360 None None] MFA Rules not processed for user `4fab95367403451b921099425345b3ea`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:43:43.274040 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-bcb864a9-ce7c-4813-b7de-df186910f360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:43.317553 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:43.353440 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 703/1395] 10.222.0.70 () {58 vars in 1064 bytes} [Mon Aug 8 17:43:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:43:43.361477 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787539f0-3314-4f62-b47b-2e5ced9d9a66 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:43:43.362977 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-787539f0-3314-4f62-b47b-2e5ced9d9a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:43.376885 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:43.470123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787539f0-3314-4f62-b47b-2e5ced9d9a66 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:43:43.544735 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005f95e-23ba-421b-a8e6-c203f58d44e2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab95367403451b921099425345b3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:43:43.545304 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005f95e-23ba-421b-a8e6-c203f58d44e2 service glance] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:43.545594 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005f95e-23ba-421b-a8e6-c203f58d44e2 service glance] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:43.545865 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005f95e-23ba-421b-a8e6-c203f58d44e2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:43.548405 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-6005f95e-23ba-421b-a8e6-c203f58d44e2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:43.617951 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:43.659825 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005f95e-23ba-421b-a8e6-c203f58d44e2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:43:43.661780 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005f95e-23ba-421b-a8e6-c203f58d44e2 service glance] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:43:43.680862 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 693/1396] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:43:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:43:44.459216 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc1533-e44c-4485-b8b6-c269ca313d13 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:44.459777 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc1533-e44c-4485-b8b6-c269ca313d13 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:44.459777 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc1533-e44c-4485-b8b6-c269ca313d13 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:44.461114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 704/1397] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:43:44.466733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ccaa5-be6c-4299-92ae-1bbccffdfbd4 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:44.471404 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ccaa5-be6c-4299-92ae-1bbccffdfbd4 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:44.471404 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ccaa5-be6c-4299-92ae-1bbccffdfbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:44.534955 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-4b2ccaa5-be6c-4299-92ae-1bbccffdfbd4 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:43:44.538428 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-4b2ccaa5-be6c-4299-92ae-1bbccffdfbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:44.625467 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb755bbc-a03c-47a9-8fb4-4d51e0a48801 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:44.625757 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb755bbc-a03c-47a9-8fb4-4d51e0a48801 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:44.626032 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb755bbc-a03c-47a9-8fb4-4d51e0a48801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:44.643222 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 694/1398] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:43:44.689020 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ccaa5-be6c-4299-92ae-1bbccffdfbd4 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:43:44.690255 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-4b2ccaa5-be6c-4299-92ae-1bbccffdfbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:44.701075 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-cb755bbc-a03c-47a9-8fb4-4d51e0a48801 None None] MFA Rules not processed for user `c880ab908c114c5897d11aad7fb48607`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:43:44.702276 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-cb755bbc-a03c-47a9-8fb4-4d51e0a48801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:44.719172 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:44.792616 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 705/1399] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Aug 8 17:43:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:43:44.808016 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ccaa5-be6c-4299-92ae-1bbccffdfbd4 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:43:44.836880 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76556454-b831-455e-974c-63970d997d48 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:44.837424 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76556454-b831-455e-974c-63970d997d48 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:44.837698 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76556454-b831-455e-974c-63970d997d48 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:44.839036 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 706/1400] 10.222.0.70 () {54 vars in 943 bytes} [Mon Aug 8 17:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 17:43:44.845566 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840fd13-9a28-4e7e-8f67-893896c07542 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:44.845855 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840fd13-9a28-4e7e-8f67-893896c07542 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:44.846128 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840fd13-9a28-4e7e-8f67-893896c07542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:44.915088 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:44.923373 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-4840fd13-9a28-4e7e-8f67-893896c07542 None None] MFA Rules not processed for user `67b83ff95ed44f35af2e412a700ca567`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:43:44.924586 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-4840fd13-9a28-4e7e-8f67-893896c07542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:44.925396 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a75bb-ece7-4fca-acb5-879a008c4936 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:43:44.926091 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a75bb-ece7-4fca-acb5-879a008c4936 service nova] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:44.926372 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a75bb-ece7-4fca-acb5-879a008c4936 service nova] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:44.926565 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a75bb-ece7-4fca-acb5-879a008c4936 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:44.928154 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-a91a75bb-ece7-4fca-acb5-879a008c4936 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:44.946485 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:45.021121 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a75bb-ece7-4fca-acb5-879a008c4936 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:43:45.022724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a75bb-ece7-4fca-acb5-879a008c4936 service nova] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:43:45.035847 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 707/1401] 10.222.0.70 () {58 vars in 1040 bytes} [Mon Aug 8 17:43:44 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:43:45.041052 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 695/1402] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:43:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:43:45.045335 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840fd13-9a28-4e7e-8f67-893896c07542 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:43:45.056227 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840fd13-9a28-4e7e-8f67-893896c07542 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:43:45.166152 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37859df-885b-480c-a290-c1557959a215 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b83ff95ed44f35af2e412a700ca567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:43:45.166760 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37859df-885b-480c-a290-c1557959a215 service swift] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:45.167046 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37859df-885b-480c-a290-c1557959a215 service swift] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:45.167314 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37859df-885b-480c-a290-c1557959a215 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:45.168949 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-b37859df-885b-480c-a290-c1557959a215 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:45.171490 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:45.261504 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37859df-885b-480c-a290-c1557959a215 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:43:45.263136 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37859df-885b-480c-a290-c1557959a215 service swift] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:43:45.273375 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 708/1403] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Aug 8 17:43:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 17:43:47.250044 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c344e70-1f5f-420d-b7da-e6cb212fea6c None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:47.250838 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c344e70-1f5f-420d-b7da-e6cb212fea6c None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:47.250838 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c344e70-1f5f-420d-b7da-e6cb212fea6c None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:47.252330 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 696/1404] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:43:47.257863 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2e869-548a-4b9d-a18a-ebe6e3dad977 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:47.257863 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2e869-548a-4b9d-a18a-ebe6e3dad977 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:47.258438 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2e869-548a-4b9d-a18a-ebe6e3dad977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:47.336986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-4bf2e869-548a-4b9d-a18a-ebe6e3dad977 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:43:47.338268 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-4bf2e869-548a-4b9d-a18a-ebe6e3dad977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:47.448589 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:47.455413 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 709/1405] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:43:47.506061 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c344e70-1f5f-420d-b7da-e6cb212fea6c None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:43:47.507546 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-1c344e70-1f5f-420d-b7da-e6cb212fea6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:47.666942 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:47.669566 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c344e70-1f5f-420d-b7da-e6cb212fea6c None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:43:47.801108 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e6266-c5da-40e7-a302-ce1b988a6c01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:43:47.801641 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e6266-c5da-40e7-a302-ce1b988a6c01 service nova] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:47.801950 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e6266-c5da-40e7-a302-ce1b988a6c01 service nova] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:47.802225 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e6266-c5da-40e7-a302-ce1b988a6c01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:47.803954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-e99e6266-c5da-40e7-a302-ce1b988a6c01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:47.904368 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e6266-c5da-40e7-a302-ce1b988a6c01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:43:47.906024 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e6266-c5da-40e7-a302-ce1b988a6c01 service nova] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:43:47.926191 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 697/1406] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:43:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:43:50.117167 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fee695-69ab-4a7f-84d0-de4c9417f2d4 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:50.117751 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fee695-69ab-4a7f-84d0-de4c9417f2d4 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:50.117751 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fee695-69ab-4a7f-84d0-de4c9417f2d4 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:50.119039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 710/1407] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:43:50.124122 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7dc90a-07b5-473c-a9fb-2585135d151a None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:50.124535 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7dc90a-07b5-473c-a9fb-2585135d151a None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:50.124723 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7dc90a-07b5-473c-a9fb-2585135d151a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:50.129790 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:50.199153 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-ac7dc90a-07b5-473c-a9fb-2585135d151a None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:43:50.200529 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-ac7dc90a-07b5-473c-a9fb-2585135d151a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:50.314471 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 698/1408] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:43:50.359424 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fee695-69ab-4a7f-84d0-de4c9417f2d4 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:43:50.361540 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-04fee695-69ab-4a7f-84d0-de4c9417f2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:50.579605 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fee695-69ab-4a7f-84d0-de4c9417f2d4 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:43:50.658936 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:43:50.713716 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30865f9-006c-404b-a98e-982328f1f65c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:43:50.714324 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30865f9-006c-404b-a98e-982328f1f65c service nova] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:43:50.714606 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30865f9-006c-404b-a98e-982328f1f65c service nova] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:43:50.714870 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30865f9-006c-404b-a98e-982328f1f65c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:43:50.716492 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-d30865f9-006c-404b-a98e-982328f1f65c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:43:50.822518 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30865f9-006c-404b-a98e-982328f1f65c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:43:50.824478 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30865f9-006c-404b-a98e-982328f1f65c service nova] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:43:50.844917 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 711/1409] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:43:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:44:00.311949 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=64 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:00.842555 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=64 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:09.068479 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095de63-aab6-4889-9cdf-5288a9642c08 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:09.069077 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095de63-aab6-4889-9cdf-5288a9642c08 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:09.069194 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095de63-aab6-4889-9cdf-5288a9642c08 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:09.070475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 699/1410] 10.222.0.70 () {54 vars in 918 bytes} [Mon Aug 8 17:44:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:44:09.075726 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173366d-52ec-4a86-9704-b7a1c2761f05 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:09.076135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173366d-52ec-4a86-9704-b7a1c2761f05 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:09.076280 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173366d-52ec-4a86-9704-b7a1c2761f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:09.152267 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-4173366d-52ec-4a86-9704-b7a1c2761f05 None None] MFA Rules not processed for user `68717c19e74e434da825d9b1d6ca202a`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:44:09.153418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-4173366d-52ec-4a86-9704-b7a1c2761f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:09.258787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 712/1411] 10.222.0.70 () {58 vars in 1015 bytes} [Mon Aug 8 17:44:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:44:09.273884 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f28d01-62f6-4460-8f02-efb18d2c1623 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:09.274205 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f28d01-62f6-4460-8f02-efb18d2c1623 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:09.274495 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f28d01-62f6-4460-8f02-efb18d2c1623 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:09.275824 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 700/1412] 10.222.0.70 () {54 vars in 918 bytes} [Mon Aug 8 17:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:44:09.280378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b391608-9f78-4451-9e6d-8ebc7d1ec0e0 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:09.280669 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b391608-9f78-4451-9e6d-8ebc7d1ec0e0 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:09.280975 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b391608-9f78-4451-9e6d-8ebc7d1ec0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:09.353515 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:09.356542 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-6b391608-9f78-4451-9e6d-8ebc7d1ec0e0 None None] MFA Rules not processed for user `3973b8fbfbb9475896e4e110ca8aa615`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:44:09.357784 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-6b391608-9f78-4451-9e6d-8ebc7d1ec0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:09.474940 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 713/1413] 10.222.0.70 () {58 vars in 1015 bytes} [Mon Aug 8 17:44:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:44:11.934563 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66b66d-2fb5-4ee6-bab3-0914ce6c8125 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:11.935107 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66b66d-2fb5-4ee6-bab3-0914ce6c8125 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:11.935107 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66b66d-2fb5-4ee6-bab3-0914ce6c8125 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:11.936449 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 701/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 17:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:44:11.941753 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20246f-8c5f-4cdb-98e4-653739680c49 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:11.942169 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20246f-8c5f-4cdb-98e4-653739680c49 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:11.942300 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20246f-8c5f-4cdb-98e4-653739680c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:12.010884 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-ef20246f-8c5f-4cdb-98e4-653739680c49 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:44:12.012084 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-ef20246f-8c5f-4cdb-98e4-653739680c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:12.066413 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:12.107626 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 714/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 17:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:44:12.151418 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66b66d-2fb5-4ee6-bab3-0914ce6c8125 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:44:12.152987 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-ed66b66d-2fb5-4ee6-bab3-0914ce6c8125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:12.297577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66b66d-2fb5-4ee6-bab3-0914ce6c8125 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:44:12.369042 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:12.409837 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee3737-fe3f-4782-aa57-ea64fe7c8832 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:44:12.410554 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee3737-fe3f-4782-aa57-ea64fe7c8832 service nova] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:12.410767 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee3737-fe3f-4782-aa57-ea64fe7c8832 service nova] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:12.411364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee3737-fe3f-4782-aa57-ea64fe7c8832 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:12.413739 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-3aee3737-fe3f-4782-aa57-ea64fe7c8832 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:12.503178 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee3737-fe3f-4782-aa57-ea64fe7c8832 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:44:12.504770 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee3737-fe3f-4782-aa57-ea64fe7c8832 service nova] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:44:12.523310 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 702/1416] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:44:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:44:13.421392 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0a015-42bb-41f7-816c-3d2102258820 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:13.421851 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0a015-42bb-41f7-816c-3d2102258820 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:13.421964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0a015-42bb-41f7-816c-3d2102258820 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:13.423288 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 715/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 17:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:44:13.428965 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cf9f7-d6b8-488d-a1d6-1ff3d2ea8033 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:13.429417 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cf9f7-d6b8-488d-a1d6-1ff3d2ea8033 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:13.429540 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cf9f7-d6b8-488d-a1d6-1ff3d2ea8033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:13.504010 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-e08cf9f7-d6b8-488d-a1d6-1ff3d2ea8033 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:44:13.505236 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-e08cf9f7-d6b8-488d-a1d6-1ff3d2ea8033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:13.532357 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:13.601107 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 703/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 17:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:44:13.757071 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0a015-42bb-41f7-816c-3d2102258820 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:44:13.758590 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-ede0a015-42bb-41f7-816c-3d2102258820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:13.904286 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0a015-42bb-41f7-816c-3d2102258820 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:44:13.943712 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:14.017306 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e2e31-0983-47fe-810a-f569af5c6926 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:44:14.017906 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e2e31-0983-47fe-810a-f569af5c6926 service nova] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:14.018185 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e2e31-0983-47fe-810a-f569af5c6926 service nova] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:14.018454 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e2e31-0983-47fe-810a-f569af5c6926 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:14.020033 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-f55e2e31-0983-47fe-810a-f569af5c6926 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:14.107363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e2e31-0983-47fe-810a-f569af5c6926 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:44:14.108941 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e2e31-0983-47fe-810a-f569af5c6926 service nova] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:44:14.127282 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 716/1419] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:44:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:44:15.013466 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab530dcf-89ac-4c99-8ca2-145b4e6e1a47 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:15.014049 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab530dcf-89ac-4c99-8ca2-145b4e6e1a47 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:15.014049 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab530dcf-89ac-4c99-8ca2-145b4e6e1a47 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:15.015350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 704/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 17:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:44:15.020303 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da7081-6ed4-4a2c-b1c2-b5ee103ead04 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:15.020743 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da7081-6ed4-4a2c-b1c2-b5ee103ead04 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:15.020844 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da7081-6ed4-4a2c-b1c2-b5ee103ead04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:15.077257 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:15.097902 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-01da7081-6ed4-4a2c-b1c2-b5ee103ead04 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:44:15.099113 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-01da7081-6ed4-4a2c-b1c2-b5ee103ead04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:15.196685 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 717/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 17:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:44:15.356315 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab530dcf-89ac-4c99-8ca2-145b4e6e1a47 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:44:15.357867 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-ab530dcf-89ac-4c99-8ca2-145b4e6e1a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:15.503473 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab530dcf-89ac-4c99-8ca2-145b4e6e1a47 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:44:15.515435 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:15.614719 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a2072-51e5-4741-915d-6235c7514fc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:44:15.615304 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a2072-51e5-4741-915d-6235c7514fc0 service nova] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:15.615581 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a2072-51e5-4741-915d-6235c7514fc0 service nova] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:15.615852 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a2072-51e5-4741-915d-6235c7514fc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:15.617480 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-4c9a2072-51e5-4741-915d-6235c7514fc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:15.704658 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a2072-51e5-4741-915d-6235c7514fc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:44:15.706287 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a2072-51e5-4741-915d-6235c7514fc0 service nova] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:44:15.724448 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 705/1422] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:44:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:44:16.591012 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3cad6-1dd5-4010-9956-6e2b366af4e3 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:16.591602 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3cad6-1dd5-4010-9956-6e2b366af4e3 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:16.591602 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3cad6-1dd5-4010-9956-6e2b366af4e3 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:16.592917 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 718/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 17:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:44:16.597950 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77242fd-ee22-4c0a-821c-ca50f70c54ff None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:16.598363 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77242fd-ee22-4c0a-821c-ca50f70c54ff None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:16.598565 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77242fd-ee22-4c0a-821c-ca50f70c54ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:16.618853 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:16.801238 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-e77242fd-ee22-4c0a-821c-ca50f70c54ff None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:44:16.802778 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-e77242fd-ee22-4c0a-821c-ca50f70c54ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:16.900776 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 706/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 17:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:44:17.054246 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3cad6-1dd5-4010-9956-6e2b366af4e3 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:44:17.055717 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-a5a3cad6-1dd5-4010-9956-6e2b366af4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:17.166166 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:17.204411 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3cad6-1dd5-4010-9956-6e2b366af4e3 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:44:17.319263 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec61ea8-f0b3-4bdb-9ac5-e18b7ed164b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:44:17.320116 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec61ea8-f0b3-4bdb-9ac5-e18b7ed164b3 service nova] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:17.320399 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec61ea8-f0b3-4bdb-9ac5-e18b7ed164b3 service nova] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:17.320672 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec61ea8-f0b3-4bdb-9ac5-e18b7ed164b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:17.322357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-9ec61ea8-f0b3-4bdb-9ac5-e18b7ed164b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:17.398237 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:17.411447 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec61ea8-f0b3-4bdb-9ac5-e18b7ed164b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:44:17.414106 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec61ea8-f0b3-4bdb-9ac5-e18b7ed164b3 service nova] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:44:17.433153 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 719/1425] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:44:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:44:18.307860 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8600a-40b9-448b-bfe4-2f6768bf7529 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:18.308564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8600a-40b9-448b-bfe4-2f6768bf7529 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:18.308564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8600a-40b9-448b-bfe4-2f6768bf7529 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:18.309823 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 707/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 17:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:44:18.314638 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b67d7-64a4-4108-8c22-595c0097d507 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:18.315086 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b67d7-64a4-4108-8c22-595c0097d507 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:18.315187 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b67d7-64a4-4108-8c22-595c0097d507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:18.392307 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-8b4b67d7-64a4-4108-8c22-595c0097d507 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:44:18.393550 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-8b4b67d7-64a4-4108-8c22-595c0097d507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:18.489791 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 720/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 17:44:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:44:18.645385 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8600a-40b9-448b-bfe4-2f6768bf7529 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:44:18.646974 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-2cc8600a-40b9-448b-bfe4-2f6768bf7529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:18.731650 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:18.793600 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8600a-40b9-448b-bfe4-2f6768bf7529 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:44:18.907102 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1a2b2-d0d4-4bb4-88f2-b86b75f3bcbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:44:18.907624 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1a2b2-d0d4-4bb4-88f2-b86b75f3bcbe service nova] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:18.907902 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1a2b2-d0d4-4bb4-88f2-b86b75f3bcbe service nova] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:18.908173 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1a2b2-d0d4-4bb4-88f2-b86b75f3bcbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:18.909800 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-6cb1a2b2-d0d4-4bb4-88f2-b86b75f3bcbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:18.958393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:18.999817 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb1a2b2-d0d4-4bb4-88f2-b86b75f3bcbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:44:19.001472 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb1a2b2-d0d4-4bb4-88f2-b86b75f3bcbe service nova] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:44:19.019173 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 708/1428] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:44:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:44:19.882181 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7e65e-9c66-431c-af28-26f40c859d5a None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:19.882760 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7e65e-9c66-431c-af28-26f40c859d5a None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:19.882760 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7e65e-9c66-431c-af28-26f40c859d5a None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:19.884066 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 721/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 17:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:44:19.889438 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291dec5-49f0-4d43-a038-0585a613d84b None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:19.889863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291dec5-49f0-4d43-a038-0585a613d84b None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:19.890023 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291dec5-49f0-4d43-a038-0585a613d84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:19.965583 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-e291dec5-49f0-4d43-a038-0585a613d84b None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:44:19.966787 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-e291dec5-49f0-4d43-a038-0585a613d84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:20.062170 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 709/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 17:44:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:44:20.212809 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7e65e-9c66-431c-af28-26f40c859d5a None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:44:20.214369 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-c1d7e65e-9c66-431c-af28-26f40c859d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:20.263895 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:20.360797 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7e65e-9c66-431c-af28-26f40c859d5a None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:44:20.475887 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0f632-957c-4090-a471-91423015a6ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:44:20.476428 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0f632-957c-4090-a471-91423015a6ee service nova] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:20.476710 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0f632-957c-4090-a471-91423015a6ee service nova] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:20.476978 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0f632-957c-4090-a471-91423015a6ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:20.478599 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-2ee0f632-957c-4090-a471-91423015a6ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:20.485662 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:20.567837 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0f632-957c-4090-a471-91423015a6ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:44:20.570072 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0f632-957c-4090-a471-91423015a6ee service nova] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:44:20.588542 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 722/1431] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:44:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:44:21.455508 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22c2e6-602a-469f-8d0e-e4c75961ee4b None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:21.456020 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22c2e6-602a-469f-8d0e-e4c75961ee4b None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:21.456131 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22c2e6-602a-469f-8d0e-e4c75961ee4b None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:21.457471 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 710/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 17:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:44:21.463172 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a210aa-fc9b-4252-8904-e2b3d9c83c90 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:21.463595 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a210aa-fc9b-4252-8904-e2b3d9c83c90 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:21.463716 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a210aa-fc9b-4252-8904-e2b3d9c83c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:21.541176 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-11a210aa-fc9b-4252-8904-e2b3d9c83c90 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:44:21.542405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-11a210aa-fc9b-4252-8904-e2b3d9c83c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:21.610902 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:21.640602 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 723/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 17:44:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:44:21.792443 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22c2e6-602a-469f-8d0e-e4c75961ee4b None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:44:21.794095 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-af22c2e6-602a-469f-8d0e-e4c75961ee4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:21.812299 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:21.937866 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22c2e6-602a-469f-8d0e-e4c75961ee4b None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:44:22.022995 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:22.049551 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e0812-1a55-4c3a-b655-7736841c1269 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:44:22.050247 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e0812-1a55-4c3a-b655-7736841c1269 service nova] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:22.050728 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e0812-1a55-4c3a-b655-7736841c1269 service nova] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:22.051270 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e0812-1a55-4c3a-b655-7736841c1269 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:22.054033 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-dc1e0812-1a55-4c3a-b655-7736841c1269 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:22.144398 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e0812-1a55-4c3a-b655-7736841c1269 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:44:22.146056 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e0812-1a55-4c3a-b655-7736841c1269 service nova] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:44:22.164764 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 711/1434] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:44:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:44:23.031305 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f5a32-81a2-4b84-8037-7c820683e9d8 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:23.031910 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f5a32-81a2-4b84-8037-7c820683e9d8 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:23.031910 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f5a32-81a2-4b84-8037-7c820683e9d8 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:23.033259 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 724/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 17:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:44:23.038131 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa530804-14f6-4d40-a815-3dc13a19d1c0 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:23.038620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa530804-14f6-4d40-a815-3dc13a19d1c0 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:23.038778 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa530804-14f6-4d40-a815-3dc13a19d1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:23.113412 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-fa530804-14f6-4d40-a815-3dc13a19d1c0 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:44:23.114608 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-fa530804-14f6-4d40-a815-3dc13a19d1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:23.156318 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:23.209696 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 712/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 17:44:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:44:23.361256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f5a32-81a2-4b84-8037-7c820683e9d8 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:44:23.362839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-c75f5a32-81a2-4b84-8037-7c820683e9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:23.510483 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f5a32-81a2-4b84-8037-7c820683e9d8 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:44:23.566254 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:23.625594 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1cca5d-ba8c-4d4a-960f-500fb79f0854 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:44:23.626207 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cca5d-ba8c-4d4a-960f-500fb79f0854 service nova] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:23.626494 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cca5d-ba8c-4d4a-960f-500fb79f0854 service nova] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:23.626771 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cca5d-ba8c-4d4a-960f-500fb79f0854 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:23.628419 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-ff1cca5d-ba8c-4d4a-960f-500fb79f0854 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:23.719413 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1cca5d-ba8c-4d4a-960f-500fb79f0854 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:44:23.721285 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1cca5d-ba8c-4d4a-960f-500fb79f0854 service nova] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:44:23.740176 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 725/1437] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:44:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:44:24.608100 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0052f1-ef26-43c4-ac0c-94b6a10e8fae None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:24.608674 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0052f1-ef26-43c4-ac0c-94b6a10e8fae None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:24.608674 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0052f1-ef26-43c4-ac0c-94b6a10e8fae None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:24.610166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 713/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 17:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:44:24.615174 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59490399-a3e7-4f82-8b12-d471ce8b9418 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:24.615573 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59490399-a3e7-4f82-8b12-d471ce8b9418 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:24.615734 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59490399-a3e7-4f82-8b12-d471ce8b9418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:24.812418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-59490399-a3e7-4f82-8b12-d471ce8b9418 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:44:24.813692 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-59490399-a3e7-4f82-8b12-d471ce8b9418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:24.815883 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:24.908912 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 726/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 17:44:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:44:25.059925 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0052f1-ef26-43c4-ac0c-94b6a10e8fae None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:44:25.061403 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-0c0052f1-ef26-43c4-ac0c-94b6a10e8fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:25.203933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0052f1-ef26-43c4-ac0c-94b6a10e8fae None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:44:25.230577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:25.315915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd4491-15aa-444e-9772-ab708c83f58c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:44:25.316424 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd4491-15aa-444e-9772-ab708c83f58c service nova] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:25.316784 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd4491-15aa-444e-9772-ab708c83f58c service nova] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:25.317014 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd4491-15aa-444e-9772-ab708c83f58c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:25.318698 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-50fd4491-15aa-444e-9772-ab708c83f58c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:25.408336 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd4491-15aa-444e-9772-ab708c83f58c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:44:25.409996 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd4491-15aa-444e-9772-ab708c83f58c service nova] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:44:25.428232 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 714/1440] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:44:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:44:27.360902 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646b3b8-33f9-4521-9190-86c18a6c3017 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:27.361438 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646b3b8-33f9-4521-9190-86c18a6c3017 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:27.361551 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646b3b8-33f9-4521-9190-86c18a6c3017 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:27.362820 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 727/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 17:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:44:27.369158 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8b6f4-d7e4-410b-b7f7-09306196f7ea None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:27.369578 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8b6f4-d7e4-410b-b7f7-09306196f7ea None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:27.369740 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8b6f4-d7e4-410b-b7f7-09306196f7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:27.409834 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:27.436940 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-5fa8b6f4-d7e4-410b-b7f7-09306196f7ea None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:44:27.438235 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-5fa8b6f4-d7e4-410b-b7f7-09306196f7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:27.534425 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 715/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 17:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:44:27.573712 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646b3b8-33f9-4521-9190-86c18a6c3017 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:44:27.575253 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-4646b3b8-33f9-4521-9190-86c18a6c3017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:27.677866 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646b3b8-33f9-4521-9190-86c18a6c3017 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:44:27.710540 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:27.751884 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419cbc30-a2b0-485f-af0a-76cb6cb7ac92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:44:27.752492 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cbc30-a2b0-485f-af0a-76cb6cb7ac92 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:27.752832 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cbc30-a2b0-485f-af0a-76cb6cb7ac92 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:27.753219 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cbc30-a2b0-485f-af0a-76cb6cb7ac92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:27.755551 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-419cbc30-a2b0-485f-af0a-76cb6cb7ac92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:27.864821 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419cbc30-a2b0-485f-af0a-76cb6cb7ac92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:44:27.866283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419cbc30-a2b0-485f-af0a-76cb6cb7ac92 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:44:27.884217 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 728/1443] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:44:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:44:30.058823 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adedfcf-2c88-4e72-bcdd-ff2173e24efd None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:30.059367 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adedfcf-2c88-4e72-bcdd-ff2173e24efd None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:30.059367 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adedfcf-2c88-4e72-bcdd-ff2173e24efd None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:30.060725 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 716/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 17:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:44:30.065949 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae3eac-8360-438b-9ce5-e15201c0a5cc None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:30.066396 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae3eac-8360-438b-9ce5-e15201c0a5cc None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:30.066498 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae3eac-8360-438b-9ce5-e15201c0a5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:30.133184 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-19ae3eac-8360-438b-9ce5-e15201c0a5cc None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:44:30.134389 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-19ae3eac-8360-438b-9ce5-e15201c0a5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:30.147089 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:30.231100 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 729/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 17:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:44:30.269722 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adedfcf-2c88-4e72-bcdd-ff2173e24efd None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:44:30.271283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-2adedfcf-2c88-4e72-bcdd-ff2173e24efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:30.381938 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adedfcf-2c88-4e72-bcdd-ff2173e24efd None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:44:30.396081 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:30.457976 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97baa2-7261-4d8d-ae23-00fee1524894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:44:30.458572 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97baa2-7261-4d8d-ae23-00fee1524894 service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:30.458845 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97baa2-7261-4d8d-ae23-00fee1524894 service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:30.459110 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97baa2-7261-4d8d-ae23-00fee1524894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:30.461240 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-1c97baa2-7261-4d8d-ae23-00fee1524894 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:30.571670 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97baa2-7261-4d8d-ae23-00fee1524894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:44:30.573129 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97baa2-7261-4d8d-ae23-00fee1524894 service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:44:30.591617 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 717/1446] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:44:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:44:32.952222 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a85ff2-033b-4d81-b3f9-49256ab47e9a None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:32.952822 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a85ff2-033b-4d81-b3f9-49256ab47e9a None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:32.952822 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a85ff2-033b-4d81-b3f9-49256ab47e9a None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:32.954101 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 730/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 17:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:44:32.959242 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8e657-bae2-4dc5-9ed3-87cd8aad875b None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:32.959658 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8e657-bae2-4dc5-9ed3-87cd8aad875b None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:32.959801 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8e657-bae2-4dc5-9ed3-87cd8aad875b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:33.008754 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:33.027084 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-94a8e657-bae2-4dc5-9ed3-87cd8aad875b None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:44:33.028292 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-94a8e657-bae2-4dc5-9ed3-87cd8aad875b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:33.122600 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 718/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 17:44:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:44:33.166843 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a85ff2-033b-4d81-b3f9-49256ab47e9a None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:44:33.168373 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-b6a85ff2-033b-4d81-b3f9-49256ab47e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:33.274592 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a85ff2-033b-4d81-b3f9-49256ab47e9a None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:44:33.314717 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:33.348838 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f355ac-a391-40af-b910-68719e90a10d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:44:33.349475 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f355ac-a391-40af-b910-68719e90a10d service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:33.349758 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f355ac-a391-40af-b910-68719e90a10d service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:33.350030 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f355ac-a391-40af-b910-68719e90a10d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:33.351788 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-b9f355ac-a391-40af-b910-68719e90a10d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:33.460303 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f355ac-a391-40af-b910-68719e90a10d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:44:33.462469 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f355ac-a391-40af-b910-68719e90a10d service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:44:33.481532 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 731/1449] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:44:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:44:35.614507 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7aa9b-7702-4535-b47f-f9950ca9854a None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:35.615023 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7aa9b-7702-4535-b47f-f9950ca9854a None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:35.615023 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7aa9b-7702-4535-b47f-f9950ca9854a None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:35.616316 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 719/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 17:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:44:35.622473 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe620c97-540a-4025-a878-4ca1ff7164ea None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:35.622904 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe620c97-540a-4025-a878-4ca1ff7164ea None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:35.623037 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe620c97-540a-4025-a878-4ca1ff7164ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:35.687867 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-fe620c97-540a-4025-a878-4ca1ff7164ea None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:44:35.689127 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-fe620c97-540a-4025-a878-4ca1ff7164ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:35.709875 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:35.787004 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 732/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 17:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:44:35.827029 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7aa9b-7702-4535-b47f-f9950ca9854a None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:44:35.828555 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-62d7aa9b-7702-4535-b47f-f9950ca9854a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:35.932210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7aa9b-7702-4535-b47f-f9950ca9854a None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:44:35.952591 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:36.005794 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955dafd-6bfa-42fe-8e6f-910f0180c4ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:44:36.006418 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955dafd-6bfa-42fe-8e6f-910f0180c4ee service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:36.006693 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955dafd-6bfa-42fe-8e6f-910f0180c4ee service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:36.006960 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955dafd-6bfa-42fe-8e6f-910f0180c4ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:36.009631 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-d955dafd-6bfa-42fe-8e6f-910f0180c4ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:36.117812 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d955dafd-6bfa-42fe-8e6f-910f0180c4ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:44:36.119269 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d955dafd-6bfa-42fe-8e6f-910f0180c4ee service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:44:36.137701 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 720/1452] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:44:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:44:38.194029 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b381b8-f1b5-48c6-a559-b84a18642317 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:38.194631 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b381b8-f1b5-48c6-a559-b84a18642317 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:38.194631 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b381b8-f1b5-48c6-a559-b84a18642317 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:38.195990 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 733/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 17:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:44:38.201180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657e8fc-14fd-48ba-a9e4-6752d5e17cb8 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:38.201630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657e8fc-14fd-48ba-a9e4-6752d5e17cb8 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:38.201741 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657e8fc-14fd-48ba-a9e4-6752d5e17cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:38.266148 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:38.268848 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-a657e8fc-14fd-48ba-a9e4-6752d5e17cb8 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:44:38.270107 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-a657e8fc-14fd-48ba-a9e4-6752d5e17cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:38.367403 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 721/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 17:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:44:38.405890 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b381b8-f1b5-48c6-a559-b84a18642317 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:44:38.407414 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-51b381b8-f1b5-48c6-a559-b84a18642317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:38.514028 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b381b8-f1b5-48c6-a559-b84a18642317 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:44:38.565364 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:38.590036 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf06d22-b247-40f6-a3bd-11167181d136 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:44:38.590629 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf06d22-b247-40f6-a3bd-11167181d136 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:38.590903 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf06d22-b247-40f6-a3bd-11167181d136 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:38.591169 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf06d22-b247-40f6-a3bd-11167181d136 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:38.592749 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-fcf06d22-b247-40f6-a3bd-11167181d136 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:38.701542 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf06d22-b247-40f6-a3bd-11167181d136 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:44:38.703002 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf06d22-b247-40f6-a3bd-11167181d136 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:44:38.721290 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 734/1455] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:44:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:44:40.788770 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b8dce-8b5c-4f95-aafb-7f28030ddac1 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:40.789905 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b8dce-8b5c-4f95-aafb-7f28030ddac1 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:40.790145 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b8dce-8b5c-4f95-aafb-7f28030ddac1 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:40.792047 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 722/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 17:44:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:44:40.797348 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3c1c5-3c61-47fb-b7d0-cfdabab43de9 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:40.797830 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3c1c5-3c61-47fb-b7d0-cfdabab43de9 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:40.797942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3c1c5-3c61-47fb-b7d0-cfdabab43de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:40.866167 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-68b3c1c5-3c61-47fb-b7d0-cfdabab43de9 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:44:40.867507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-68b3c1c5-3c61-47fb-b7d0-cfdabab43de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:40.898074 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:40.973175 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 735/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 17:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:44:41.010846 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b8dce-8b5c-4f95-aafb-7f28030ddac1 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:44:41.012370 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-970b8dce-8b5c-4f95-aafb-7f28030ddac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:41.114433 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b8dce-8b5c-4f95-aafb-7f28030ddac1 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:44:41.142739 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:41.187567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82390b-fc4f-4895-a1b8-74369e4ab4f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:44:41.188162 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82390b-fc4f-4895-a1b8-74369e4ab4f2 service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:41.188443 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82390b-fc4f-4895-a1b8-74369e4ab4f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:41.188716 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82390b-fc4f-4895-a1b8-74369e4ab4f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:41.190329 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-eb82390b-fc4f-4895-a1b8-74369e4ab4f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:41.299340 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb82390b-fc4f-4895-a1b8-74369e4ab4f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:44:41.300766 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb82390b-fc4f-4895-a1b8-74369e4ab4f2 service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:44:41.319861 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 723/1458] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:44:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:44:43.407076 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab638dd-a074-49a1-8004-d356f223fafe None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:43.413959 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab638dd-a074-49a1-8004-d356f223fafe None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:43.413959 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab638dd-a074-49a1-8004-d356f223fafe None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:43.413959 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 736/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 17:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:44:43.415446 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55820d6a-7207-42b6-84fe-21a72213caa6 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:43.415446 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55820d6a-7207-42b6-84fe-21a72213caa6 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:43.415895 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55820d6a-7207-42b6-84fe-21a72213caa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:43.481541 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-55820d6a-7207-42b6-84fe-21a72213caa6 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:44:43.482818 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-55820d6a-7207-42b6-84fe-21a72213caa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:43.491184 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:43.580546 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 724/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 17:44:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:44:43.618667 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab638dd-a074-49a1-8004-d356f223fafe None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:44:43.620197 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-9ab638dd-a074-49a1-8004-d356f223fafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:43.723856 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab638dd-a074-49a1-8004-d356f223fafe None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:44:43.778549 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:43.796711 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceef313-fec9-4d55-b0ad-c61140ce61c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:44:43.797476 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceef313-fec9-4d55-b0ad-c61140ce61c1 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:43.797792 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceef313-fec9-4d55-b0ad-c61140ce61c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:43.798065 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceef313-fec9-4d55-b0ad-c61140ce61c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:43.799659 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-0ceef313-fec9-4d55-b0ad-c61140ce61c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:43.906823 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceef313-fec9-4d55-b0ad-c61140ce61c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:44:43.908196 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceef313-fec9-4d55-b0ad-c61140ce61c1 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:44:43.926667 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 737/1461] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:44:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:44:46.020192 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649df894-3846-473f-af74-10eadd0c90a8 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:46.020776 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649df894-3846-473f-af74-10eadd0c90a8 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:46.020776 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649df894-3846-473f-af74-10eadd0c90a8 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:46.022124 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 725/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 17:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:44:46.028063 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a52d45-83ad-467b-bb0d-f9ef293817b4 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:46.028486 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a52d45-83ad-467b-bb0d-f9ef293817b4 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:46.028603 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a52d45-83ad-467b-bb0d-f9ef293817b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:46.094538 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-71a52d45-83ad-467b-bb0d-f9ef293817b4 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:44:46.095745 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-71a52d45-83ad-467b-bb0d-f9ef293817b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:46.133019 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:46.190167 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 738/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 17:44:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:44:46.228754 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649df894-3846-473f-af74-10eadd0c90a8 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:44:46.230305 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-649df894-3846-473f-af74-10eadd0c90a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:46.333363 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649df894-3846-473f-af74-10eadd0c90a8 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:44:46.369993 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:46.405445 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83772a9d-c0da-471c-82f9-c584cc0c4886 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:44:46.406050 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83772a9d-c0da-471c-82f9-c584cc0c4886 service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:46.406330 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83772a9d-c0da-471c-82f9-c584cc0c4886 service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:46.406610 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83772a9d-c0da-471c-82f9-c584cc0c4886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:46.408253 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-83772a9d-c0da-471c-82f9-c584cc0c4886 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:46.517507 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83772a9d-c0da-471c-82f9-c584cc0c4886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:44:46.518945 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83772a9d-c0da-471c-82f9-c584cc0c4886 service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:44:46.537197 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 726/1464] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:44:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:44:48.623209 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e8e88-d67f-407c-b429-f2b49a3a715c None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:48.623665 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e8e88-d67f-407c-b429-f2b49a3a715c None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:48.623758 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e8e88-d67f-407c-b429-f2b49a3a715c None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:48.625119 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 739/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 17:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:44:48.630356 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735252b-2666-4795-865b-da8130a329e4 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:48.630808 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735252b-2666-4795-865b-da8130a329e4 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:48.630918 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735252b-2666-4795-865b-da8130a329e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:48.698016 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-7735252b-2666-4795-865b-da8130a329e4 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:44:48.699236 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-7735252b-2666-4795-865b-da8130a329e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:48.718418 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:48.808344 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 727/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 17:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:44:48.845756 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e8e88-d67f-407c-b429-f2b49a3a715c None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:44:48.847301 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-e63e8e88-d67f-407c-b429-f2b49a3a715c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:48.955675 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e8e88-d67f-407c-b429-f2b49a3a715c None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:44:49.021879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:49.029174 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab16bd4-85da-4257-b8fe-ef04d440ff6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:44:49.029856 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab16bd4-85da-4257-b8fe-ef04d440ff6a service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:49.030137 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab16bd4-85da-4257-b8fe-ef04d440ff6a service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:49.030411 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab16bd4-85da-4257-b8fe-ef04d440ff6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:49.032026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-aab16bd4-85da-4257-b8fe-ef04d440ff6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:49.139341 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab16bd4-85da-4257-b8fe-ef04d440ff6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:44:49.140773 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab16bd4-85da-4257-b8fe-ef04d440ff6a service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:44:49.158902 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 740/1467] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:44:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:44:51.178676 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550350fa-0673-44ac-95f5-f9507b54684f None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:51.179238 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550350fa-0673-44ac-95f5-f9507b54684f None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:51.179238 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550350fa-0673-44ac-95f5-f9507b54684f None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:51.180517 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 17:44:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:44:51.185980 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1940fb5-9268-4500-8e8b-3c22931e19d4 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:51.186409 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1940fb5-9268-4500-8e8b-3c22931e19d4 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:51.186517 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1940fb5-9268-4500-8e8b-3c22931e19d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:51.252346 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-c1940fb5-9268-4500-8e8b-3c22931e19d4 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:44:51.253604 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-c1940fb5-9268-4500-8e8b-3c22931e19d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:51.301601 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:51.350922 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 17:44:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:44:51.387827 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550350fa-0673-44ac-95f5-f9507b54684f None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:44:51.389414 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-550350fa-0673-44ac-95f5-f9507b54684f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:51.493909 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550350fa-0673-44ac-95f5-f9507b54684f None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:44:51.542310 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:44:51.568468 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491823f-e371-4440-928c-2a43f9214379 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:44:51.569278 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491823f-e371-4440-928c-2a43f9214379 service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:44:51.569781 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491823f-e371-4440-928c-2a43f9214379 service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:44:51.570065 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491823f-e371-4440-928c-2a43f9214379 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:44:51.572545 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-f491823f-e371-4440-928c-2a43f9214379 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:44:51.677969 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f491823f-e371-4440-928c-2a43f9214379 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:44:51.679417 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f491823f-e371-4440-928c-2a43f9214379 service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:44:51.698859 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 729/1470] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:44:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:45:01.349104 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=22 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:45:01.695884 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=66 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:45:11.240086 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9c572-f0f1-4696-9db4-e8c36537bc7d None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:45:11.240658 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9c572-f0f1-4696-9db4-e8c36537bc7d None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:45:11.240658 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9c572-f0f1-4696-9db4-e8c36537bc7d None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:45:11.242323 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 742/1471] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:45:11.248029 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa6844-bca9-4005-bedd-0dd48fc7ffb4 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:45:11.248491 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa6844-bca9-4005-bedd-0dd48fc7ffb4 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:45:11.248626 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa6844-bca9-4005-bedd-0dd48fc7ffb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:45:11.314629 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-3eaa6844-bca9-4005-bedd-0dd48fc7ffb4 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:45:11.315823 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-3eaa6844-bca9-4005-bedd-0dd48fc7ffb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:45:11.412524 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 730/1472] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:45:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:45:11.496445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da615b0-1e07-471f-8958-b3b596f933aa None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:45:11.496732 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da615b0-1e07-471f-8958-b3b596f933aa None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:45:11.497008 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da615b0-1e07-471f-8958-b3b596f933aa None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:45:11.498368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 743/1473] 10.222.0.70 () {54 vars in 967 bytes} [Mon Aug 8 17:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:45:11.503391 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f2f77-37b9-426a-a2e5-ef11aeb9704d None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:45:11.503682 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f2f77-37b9-426a-a2e5-ef11aeb9704d None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:45:11.503980 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f2f77-37b9-426a-a2e5-ef11aeb9704d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:45:11.579694 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-750f2f77-37b9-426a-a2e5-ef11aeb9704d None None] MFA Rules not processed for user `4fab95367403451b921099425345b3ea`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:45:11.580891 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-750f2f77-37b9-426a-a2e5-ef11aeb9704d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:45:11.601430 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:45:11.656930 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 731/1474] 10.222.0.70 () {58 vars in 1064 bytes} [Mon Aug 8 17:45:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:45:11.664526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da615b0-1e07-471f-8958-b3b596f933aa None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:45:11.666052 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-9da615b0-1e07-471f-8958-b3b596f933aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:45:11.769011 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da615b0-1e07-471f-8958-b3b596f933aa None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:45:11.843845 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735329f-498f-4eb4-9f38-c5be3880d116 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab95367403451b921099425345b3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:45:11.844582 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735329f-498f-4eb4-9f38-c5be3880d116 service glance] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:45:11.844864 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735329f-498f-4eb4-9f38-c5be3880d116 service glance] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:45:11.845165 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735329f-498f-4eb4-9f38-c5be3880d116 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:45:11.846767 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-0735329f-498f-4eb4-9f38-c5be3880d116 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:45:11.899331 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:45:11.955409 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735329f-498f-4eb4-9f38-c5be3880d116 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:45:11.959870 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735329f-498f-4eb4-9f38-c5be3880d116 service glance] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:45:11.975679 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 744/1475] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:45:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:45:14.080670 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d360ae-762f-463e-8131-eb3801215604 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:45:14.081251 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d360ae-762f-463e-8131-eb3801215604 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:45:14.081251 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d360ae-762f-463e-8131-eb3801215604 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:45:14.082568 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 732/1476] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:45:14.087627 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539ce68-14da-4c6a-b24c-044c8715401d None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:45:14.088049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539ce68-14da-4c6a-b24c-044c8715401d None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:45:14.088154 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539ce68-14da-4c6a-b24c-044c8715401d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:45:14.156304 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-a539ce68-14da-4c6a-b24c-044c8715401d None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:45:14.157531 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-a539ce68-14da-4c6a-b24c-044c8715401d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:45:14.254203 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 745/1477] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:45:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:45:14.278020 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d360ae-762f-463e-8131-eb3801215604 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:45:14.279710 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-36d360ae-762f-463e-8131-eb3801215604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:45:14.412181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d360ae-762f-463e-8131-eb3801215604 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:45:14.453532 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:45:14.497328 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a6189-bcc6-4f3e-88fb-f1379329d50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:45:14.497954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a6189-bcc6-4f3e-88fb-f1379329d50f admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:45:14.498585 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a6189-bcc6-4f3e-88fb-f1379329d50f admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:45:14.498858 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a6189-bcc6-4f3e-88fb-f1379329d50f admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:45:14.499493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a6189-bcc6-4f3e-88fb-f1379329d50f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:45:14.501276 dv-cinder-852364-1-smb devstack@keystone.service[86920]: WARNING py.warnings [None req-3e1a6189-bcc6-4f3e-88fb-f1379329d50f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 17:45:14.501276 dv-cinder-852364-1-smb devstack@keystone.service[86920]: warnings.warn(msg) Aug 08 17:45:14.501276 dv-cinder-852364-1-smb devstack@keystone.service[86920]: Aug 08 17:45:14.502496 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a6189-bcc6-4f3e-88fb-f1379329d50f admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:45:14.521830 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 733/1478] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 8 17:45:14 2022] GET /identity/v3/projects => generated 2553 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:45:16.554288 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f929ec3-10e8-4138-94d5-7e1da7d611ac None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:45:16.554862 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f929ec3-10e8-4138-94d5-7e1da7d611ac None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:45:16.554862 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f929ec3-10e8-4138-94d5-7e1da7d611ac None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:45:16.556228 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 746/1479] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:45:16.561697 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da6a03-9fb3-49b3-a0ce-9e23f1fedb8b None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:45:16.562109 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da6a03-9fb3-49b3-a0ce-9e23f1fedb8b None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:45:16.562250 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da6a03-9fb3-49b3-a0ce-9e23f1fedb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:45:16.627337 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-e0da6a03-9fb3-49b3-a0ce-9e23f1fedb8b None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:45:16.628549 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-e0da6a03-9fb3-49b3-a0ce-9e23f1fedb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:45:16.729301 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 734/1480] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:45:16.772215 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f929ec3-10e8-4138-94d5-7e1da7d611ac None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:45:16.773805 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-5f929ec3-10e8-4138-94d5-7e1da7d611ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:45:16.784116 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:45:16.920163 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f929ec3-10e8-4138-94d5-7e1da7d611ac None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:45:17.008457 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:45:17.041999 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9eeac6-fbcb-463d-8fa4-dd70bbf3be3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:45:17.042772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9eeac6-fbcb-463d-8fa4-dd70bbf3be3d service nova] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:45:17.043055 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9eeac6-fbcb-463d-8fa4-dd70bbf3be3d service nova] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:45:17.043326 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9eeac6-fbcb-463d-8fa4-dd70bbf3be3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:45:17.044926 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-1d9eeac6-fbcb-463d-8fa4-dd70bbf3be3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:45:17.134131 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9eeac6-fbcb-463d-8fa4-dd70bbf3be3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:45:17.136361 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9eeac6-fbcb-463d-8fa4-dd70bbf3be3d service nova] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:45:17.154105 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 747/1481] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:45:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:45:19.396414 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8cdd8-e89d-49e8-94af-f49724ff71b4 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:45:19.396936 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8cdd8-e89d-49e8-94af-f49724ff71b4 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:45:19.397078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8cdd8-e89d-49e8-94af-f49724ff71b4 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:45:19.398341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 735/1482] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:45:19.404304 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fbdcc-0fe6-4482-9eb6-731425606990 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:45:19.404740 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fbdcc-0fe6-4482-9eb6-731425606990 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:45:19.404883 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fbdcc-0fe6-4482-9eb6-731425606990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:45:19.472204 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-332fbdcc-0fe6-4482-9eb6-731425606990 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:45:19.483864 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-332fbdcc-0fe6-4482-9eb6-731425606990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:45:19.521613 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:45:19.576334 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 748/1483] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:45:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:45:19.615195 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8cdd8-e89d-49e8-94af-f49724ff71b4 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:45:19.616724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-13e8cdd8-e89d-49e8-94af-f49724ff71b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:45:19.640530 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:45:19.721955 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8cdd8-e89d-49e8-94af-f49724ff71b4 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:45:19.794059 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9582aa5-265d-45d8-b781-64ca6aa0824a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:45:19.794659 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9582aa5-265d-45d8-b781-64ca6aa0824a service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:45:19.794941 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9582aa5-265d-45d8-b781-64ca6aa0824a service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:45:19.795216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9582aa5-265d-45d8-b781-64ca6aa0824a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:45:19.796824 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-b9582aa5-265d-45d8-b781-64ca6aa0824a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:45:19.870586 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:45:19.905818 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9582aa5-265d-45d8-b781-64ca6aa0824a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:45:19.907257 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9582aa5-265d-45d8-b781-64ca6aa0824a service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:45:19.925337 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 736/1484] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:45:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:45:22.005885 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e1ec1-372a-4273-a709-20455fd5faa9 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:45:22.006356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e1ec1-372a-4273-a709-20455fd5faa9 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:45:22.006464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e1ec1-372a-4273-a709-20455fd5faa9 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:45:22.007820 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 749/1485] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:45:22.013774 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9f791-e3dc-4f41-9ded-966747f3753e None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:45:22.021211 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9f791-e3dc-4f41-9ded-966747f3753e None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:45:22.021211 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9f791-e3dc-4f41-9ded-966747f3753e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:45:22.082261 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-32f9f791-e3dc-4f41-9ded-966747f3753e None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:45:22.083494 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-32f9f791-e3dc-4f41-9ded-966747f3753e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:45:22.179540 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 737/1486] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:45:22.218877 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e1ec1-372a-4273-a709-20455fd5faa9 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:45:22.220431 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-453e1ec1-372a-4273-a709-20455fd5faa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:45:22.322603 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e1ec1-372a-4273-a709-20455fd5faa9 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:45:22.393358 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:45:22.395166 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732d54b-f516-4d7b-b5f0-955117cf4fdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:45:22.395769 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732d54b-f516-4d7b-b5f0-955117cf4fdf service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:45:22.396048 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732d54b-f516-4d7b-b5f0-955117cf4fdf service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:45:22.396315 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732d54b-f516-4d7b-b5f0-955117cf4fdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:45:22.397945 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-e732d54b-f516-4d7b-b5f0-955117cf4fdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:45:22.507845 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732d54b-f516-4d7b-b5f0-955117cf4fdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:45:22.509308 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732d54b-f516-4d7b-b5f0-955117cf4fdf service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:45:22.527858 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 750/1487] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:45:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:45:24.639934 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97177e9b-25c8-4dfd-9a86-5ef650eb2966 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:45:24.640538 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97177e9b-25c8-4dfd-9a86-5ef650eb2966 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:45:24.640538 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97177e9b-25c8-4dfd-9a86-5ef650eb2966 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:45:24.641878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 738/1488] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:45:24.647141 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3d93f-808c-4d22-94bc-3d869b1d50f8 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:45:24.652242 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3d93f-808c-4d22-94bc-3d869b1d50f8 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:45:24.652242 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3d93f-808c-4d22-94bc-3d869b1d50f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:45:24.715450 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-c4f3d93f-808c-4d22-94bc-3d869b1d50f8 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:45:24.716651 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-c4f3d93f-808c-4d22-94bc-3d869b1d50f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:45:24.768908 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:45:24.814000 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 751/1489] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:45:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:45:24.856096 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97177e9b-25c8-4dfd-9a86-5ef650eb2966 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:45:24.857765 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-97177e9b-25c8-4dfd-9a86-5ef650eb2966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:45:24.895089 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:45:24.963905 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97177e9b-25c8-4dfd-9a86-5ef650eb2966 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:45:25.035423 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea1e95-359e-4937-b579-3d5a86c4589f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:45:25.035950 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea1e95-359e-4937-b579-3d5a86c4589f service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:45:25.036227 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea1e95-359e-4937-b579-3d5a86c4589f service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:45:25.036497 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea1e95-359e-4937-b579-3d5a86c4589f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:45:25.038107 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-16ea1e95-359e-4937-b579-3d5a86c4589f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:45:25.116934 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:45:25.146178 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ea1e95-359e-4937-b579-3d5a86c4589f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:45:25.147614 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ea1e95-359e-4937-b579-3d5a86c4589f service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:45:25.165939 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 739/1490] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:45:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:45:27.645807 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc58315-372c-4f7f-9f7f-ab9d8cd867f2 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:45:27.646326 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc58315-372c-4f7f-9f7f-ab9d8cd867f2 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:45:27.646326 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc58315-372c-4f7f-9f7f-ab9d8cd867f2 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:45:27.647619 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 752/1491] 10.222.0.70 () {54 vars in 927 bytes} [Mon Aug 8 17:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:45:27.653328 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a51c2-e95b-40ad-be49-2891a97b46e9 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:45:27.653764 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a51c2-e95b-40ad-be49-2891a97b46e9 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:45:27.653862 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a51c2-e95b-40ad-be49-2891a97b46e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:45:27.719487 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-557a51c2-e95b-40ad-be49-2891a97b46e9 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:45:27.720685 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-557a51c2-e95b-40ad-be49-2891a97b46e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:45:27.818192 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 740/1492] 10.222.0.70 () {58 vars in 1024 bytes} [Mon Aug 8 17:45:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:45:27.858524 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc58315-372c-4f7f-9f7f-ab9d8cd867f2 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:45:27.860065 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-ccc58315-372c-4f7f-9f7f-ab9d8cd867f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:45:27.963675 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc58315-372c-4f7f-9f7f-ab9d8cd867f2 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:45:28.036232 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aaba83-cd71-4bdc-9765-ec0da475232e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:45:28.036840 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aaba83-cd71-4bdc-9765-ec0da475232e service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:45:28.037150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aaba83-cd71-4bdc-9765-ec0da475232e service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:45:28.037424 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aaba83-cd71-4bdc-9765-ec0da475232e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:45:28.039026 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-d6aaba83-cd71-4bdc-9765-ec0da475232e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:45:28.048546 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:45:28.147147 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aaba83-cd71-4bdc-9765-ec0da475232e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:45:28.148578 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aaba83-cd71-4bdc-9765-ec0da475232e service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:45:28.166103 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 753/1493] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:45:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:45:37.816401 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=82 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:45:38.163925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=50 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:46:55.930805 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73593ef-b211-4e4a-9c83-28fe683f74e7 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:46:55.931403 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73593ef-b211-4e4a-9c83-28fe683f74e7 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:46:55.931403 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73593ef-b211-4e4a-9c83-28fe683f74e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:46:56.006397 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-f73593ef-b211-4e4a-9c83-28fe683f74e7 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:46:56.007599 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-f73593ef-b211-4e4a-9c83-28fe683f74e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:46:56.102906 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 741/1494] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:46:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:46:56.111281 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b142400-88a5-42e8-acb4-de69c95dcb39 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:46:56.111789 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b142400-88a5-42e8-acb4-de69c95dcb39 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:46:56.111896 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b142400-88a5-42e8-acb4-de69c95dcb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:46:56.190137 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-1b142400-88a5-42e8-acb4-de69c95dcb39 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:46:56.191972 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-1b142400-88a5-42e8-acb4-de69c95dcb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:46:56.286171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 754/1495] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:46:56.291022 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73593ef-b211-4e4a-9c83-28fe683f74e7 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:46:56.292469 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-f73593ef-b211-4e4a-9c83-28fe683f74e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:46:56.304167 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73593ef-b211-4e4a-9c83-28fe683f74e7 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:46:56.364704 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:46:56.397808 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3029aa9-c05f-4158-8f50-9dea0f82858f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:46:56.398420 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3029aa9-c05f-4158-8f50-9dea0f82858f admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:46:56.398729 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3029aa9-c05f-4158-8f50-9dea0f82858f admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:46:56.398998 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3029aa9-c05f-4158-8f50-9dea0f82858f admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:46:56.399633 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3029aa9-c05f-4158-8f50-9dea0f82858f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:46:56.399927 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3029aa9-c05f-4158-8f50-9dea0f82858f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:46:56.400931 dv-cinder-852364-1-smb devstack@keystone.service[86920]: WARNING py.warnings [None req-d3029aa9-c05f-4158-8f50-9dea0f82858f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 17:46:56.400931 dv-cinder-852364-1-smb devstack@keystone.service[86920]: warnings.warn(msg) Aug 08 17:46:56.400931 dv-cinder-852364-1-smb devstack@keystone.service[86920]: Aug 08 17:46:56.401842 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3029aa9-c05f-4158-8f50-9dea0f82858f admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:46:56.413477 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 742/1496] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:46:56.421726 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b142400-88a5-42e8-acb4-de69c95dcb39 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:46:56.432348 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b142400-88a5-42e8-acb4-de69c95dcb39 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:46:56.494462 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:46:56.529008 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb19a7e-5d10-46d9-ba83-31b1a264bf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:46:56.529638 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb19a7e-5d10-46d9-ba83-31b1a264bf56 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:46:56.529917 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb19a7e-5d10-46d9-ba83-31b1a264bf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:46:56.530187 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb19a7e-5d10-46d9-ba83-31b1a264bf56 admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:46:56.530828 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb19a7e-5d10-46d9-ba83-31b1a264bf56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:46:56.532610 dv-cinder-852364-1-smb devstack@keystone.service[86919]: WARNING py.warnings [None req-4cb19a7e-5d10-46d9-ba83-31b1a264bf56 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 17:46:56.532610 dv-cinder-852364-1-smb devstack@keystone.service[86919]: warnings.warn(msg) Aug 08 17:46:56.532610 dv-cinder-852364-1-smb devstack@keystone.service[86919]: Aug 08 17:46:56.533955 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb19a7e-5d10-46d9-ba83-31b1a264bf56 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:46:56.639938 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 755/1497] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:46:56 2022] POST /identity/v3/projects => generated 379 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:46:56.644104 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3029aa9-c05f-4158-8f50-9dea0f82858f admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:46:56.646191 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-d3029aa9-c05f-4158-8f50-9dea0f82858f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:46:56.679634 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3029aa9-c05f-4158-8f50-9dea0f82858f admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:46:56.773491 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078ca67-84f1-41a4-8b24-254f9f051ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:46:56.774020 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078ca67-84f1-41a4-8b24-254f9f051ffb admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:46:56.774301 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078ca67-84f1-41a4-8b24-254f9f051ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:46:56.774572 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078ca67-84f1-41a4-8b24-254f9f051ffb admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:46:56.775216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1078ca67-84f1-41a4-8b24-254f9f051ffb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:46:56.776624 dv-cinder-852364-1-smb devstack@keystone.service[86920]: WARNING py.warnings [None req-1078ca67-84f1-41a4-8b24-254f9f051ffb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 17:46:56.776624 dv-cinder-852364-1-smb devstack@keystone.service[86920]: warnings.warn(msg) Aug 08 17:46:56.776624 dv-cinder-852364-1-smb devstack@keystone.service[86920]: Aug 08 17:46:56.777871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1078ca67-84f1-41a4-8b24-254f9f051ffb admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:46:56.890541 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 743/1498] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:46:56 2022] POST /identity/v3/users => generated 290 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:46:56.894705 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb19a7e-5d10-46d9-ba83-31b1a264bf56 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:46:56.896337 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-4cb19a7e-5d10-46d9-ba83-31b1a264bf56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:46:56.958585 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb19a7e-5d10-46d9-ba83-31b1a264bf56 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:46:57.040501 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:46:57.050600 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c39e30-8755-4151-9134-a730bd422ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:46:57.056190 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c39e30-8755-4151-9134-a730bd422ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:46:57.056190 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c39e30-8755-4151-9134-a730bd422ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:46:57.056190 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c39e30-8755-4151-9134-a730bd422ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:46:57.056190 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c39e30-8755-4151-9134-a730bd422ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:46:57.056190 dv-cinder-852364-1-smb devstack@keystone.service[86919]: WARNING py.warnings [None req-80c39e30-8755-4151-9134-a730bd422ba7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 17:46:57.056190 dv-cinder-852364-1-smb devstack@keystone.service[86919]: warnings.warn(msg) Aug 08 17:46:57.056190 dv-cinder-852364-1-smb devstack@keystone.service[86919]: Aug 08 17:46:57.056866 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c39e30-8755-4151-9134-a730bd422ba7 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:46:57.067893 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 756/1499] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:46:57.072006 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078ca67-84f1-41a4-8b24-254f9f051ffb admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:46:57.073662 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-1078ca67-84f1-41a4-8b24-254f9f051ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:46:57.086179 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078ca67-84f1-41a4-8b24-254f9f051ffb admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:46:57.110984 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:46:57.183657 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3734a47-82b5-4580-8087-4fcf4d0c56b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:46:57.184251 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3734a47-82b5-4580-8087-4fcf4d0c56b3 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:46:57.184525 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3734a47-82b5-4580-8087-4fcf4d0c56b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:46:57.184790 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3734a47-82b5-4580-8087-4fcf4d0c56b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:46:57.185452 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3734a47-82b5-4580-8087-4fcf4d0c56b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:46:57.186456 dv-cinder-852364-1-smb devstack@keystone.service[86920]: WARNING py.warnings [None req-b3734a47-82b5-4580-8087-4fcf4d0c56b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 17:46:57.186456 dv-cinder-852364-1-smb devstack@keystone.service[86920]: warnings.warn(msg) Aug 08 17:46:57.186456 dv-cinder-852364-1-smb devstack@keystone.service[86920]: Aug 08 17:46:57.187329 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3734a47-82b5-4580-8087-4fcf4d0c56b3 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:46:57.200516 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 744/1500] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:46:57.204737 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c39e30-8755-4151-9134-a730bd422ba7 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:46:57.206298 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-80c39e30-8755-4151-9134-a730bd422ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:46:57.240344 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c39e30-8755-4151-9134-a730bd422ba7 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:46:57.334458 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62a7ef-1a9f-429b-bd45-a6f3e257a0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:46:57.335062 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62a7ef-1a9f-429b-bd45-a6f3e257a0f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:46:57.335342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62a7ef-1a9f-429b-bd45-a6f3e257a0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:46:57.335611 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62a7ef-1a9f-429b-bd45-a6f3e257a0f0 admin admin] PATH_INFO: `/v3/projects/d82adb29b17444219f31fffce8d3a052/users/e8d24b3712524d65a3230834ea5b575d/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:46:57.356749 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62a7ef-1a9f-429b-bd45-a6f3e257a0f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d82adb29b17444219f31fffce8d3a052, user_id=e8d24b3712524d65a3230834ea5b575d, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:46:57.357794 dv-cinder-852364-1-smb devstack@keystone.service[86919]: WARNING py.warnings [None req-ac62a7ef-1a9f-429b-bd45-a6f3e257a0f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 17:46:57.357794 dv-cinder-852364-1-smb devstack@keystone.service[86919]: warnings.warn(msg) Aug 08 17:46:57.357794 dv-cinder-852364-1-smb devstack@keystone.service[86919]: Aug 08 17:46:57.359721 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62a7ef-1a9f-429b-bd45-a6f3e257a0f0 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:46:57.490086 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 757/1501] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:46:57 2022] PUT /identity/v3/projects/d82adb29b17444219f31fffce8d3a052/users/e8d24b3712524d65a3230834ea5b575d/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:46:57.502772 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba3a3f-516d-43d0-abbd-d847587f8671 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:46:57.503156 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba3a3f-516d-43d0-abbd-d847587f8671 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:46:57.503440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba3a3f-516d-43d0-abbd-d847587f8671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:46:57.561046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-0fba3a3f-516d-43d0-abbd-d847587f8671 None None] MFA Rules not processed for user `e8d24b3712524d65a3230834ea5b575d`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:46:57.562294 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-0fba3a3f-516d-43d0-abbd-d847587f8671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:46:57.642588 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 745/1502] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:46:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:46:57.655499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffb382-080c-4410-b131-cac3d5ceecc1 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:46:57.655792 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffb382-080c-4410-b131-cac3d5ceecc1 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:46:57.656071 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffb382-080c-4410-b131-cac3d5ceecc1 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:46:57.657443 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 758/1503] 10.222.0.70 () {54 vars in 964 bytes} [Mon Aug 8 17:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:46:57.662906 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6ed2c-8eae-4a31-bb1d-1584489b8869 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:46:57.663198 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6ed2c-8eae-4a31-bb1d-1584489b8869 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:46:57.663476 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6ed2c-8eae-4a31-bb1d-1584489b8869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:46:57.695850 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:46:57.739992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-d6a6ed2c-8eae-4a31-bb1d-1584489b8869 None None] MFA Rules not processed for user `44340c24b5784b58b829e2faa62ac58a`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:46:57.741244 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-d6a6ed2c-8eae-4a31-bb1d-1584489b8869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:46:57.815914 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 746/1504] 10.222.0.70 () {58 vars in 1061 bytes} [Mon Aug 8 17:46:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:46:57.824069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaffb382-080c-4410-b131-cac3d5ceecc1 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:46:57.825602 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-aaffb382-080c-4410-b131-cac3d5ceecc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:46:57.876935 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:46:57.931021 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaffb382-080c-4410-b131-cac3d5ceecc1 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:46:58.005735 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1740e-a2b0-4c6b-8fef-a0150324bca8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:46:58.006342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1740e-a2b0-4c6b-8fef-a0150324bca8 service cinder] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:46:58.006621 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1740e-a2b0-4c6b-8fef-a0150324bca8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:46:58.006891 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1740e-a2b0-4c6b-8fef-a0150324bca8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:46:58.008489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-2cc1740e-a2b0-4c6b-8fef-a0150324bca8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:46:58.110305 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1740e-a2b0-4c6b-8fef-a0150324bca8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:46:58.111739 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1740e-a2b0-4c6b-8fef-a0150324bca8 service cinder] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:46:58.115247 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:46:58.129156 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 759/1505] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:46:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:46:58.174839 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bba860-cb8f-4a88-8e6a-6460bf755388 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:46:58.175254 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bba860-cb8f-4a88-8e6a-6460bf755388 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:46:58.175386 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bba860-cb8f-4a88-8e6a-6460bf755388 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:46:58.177402 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 747/1506] 10.222.0.70 () {52 vars in 830 bytes} [Mon Aug 8 17:46:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:46:58.180959 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1740e-a2b0-4c6b-8fef-a0150324bca8 service cinder] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:46:58.182258 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-2cc1740e-a2b0-4c6b-8fef-a0150324bca8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:46:58.279440 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1740e-a2b0-4c6b-8fef-a0150324bca8 service cinder] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:46:58.371689 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3023066-d035-47df-9d09-72ba8f4dd45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:46:58.372309 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3023066-d035-47df-9d09-72ba8f4dd45e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:46:58.372587 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3023066-d035-47df-9d09-72ba8f4dd45e admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:46:58.372859 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3023066-d035-47df-9d09-72ba8f4dd45e admin admin] PATH_INFO: `/v3/users/e8d24b3712524d65a3230834ea5b575d` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:46:58.385388 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3023066-d035-47df-9d09-72ba8f4dd45e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8d24b3712524d65a3230834ea5b575d)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:46:58.386403 dv-cinder-852364-1-smb devstack@keystone.service[86919]: WARNING py.warnings [None req-f3023066-d035-47df-9d09-72ba8f4dd45e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 17:46:58.386403 dv-cinder-852364-1-smb devstack@keystone.service[86919]: warnings.warn(msg) Aug 08 17:46:58.386403 dv-cinder-852364-1-smb devstack@keystone.service[86919]: Aug 08 17:46:58.387603 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3023066-d035-47df-9d09-72ba8f4dd45e admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:46:58.397337 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:46:58.685445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-f3023066-d035-47df-9d09-72ba8f4dd45e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8d24b3712524d65a3230834ea5b575d'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:46:58.756350 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-f3023066-d035-47df-9d09-72ba8f4dd45e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8d24b3712524d65a3230834ea5b575d'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:46:58.756874 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-f3023066-d035-47df-9d09-72ba8f4dd45e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8d24b3712524d65a3230834ea5b575d'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:46:58.757337 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-f3023066-d035-47df-9d09-72ba8f4dd45e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8d24b3712524d65a3230834ea5b575d'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:46:58.771203 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-f3023066-d035-47df-9d09-72ba8f4dd45e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8d24b3712524d65a3230834ea5b575d'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:46:58.799046 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 760/1507] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:46:58 2022] DELETE /identity/v3/users/e8d24b3712524d65a3230834ea5b575d => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:46:58.803930 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de29c2c-16ea-46ae-8b87-6c4e3883f178 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:46:58.804222 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de29c2c-16ea-46ae-8b87-6c4e3883f178 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:46:58.804498 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de29c2c-16ea-46ae-8b87-6c4e3883f178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:46:58.862340 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-4de29c2c-16ea-46ae-8b87-6c4e3883f178 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:46:58.864500 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-4de29c2c-16ea-46ae-8b87-6c4e3883f178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:46:58.940752 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:46:58.953536 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 748/1508] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:46:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:46:58.963667 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3023066-d035-47df-9d09-72ba8f4dd45e admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:46:58.964880 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-f3023066-d035-47df-9d09-72ba8f4dd45e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:46:59.064783 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3023066-d035-47df-9d09-72ba8f4dd45e admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:46:59.124080 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:46:59.143234 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2039b47-9290-4909-a8db-e5813657e901 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:46:59.143836 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2039b47-9290-4909-a8db-e5813657e901 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:46:59.144114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2039b47-9290-4909-a8db-e5813657e901 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:46:59.145620 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2039b47-9290-4909-a8db-e5813657e901 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:46:59.147211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-c2039b47-9290-4909-a8db-e5813657e901 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:46:59.259052 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2039b47-9290-4909-a8db-e5813657e901 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:46:59.260400 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2039b47-9290-4909-a8db-e5813657e901 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:46:59.279444 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 761/1509] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:46:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:46:59.775770 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de29c2c-16ea-46ae-8b87-6c4e3883f178 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:46:59.775770 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-4de29c2c-16ea-46ae-8b87-6c4e3883f178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:46:59.786540 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de29c2c-16ea-46ae-8b87-6c4e3883f178 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:46:59.884620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97b408-7517-4040-afe0-d6f99c6f17ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:46:59.885278 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97b408-7517-4040-afe0-d6f99c6f17ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:46:59.885555 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97b408-7517-4040-afe0-d6f99c6f17ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:46:59.885822 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97b408-7517-4040-afe0-d6f99c6f17ad admin admin] PATH_INFO: `/v3/projects/d82adb29b17444219f31fffce8d3a052` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:46:59.896630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97b408-7517-4040-afe0-d6f99c6f17ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=d82adb29b17444219f31fffce8d3a052)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:46:59.897679 dv-cinder-852364-1-smb devstack@keystone.service[86920]: WARNING py.warnings [None req-3d97b408-7517-4040-afe0-d6f99c6f17ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 17:46:59.897679 dv-cinder-852364-1-smb devstack@keystone.service[86920]: warnings.warn(msg) Aug 08 17:46:59.897679 dv-cinder-852364-1-smb devstack@keystone.service[86920]: Aug 08 17:46:59.898864 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97b408-7517-4040-afe0-d6f99c6f17ad admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:47:00.014545 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-3d97b408-7517-4040-afe0-d6f99c6f17ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd82adb29b17444219f31fffce8d3a052', 'request_id': 'req-3d97b408-7517-4040-afe0-d6f99c6f17ad'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:47:00.021391 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-3d97b408-7517-4040-afe0-d6f99c6f17ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd82adb29b17444219f31fffce8d3a052', 'request_id': 'req-3d97b408-7517-4040-afe0-d6f99c6f17ad'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:47:00.118721 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-3d97b408-7517-4040-afe0-d6f99c6f17ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd82adb29b17444219f31fffce8d3a052', 'request_id': 'req-3d97b408-7517-4040-afe0-d6f99c6f17ad'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:47:00.149435 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-3d97b408-7517-4040-afe0-d6f99c6f17ad admin admin] The token cache is being invalidate because project d82adb29b17444219f31fffce8d3a052 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:47:00.149721 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-3d97b408-7517-4040-afe0-d6f99c6f17ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:47:00.150248 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-3d97b408-7517-4040-afe0-d6f99c6f17ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:47:00.151583 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 749/1510] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:46:59 2022] DELETE /identity/v3/projects/d82adb29b17444219f31fffce8d3a052 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:47:09.277244 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=62 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:47:10.147555 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:48:35.532474 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ee4d8-a003-4646-ac39-93d75b6f4459 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:48:35.533019 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ee4d8-a003-4646-ac39-93d75b6f4459 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:48:35.533019 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ee4d8-a003-4646-ac39-93d75b6f4459 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:48:35.534416 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 762/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 17:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:48:35.539154 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54f78e-168c-429c-a52b-3385030a3618 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:48:35.539559 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54f78e-168c-429c-a52b-3385030a3618 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:48:35.539711 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54f78e-168c-429c-a52b-3385030a3618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:48:35.620518 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-5b54f78e-168c-429c-a52b-3385030a3618 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:48:35.621756 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-5b54f78e-168c-429c-a52b-3385030a3618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:48:35.724663 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 750/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 17:48:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:48:35.881366 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ee4d8-a003-4646-ac39-93d75b6f4459 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:48:35.884152 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-403ee4d8-a003-4646-ac39-93d75b6f4459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:48:36.011531 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ee4d8-a003-4646-ac39-93d75b6f4459 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:48:36.017340 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea72a5a-0881-411b-a234-88de15165b96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:48:36.017946 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea72a5a-0881-411b-a234-88de15165b96 service nova] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:48:36.018343 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea72a5a-0881-411b-a234-88de15165b96 service nova] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:48:36.018637 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea72a5a-0881-411b-a234-88de15165b96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:48:36.026742 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea72a5a-0881-411b-a234-88de15165b96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:48:36.028351 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea72a5a-0881-411b-a234-88de15165b96 service nova] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:48:36.038131 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 763/1513] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:48:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:48:36.878403 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc71be-e65c-413a-8994-6c39eb8efdce None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:48:36.878996 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc71be-e65c-413a-8994-6c39eb8efdce None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:48:36.878996 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc71be-e65c-413a-8994-6c39eb8efdce None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:48:36.880289 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 751/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 17:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:48:36.885020 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420de71c-c23a-4201-b1c5-02279b0b376d None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:48:36.885490 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420de71c-c23a-4201-b1c5-02279b0b376d None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:48:36.885633 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420de71c-c23a-4201-b1c5-02279b0b376d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:48:36.907069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-420de71c-c23a-4201-b1c5-02279b0b376d None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:48:36.908278 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-420de71c-c23a-4201-b1c5-02279b0b376d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:48:36.916115 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 764/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 17:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:48:37.067691 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc71be-e65c-413a-8994-6c39eb8efdce None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:48:37.083296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc71be-e65c-413a-8994-6c39eb8efdce None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:48:37.088827 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18648af5-03e4-4526-bd74-699b98710b36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:48:37.089446 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18648af5-03e4-4526-bd74-699b98710b36 service nova] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:48:37.089751 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18648af5-03e4-4526-bd74-699b98710b36 service nova] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:48:37.090016 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18648af5-03e4-4526-bd74-699b98710b36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:48:37.099047 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18648af5-03e4-4526-bd74-699b98710b36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:48:37.100644 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18648af5-03e4-4526-bd74-699b98710b36 service nova] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:48:37.110127 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 752/1516] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:48:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:48:37.445484 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18f73b-f4fb-46aa-8092-9cdea15c7fb2 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:48:37.445774 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18f73b-f4fb-46aa-8092-9cdea15c7fb2 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:48:37.446051 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18f73b-f4fb-46aa-8092-9cdea15c7fb2 None None] PATH_INFO: `/v3` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:48:37.447331 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 765/1517] 10.222.0.75 () {54 vars in 925 bytes} [Mon Aug 8 17:48:37 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:48:37.454043 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f8d7f-d720-4438-8e5c-77d1bf2f48da None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:48:37.454330 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f8d7f-d720-4438-8e5c-77d1bf2f48da None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:48:37.454605 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f8d7f-d720-4438-8e5c-77d1bf2f48da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:48:37.513621 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-7c7f8d7f-d720-4438-8e5c-77d1bf2f48da None None] MFA Rules not processed for user `68717c19e74e434da825d9b1d6ca202a`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:48:37.515209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-7c7f8d7f-d720-4438-8e5c-77d1bf2f48da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:48:37.533580 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:48:37.589659 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 753/1518] 10.222.0.75 () {58 vars in 1015 bytes} [Mon Aug 8 17:48:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:48:41.570229 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7870bf-e383-49c7-a021-4fe464b717a7 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:48:41.570733 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7870bf-e383-49c7-a021-4fe464b717a7 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:48:41.570733 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7870bf-e383-49c7-a021-4fe464b717a7 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:48:41.572065 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 766/1519] 10.222.0.70 () {54 vars in 961 bytes} [Mon Aug 8 17:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:48:41.577773 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbbd07-df6d-4892-b72c-3bda64f99b7e None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:48:41.578477 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbbd07-df6d-4892-b72c-3bda64f99b7e None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:48:41.578594 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbbd07-df6d-4892-b72c-3bda64f99b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:48:41.598335 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-e3cbbd07-df6d-4892-b72c-3bda64f99b7e None None] MFA Rules not processed for user `68717c19e74e434da825d9b1d6ca202a`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:48:41.599527 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-e3cbbd07-df6d-4892-b72c-3bda64f99b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:48:41.608190 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 754/1520] 10.222.0.70 () {58 vars in 1058 bytes} [Mon Aug 8 17:48:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:48:41.615920 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7870bf-e383-49c7-a021-4fe464b717a7 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:48:41.629224 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7870bf-e383-49c7-a021-4fe464b717a7 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:48:41.634176 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d86c8-a207-46db-9c1b-368588a6791b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68717c19e74e434da825d9b1d6ca202a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:48:41.634787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d86c8-a207-46db-9c1b-368588a6791b service placement] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:48:41.635066 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d86c8-a207-46db-9c1b-368588a6791b service placement] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:48:41.635340 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d86c8-a207-46db-9c1b-368588a6791b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:48:41.643997 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d86c8-a207-46db-9c1b-368588a6791b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:48:41.645640 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d86c8-a207-46db-9c1b-368588a6791b service placement] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:48:41.655916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 767/1521] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:48:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:48:48.347457 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47dd64b-530f-459b-8434-f7eae6412c2a None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:48:48.348040 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47dd64b-530f-459b-8434-f7eae6412c2a None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:48:48.348040 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47dd64b-530f-459b-8434-f7eae6412c2a None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:48:48.349405 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 755/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 17:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:48:48.354341 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a019b-48b0-4f0d-8846-80164e6800ee None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:48:48.354751 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a019b-48b0-4f0d-8846-80164e6800ee None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:48:48.354875 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a019b-48b0-4f0d-8846-80164e6800ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:48:48.375165 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-fc3a019b-48b0-4f0d-8846-80164e6800ee None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:48:48.376370 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-fc3a019b-48b0-4f0d-8846-80164e6800ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:48:48.384207 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 768/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 17:48:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:48:48.539040 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47dd64b-530f-459b-8434-f7eae6412c2a None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:48:48.554081 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47dd64b-530f-459b-8434-f7eae6412c2a None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:48:48.559690 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa4437-6b8c-4e96-abc1-80f69377178d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:48:48.560285 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa4437-6b8c-4e96-abc1-80f69377178d service nova] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:48:48.560567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa4437-6b8c-4e96-abc1-80f69377178d service nova] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:48:48.560842 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa4437-6b8c-4e96-abc1-80f69377178d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:48:48.569185 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa4437-6b8c-4e96-abc1-80f69377178d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:48:48.570698 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa4437-6b8c-4e96-abc1-80f69377178d service nova] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:48:48.581278 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 756/1524] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:48:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:48:49.404651 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d7b31-3576-4d9b-9bf6-31020f2bb7f7 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:48:49.405708 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d7b31-3576-4d9b-9bf6-31020f2bb7f7 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:48:49.405809 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d7b31-3576-4d9b-9bf6-31020f2bb7f7 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:48:49.407241 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 769/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 17:48:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:48:49.412079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc8fd2-6f7f-4226-ac91-74a66961f6a9 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:48:49.412540 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc8fd2-6f7f-4226-ac91-74a66961f6a9 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:48:49.413146 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc8fd2-6f7f-4226-ac91-74a66961f6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:48:49.432601 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-f3dc8fd2-6f7f-4226-ac91-74a66961f6a9 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:48:49.433839 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-f3dc8fd2-6f7f-4226-ac91-74a66961f6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:48:49.442229 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 757/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 17:48:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:48:49.596745 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d7b31-3576-4d9b-9bf6-31020f2bb7f7 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:48:49.611116 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d7b31-3576-4d9b-9bf6-31020f2bb7f7 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:48:49.616556 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3595e-58b6-47e1-9af2-19930978e367 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:48:49.617182 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3595e-58b6-47e1-9af2-19930978e367 service nova] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:48:49.617468 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3595e-58b6-47e1-9af2-19930978e367 service nova] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:48:49.617742 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3595e-58b6-47e1-9af2-19930978e367 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:48:49.625876 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3595e-58b6-47e1-9af2-19930978e367 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:48:49.627489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3595e-58b6-47e1-9af2-19930978e367 service nova] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:48:49.636825 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 770/1527] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:48:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:48:53.814846 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306698f-4ffe-4163-ae64-d679d1632646 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:48:53.815409 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306698f-4ffe-4163-ae64-d679d1632646 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:48:53.815409 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306698f-4ffe-4163-ae64-d679d1632646 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:48:53.816759 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 758/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 17:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:48:53.822049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69b5d6-0797-4454-8d3d-9da9a2cba98b None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:48:53.822510 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69b5d6-0797-4454-8d3d-9da9a2cba98b None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:48:53.822618 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69b5d6-0797-4454-8d3d-9da9a2cba98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:48:53.842248 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-ce69b5d6-0797-4454-8d3d-9da9a2cba98b None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:48:53.844490 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-ce69b5d6-0797-4454-8d3d-9da9a2cba98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:48:53.852184 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 771/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 17:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:48:53.928853 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306698f-4ffe-4163-ae64-d679d1632646 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:48:53.930643 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-b306698f-4ffe-4163-ae64-d679d1632646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:48:54.007663 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306698f-4ffe-4163-ae64-d679d1632646 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:48:54.011129 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a01e6-7ca2-45f9-a8fd-75ae5c1398e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:48:54.011719 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a01e6-7ca2-45f9-a8fd-75ae5c1398e0 service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:48:54.011994 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a01e6-7ca2-45f9-a8fd-75ae5c1398e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:48:54.012261 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a01e6-7ca2-45f9-a8fd-75ae5c1398e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:48:54.021499 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a01e6-7ca2-45f9-a8fd-75ae5c1398e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:48:54.022921 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a01e6-7ca2-45f9-a8fd-75ae5c1398e0 service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:48:54.032921 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 759/1530] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:48:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:48:56.047235 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a185d6-58ac-4304-a8ee-96732f13b543 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:48:56.047838 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a185d6-58ac-4304-a8ee-96732f13b543 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:48:56.047838 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a185d6-58ac-4304-a8ee-96732f13b543 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:48:56.049150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 772/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 17:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:48:56.054440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03046f74-b56c-4c31-8884-82103d306ea1 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:48:56.054883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03046f74-b56c-4c31-8884-82103d306ea1 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:48:56.055002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03046f74-b56c-4c31-8884-82103d306ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:48:56.074722 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-03046f74-b56c-4c31-8884-82103d306ea1 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:48:56.075928 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-03046f74-b56c-4c31-8884-82103d306ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:48:56.084873 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 760/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 17:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:48:56.120077 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a185d6-58ac-4304-a8ee-96732f13b543 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:48:56.131460 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a185d6-58ac-4304-a8ee-96732f13b543 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:48:56.134960 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d99e7eb-6456-44e0-85e9-219c1eebd40b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:48:56.135554 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99e7eb-6456-44e0-85e9-219c1eebd40b service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:48:56.135837 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99e7eb-6456-44e0-85e9-219c1eebd40b service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:48:56.136112 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99e7eb-6456-44e0-85e9-219c1eebd40b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:48:56.145583 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d99e7eb-6456-44e0-85e9-219c1eebd40b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:48:56.147008 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d99e7eb-6456-44e0-85e9-219c1eebd40b service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:48:56.156348 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 773/1533] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:48:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:48:59.764271 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65282cc2-cb95-402a-a874-6c609a610f92 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:48:59.764850 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65282cc2-cb95-402a-a874-6c609a610f92 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:48:59.764850 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65282cc2-cb95-402a-a874-6c609a610f92 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:48:59.766809 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 761/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 17:48:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 17:48:59.771868 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61da78-3c69-4079-b401-1023eba839f0 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:48:59.772277 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61da78-3c69-4079-b401-1023eba839f0 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:48:59.772420 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61da78-3c69-4079-b401-1023eba839f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:48:59.779970 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=81 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:48:59.792794 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-9d61da78-3c69-4079-b401-1023eba839f0 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:48:59.803886 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-9d61da78-3c69-4079-b401-1023eba839f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:48:59.803886 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 774/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 17:48:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:49:00.107362 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65282cc2-cb95-402a-a874-6c609a610f92 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:49:00.110175 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-65282cc2-cb95-402a-a874-6c609a610f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:49:00.175207 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:49:00.189082 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65282cc2-cb95-402a-a874-6c609a610f92 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:49:00.192658 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561f6ec-f9d0-4805-bca4-f4fc94726beb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:49:00.193285 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561f6ec-f9d0-4805-bca4-f4fc94726beb service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:49:00.193562 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561f6ec-f9d0-4805-bca4-f4fc94726beb service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:49:00.193831 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561f6ec-f9d0-4805-bca4-f4fc94726beb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:49:00.203127 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561f6ec-f9d0-4805-bca4-f4fc94726beb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:49:00.204614 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561f6ec-f9d0-4805-bca4-f4fc94726beb service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:49:00.214661 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 762/1536] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:49:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:49:02.251975 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2453b52-cb73-4ce3-9d14-4905076d13ce None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:49:02.252546 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2453b52-cb73-4ce3-9d14-4905076d13ce None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:49:02.252546 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2453b52-cb73-4ce3-9d14-4905076d13ce None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:49:02.253851 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 775/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 17:49:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:49:02.258917 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e590e1-ed4c-4056-94ba-b74d33c55549 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:49:02.259360 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e590e1-ed4c-4056-94ba-b74d33c55549 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:49:02.259474 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e590e1-ed4c-4056-94ba-b74d33c55549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:49:02.279406 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-e4e590e1-ed4c-4056-94ba-b74d33c55549 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:49:02.280599 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-e4e590e1-ed4c-4056-94ba-b74d33c55549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:49:02.288596 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 763/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 17:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:49:02.598931 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2453b52-cb73-4ce3-9d14-4905076d13ce None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:49:02.600596 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-c2453b52-cb73-4ce3-9d14-4905076d13ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:49:02.614253 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2453b52-cb73-4ce3-9d14-4905076d13ce None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:49:02.617912 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de2489-17a2-4a14-b732-51db1df49987 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:49:02.618501 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de2489-17a2-4a14-b732-51db1df49987 service cinder] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:49:02.618779 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de2489-17a2-4a14-b732-51db1df49987 service cinder] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:49:02.619049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de2489-17a2-4a14-b732-51db1df49987 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:49:02.628527 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de2489-17a2-4a14-b732-51db1df49987 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:49:02.629987 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de2489-17a2-4a14-b732-51db1df49987 service cinder] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:49:02.639448 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 776/1539] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:49:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:49:12.274647 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=11 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:49:12.635398 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=8 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:29.559892 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096b5f6-7edc-40f9-9bb2-f1479f36e040 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:29.560538 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096b5f6-7edc-40f9-9bb2-f1479f36e040 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:29.560538 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096b5f6-7edc-40f9-9bb2-f1479f36e040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:29.591223 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-d096b5f6-7edc-40f9-9bb2-f1479f36e040 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:29.592432 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-d096b5f6-7edc-40f9-9bb2-f1479f36e040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:29.607186 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 764/1540] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:50:29.616531 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245801e-87aa-41b5-a97b-0d3af8352dcd None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:29.617552 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245801e-87aa-41b5-a97b-0d3af8352dcd None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:29.618051 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245801e-87aa-41b5-a97b-0d3af8352dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:29.646864 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-9245801e-87aa-41b5-a97b-0d3af8352dcd None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:29.648431 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-9245801e-87aa-41b5-a97b-0d3af8352dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:29.659613 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 777/1541] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:29.665066 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096b5f6-7edc-40f9-9bb2-f1479f36e040 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:29.679140 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096b5f6-7edc-40f9-9bb2-f1479f36e040 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:29.688335 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff401b84-f3c5-4b95-9b0b-84aed5624158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:29.688957 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff401b84-f3c5-4b95-9b0b-84aed5624158 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:29.689258 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff401b84-f3c5-4b95-9b0b-84aed5624158 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:29.689533 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff401b84-f3c5-4b95-9b0b-84aed5624158 admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:29.690183 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff401b84-f3c5-4b95-9b0b-84aed5624158 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:50:29.690489 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff401b84-f3c5-4b95-9b0b-84aed5624158 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:29.692101 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff401b84-f3c5-4b95-9b0b-84aed5624158 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:29.708631 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 765/1542] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:50:29.717708 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245801e-87aa-41b5-a97b-0d3af8352dcd None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:29.730615 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245801e-87aa-41b5-a97b-0d3af8352dcd None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:29.742794 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dbbb13-0d7d-4832-8a69-a33375b8bbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:29.743779 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbbb13-0d7d-4832-8a69-a33375b8bbfb admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:29.744334 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbbb13-0d7d-4832-8a69-a33375b8bbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:29.744861 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbbb13-0d7d-4832-8a69-a33375b8bbfb admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:29.745761 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dbbb13-0d7d-4832-8a69-a33375b8bbfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:29.747934 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dbbb13-0d7d-4832-8a69-a33375b8bbfb admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:29.851130 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae33c38-b151-44ad-a679-a1a52459b18b None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:29.851398 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae33c38-b151-44ad-a679-a1a52459b18b None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:29.851691 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae33c38-b151-44ad-a679-a1a52459b18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:29.888221 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-3ae33c38-b151-44ad-a679-a1a52459b18b None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:29.889572 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-3ae33c38-b151-44ad-a679-a1a52459b18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:29.908446 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 766/1543] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:50:29.911627 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 778/1544] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:50:29 2022] POST /identity/v3/projects => generated 365 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:50:29.917362 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae33c38-b151-44ad-a679-a1a52459b18b None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:29.932028 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae33c38-b151-44ad-a679-a1a52459b18b None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:29.936611 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409f1ad-27d6-4efe-8a3f-e2a12b8b1024 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:29.937283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409f1ad-27d6-4efe-8a3f-e2a12b8b1024 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:29.937790 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409f1ad-27d6-4efe-8a3f-e2a12b8b1024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:29.976676 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-2409f1ad-27d6-4efe-8a3f-e2a12b8b1024 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:29.978341 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-2409f1ad-27d6-4efe-8a3f-e2a12b8b1024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:30.092041 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 779/1545] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:50:30.098670 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409f1ad-27d6-4efe-8a3f-e2a12b8b1024 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:30.100410 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f4a9d-a61d-43c7-85b6-e8984cd3682d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:30.101052 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f4a9d-a61d-43c7-85b6-e8984cd3682d admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:30.101336 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f4a9d-a61d-43c7-85b6-e8984cd3682d admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:30.101612 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f4a9d-a61d-43c7-85b6-e8984cd3682d admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:30.102253 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4f4a9d-a61d-43c7-85b6-e8984cd3682d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:30.104198 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4f4a9d-a61d-43c7-85b6-e8984cd3682d admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:30.110417 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409f1ad-27d6-4efe-8a3f-e2a12b8b1024 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:30.128545 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551309f0-bb6d-41bb-ad08-35ce6101c13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:30.129696 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551309f0-bb6d-41bb-ad08-35ce6101c13d admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:30.130238 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551309f0-bb6d-41bb-ad08-35ce6101c13d admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:30.130952 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551309f0-bb6d-41bb-ad08-35ce6101c13d admin admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:30.131953 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551309f0-bb6d-41bb-ad08-35ce6101c13d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:50:30.132615 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551309f0-bb6d-41bb-ad08-35ce6101c13d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:30.133998 dv-cinder-852364-1-smb devstack@keystone.service[86919]: WARNING py.warnings [None req-551309f0-bb6d-41bb-ad08-35ce6101c13d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 17:50:30.133998 dv-cinder-852364-1-smb devstack@keystone.service[86919]: warnings.warn(msg) Aug 08 17:50:30.133998 dv-cinder-852364-1-smb devstack@keystone.service[86919]: Aug 08 17:50:30.141556 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551309f0-bb6d-41bb-ad08-35ce6101c13d admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:30.156295 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 780/1546] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:50:30.158062 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf95104-33ba-449d-9c77-30f926035a6b None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:30.158584 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf95104-33ba-449d-9c77-30f926035a6b None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:30.159111 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf95104-33ba-449d-9c77-30f926035a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:30.186717 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-edf95104-33ba-449d-9c77-30f926035a6b None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:30.188363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-edf95104-33ba-449d-9c77-30f926035a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:30.200140 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 781/1547] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:30.201508 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf95104-33ba-449d-9c77-30f926035a6b None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:30.208551 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 767/1548] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:50:29 2022] POST /identity/v3/users => generated 283 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:50:30.210234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed07b6f-b18b-48da-a555-a194c86f553b None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:30.214179 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed07b6f-b18b-48da-a555-a194c86f553b None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:30.214179 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed07b6f-b18b-48da-a555-a194c86f553b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:30.214504 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf95104-33ba-449d-9c77-30f926035a6b None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:30.233198 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4b8f9-15cb-425d-942d-4c3494642ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:30.234216 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4b8f9-15cb-425d-942d-4c3494642ede admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:30.234750 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4b8f9-15cb-425d-942d-4c3494642ede admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:30.235240 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4b8f9-15cb-425d-942d-4c3494642ede admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:30.236091 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4b8f9-15cb-425d-942d-4c3494642ede admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:30.238569 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4b8f9-15cb-425d-942d-4c3494642ede admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:30.246060 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-2ed07b6f-b18b-48da-a555-a194c86f553b None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:30.247295 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-2ed07b6f-b18b-48da-a555-a194c86f553b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:30.257962 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 768/1549] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:30.259236 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3deac-04da-44a5-ad03-6afc4b961ef3 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:30.259525 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3deac-04da-44a5-ad03-6afc4b961ef3 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:30.259801 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3deac-04da-44a5-ad03-6afc4b961ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:30.286531 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-93e3deac-04da-44a5-ad03-6afc4b961ef3 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:30.288561 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-93e3deac-04da-44a5-ad03-6afc4b961ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:30.296907 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 769/1550] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:30.297729 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3deac-04da-44a5-ad03-6afc4b961ef3 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:30.308183 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3deac-04da-44a5-ad03-6afc4b961ef3 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:30.312922 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a12410-87df-454a-9ccb-3cced6165af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:30.313576 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a12410-87df-454a-9ccb-3cced6165af4 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:30.313857 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a12410-87df-454a-9ccb-3cced6165af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:30.314130 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a12410-87df-454a-9ccb-3cced6165af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:30.314769 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a12410-87df-454a-9ccb-3cced6165af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:30.316371 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a12410-87df-454a-9ccb-3cced6165af4 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:30.326849 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 770/1551] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:50:30.328011 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac2be2-efc2-49c0-b49f-c5641df8ce1d None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:30.328298 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac2be2-efc2-49c0-b49f-c5641df8ce1d None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:30.328569 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac2be2-efc2-49c0-b49f-c5641df8ce1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:30.339735 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 782/1552] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:50:30 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:50:30.341159 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4b8f9-15cb-425d-942d-4c3494642ede admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:30.351032 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-0dac2be2-efc2-49c0-b49f-c5641df8ce1d None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:30.352450 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-0dac2be2-efc2-49c0-b49f-c5641df8ce1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:30.408203 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4b8f9-15cb-425d-942d-4c3494642ede admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:30.413745 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63159343-f6a3-4d0f-b265-6a1fe7fec10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:30.414554 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63159343-f6a3-4d0f-b265-6a1fe7fec10e admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:30.414665 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63159343-f6a3-4d0f-b265-6a1fe7fec10e admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:30.414892 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63159343-f6a3-4d0f-b265-6a1fe7fec10e admin admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:30.415584 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63159343-f6a3-4d0f-b265-6a1fe7fec10e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:50:30.415886 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63159343-f6a3-4d0f-b265-6a1fe7fec10e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:30.417523 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63159343-f6a3-4d0f-b265-6a1fe7fec10e admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:30.419186 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 771/1553] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:30.420205 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea7499-55bf-47f0-a96b-56d79794ea02 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:30.420491 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea7499-55bf-47f0-a96b-56d79794ea02 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:30.420763 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea7499-55bf-47f0-a96b-56d79794ea02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:30.441925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 783/1554] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:50:30.441925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5e4ce-da1d-4431-9626-1dd94d46216c None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:30.441925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5e4ce-da1d-4431-9626-1dd94d46216c None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:30.441925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5e4ce-da1d-4431-9626-1dd94d46216c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:30.442406 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-feea7499-55bf-47f0-a96b-56d79794ea02 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:30.442406 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-feea7499-55bf-47f0-a96b-56d79794ea02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:30.450967 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 772/1555] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:30.453810 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe7fd3-ab51-4cfa-ac08-d7de0af01b0f None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:30.453810 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe7fd3-ab51-4cfa-ac08-d7de0af01b0f None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:30.453810 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe7fd3-ab51-4cfa-ac08-d7de0af01b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:30.460695 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-afb5e4ce-da1d-4431-9626-1dd94d46216c None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:30.461999 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-afb5e4ce-da1d-4431-9626-1dd94d46216c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:30.471037 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 784/1556] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:30.472389 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a0009-6263-40c4-bb70-92966d0bca16 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:30.472692 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a0009-6263-40c4-bb70-92966d0bca16 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:30.472942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a0009-6263-40c4-bb70-92966d0bca16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:30.477266 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-3dfe7fd3-ab51-4cfa-ac08-d7de0af01b0f None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:30.479598 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-3dfe7fd3-ab51-4cfa-ac08-d7de0af01b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:30.492067 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 773/1557] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:30.494120 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-e41a0009-6263-40c4-bb70-92966d0bca16 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:30.494241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe7fd3-ab51-4cfa-ac08-d7de0af01b0f None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:30.495334 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-e41a0009-6263-40c4-bb70-92966d0bca16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:30.503397 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 785/1558] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:30.504193 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a0009-6263-40c4-bb70-92966d0bca16 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:30.511268 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe7fd3-ab51-4cfa-ac08-d7de0af01b0f None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:30.511916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:30.516170 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a0009-6263-40c4-bb70-92966d0bca16 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:30.516369 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28037c69-2a15-44be-96c5-de9a2220bdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:30.516963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28037c69-2a15-44be-96c5-de9a2220bdcb admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:30.517295 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28037c69-2a15-44be-96c5-de9a2220bdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:30.517564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28037c69-2a15-44be-96c5-de9a2220bdcb admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:30.518233 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28037c69-2a15-44be-96c5-de9a2220bdcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:30.520150 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28037c69-2a15-44be-96c5-de9a2220bdcb admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:30.520924 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ac28c-fbc3-45b7-bc97-ea23832034c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:30.522357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ac28c-fbc3-45b7-bc97-ea23832034c5 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:30.522542 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ac28c-fbc3-45b7-bc97-ea23832034c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:30.522875 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ac28c-fbc3-45b7-bc97-ea23832034c5 admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:30.523553 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ac28c-fbc3-45b7-bc97-ea23832034c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:30.524589 dv-cinder-852364-1-smb devstack@keystone.service[86919]: WARNING py.warnings [None req-4d6ac28c-fbc3-45b7-bc97-ea23832034c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 17:50:30.524589 dv-cinder-852364-1-smb devstack@keystone.service[86919]: warnings.warn(msg) Aug 08 17:50:30.524589 dv-cinder-852364-1-smb devstack@keystone.service[86919]: Aug 08 17:50:30.525829 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ac28c-fbc3-45b7-bc97-ea23832034c5 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:30.532528 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 774/1559] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:50:30.533931 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8ba12-1456-40b7-be54-200ce5d897f6 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:30.534210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8ba12-1456-40b7-be54-200ce5d897f6 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:30.534480 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8ba12-1456-40b7-be54-200ce5d897f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:30.555294 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-e6b8ba12-1456-40b7-be54-200ce5d897f6 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:30.556491 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-e6b8ba12-1456-40b7-be54-200ce5d897f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:30.564307 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 775/1560] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:30.565213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8ba12-1456-40b7-be54-200ce5d897f6 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:30.575724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8ba12-1456-40b7-be54-200ce5d897f6 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:30.582393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41715b0-c132-41e5-a67d-70e2a6e388ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:30.585778 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41715b0-c132-41e5-a67d-70e2a6e388ba admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:30.585778 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41715b0-c132-41e5-a67d-70e2a6e388ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:30.585778 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41715b0-c132-41e5-a67d-70e2a6e388ba admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:30.585778 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41715b0-c132-41e5-a67d-70e2a6e388ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:30.586146 dv-cinder-852364-1-smb devstack@keystone.service[86920]: WARNING py.warnings [None req-b41715b0-c132-41e5-a67d-70e2a6e388ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 17:50:30.586146 dv-cinder-852364-1-smb devstack@keystone.service[86920]: warnings.warn(msg) Aug 08 17:50:30.586146 dv-cinder-852364-1-smb devstack@keystone.service[86920]: Aug 08 17:50:30.587005 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41715b0-c132-41e5-a67d-70e2a6e388ba admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:30.593920 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:30.643286 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 786/1561] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:50:30 2022] POST /identity/v3/users => generated 288 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:50:30.643286 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a2365-17ae-4d5b-a374-55f65de62cbf None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:30.643286 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a2365-17ae-4d5b-a374-55f65de62cbf None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:30.643286 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a2365-17ae-4d5b-a374-55f65de62cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:30.662578 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-024a2365-17ae-4d5b-a374-55f65de62cbf None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:30.663788 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-024a2365-17ae-4d5b-a374-55f65de62cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:30.672135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 787/1562] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:30.673405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeeec70-ee3c-406c-89f9-9d2c98baa294 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:30.673689 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeeec70-ee3c-406c-89f9-9d2c98baa294 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:30.673966 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeeec70-ee3c-406c-89f9-9d2c98baa294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:30.694990 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 776/1563] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:50:30 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:50:30.696059 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41715b0-c132-41e5-a67d-70e2a6e388ba admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:30.696207 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-cbeeec70-ee3c-406c-89f9-9d2c98baa294 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:30.697334 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-cbeeec70-ee3c-406c-89f9-9d2c98baa294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:30.768028 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41715b0-c132-41e5-a67d-70e2a6e388ba admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:30.768805 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 788/1564] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:30.770078 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfb8fc-03ad-4c4e-9486-a8670ced855a None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:30.770363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfb8fc-03ad-4c4e-9486-a8670ced855a None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:30.770633 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfb8fc-03ad-4c4e-9486-a8670ced855a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:30.777100 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb46c03-be90-4fc8-8880-e31240cb3c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:30.777716 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb46c03-be90-4fc8-8880-e31240cb3c9a admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:30.777998 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb46c03-be90-4fc8-8880-e31240cb3c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:30.778268 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb46c03-be90-4fc8-8880-e31240cb3c9a admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:30.778914 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb46c03-be90-4fc8-8880-e31240cb3c9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:50:30.779219 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb46c03-be90-4fc8-8880-e31240cb3c9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:30.780818 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb46c03-be90-4fc8-8880-e31240cb3c9a admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:30.791703 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-2adfb8fc-03ad-4c4e-9486-a8670ced855a None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:30.792783 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 777/1565] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:50:30.792930 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-2adfb8fc-03ad-4c4e-9486-a8670ced855a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:30.793765 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb46c03-be90-4fc8-8880-e31240cb3c9a admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:30.800718 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 789/1566] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:30.805783 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb46c03-be90-4fc8-8880-e31240cb3c9a admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:30.805921 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfb8fc-03ad-4c4e-9486-a8670ced855a None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:30.810411 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b353fe-f30a-4077-bf30-b8ebfcc7cfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:30.811055 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b353fe-f30a-4077-bf30-b8ebfcc7cfc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:30.811339 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b353fe-f30a-4077-bf30-b8ebfcc7cfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:30.811614 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b353fe-f30a-4077-bf30-b8ebfcc7cfc1 admin admin] PATH_INFO: `/v3/projects/f326bd7f01544f94853e14afc9c8f8ed/users/5784dd04977449678ddf644996c685db/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:30.815281 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfb8fc-03ad-4c4e-9486-a8670ced855a None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:30.820962 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0ca66-09a5-4e42-aeec-9bb6002c99c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:30.821655 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0ca66-09a5-4e42-aeec-9bb6002c99c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:30.822060 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0ca66-09a5-4e42-aeec-9bb6002c99c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:30.822331 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0ca66-09a5-4e42-aeec-9bb6002c99c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:30.822937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e0ca66-09a5-4e42-aeec-9bb6002c99c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:50:30.823240 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e0ca66-09a5-4e42-aeec-9bb6002c99c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:30.824903 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e0ca66-09a5-4e42-aeec-9bb6002c99c6 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:30.827311 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b353fe-f30a-4077-bf30-b8ebfcc7cfc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f326bd7f01544f94853e14afc9c8f8ed, user_id=5784dd04977449678ddf644996c685db, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:30.828430 dv-cinder-852364-1-smb devstack@keystone.service[86920]: WARNING py.warnings [None req-44b353fe-f30a-4077-bf30-b8ebfcc7cfc1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 17:50:30.828430 dv-cinder-852364-1-smb devstack@keystone.service[86920]: warnings.warn(msg) Aug 08 17:50:30.828430 dv-cinder-852364-1-smb devstack@keystone.service[86920]: Aug 08 17:50:30.830450 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b353fe-f30a-4077-bf30-b8ebfcc7cfc1 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:30.837487 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 790/1567] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:50:30.838556 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0ca66-09a5-4e42-aeec-9bb6002c99c6 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:30.847901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0ca66-09a5-4e42-aeec-9bb6002c99c6 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:30.853417 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62930ed-f506-4c81-9f59-09f1ef3d2530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:30.854000 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62930ed-f506-4c81-9f59-09f1ef3d2530 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:30.854280 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62930ed-f506-4c81-9f59-09f1ef3d2530 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:30.854595 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62930ed-f506-4c81-9f59-09f1ef3d2530 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:30.855232 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62930ed-f506-4c81-9f59-09f1ef3d2530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:30.856873 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62930ed-f506-4c81-9f59-09f1ef3d2530 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:30.868673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 791/1568] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:50:30.869506 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62930ed-f506-4c81-9f59-09f1ef3d2530 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:30.881434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62930ed-f506-4c81-9f59-09f1ef3d2530 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:30.887213 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e26e7-103c-4ed3-baed-363083c016de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:30.887818 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e26e7-103c-4ed3-baed-363083c016de admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:30.888102 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e26e7-103c-4ed3-baed-363083c016de admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:30.888376 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e26e7-103c-4ed3-baed-363083c016de admin admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:30.889023 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e26e7-103c-4ed3-baed-363083c016de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:50:30.889494 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e26e7-103c-4ed3-baed-363083c016de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:30.891288 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e26e7-103c-4ed3-baed-363083c016de admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:30.903888 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 792/1569] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:50:30.917669 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e26e7-103c-4ed3-baed-363083c016de admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:30.917832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 778/1570] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:50:30 2022] PUT /identity/v3/projects/f326bd7f01544f94853e14afc9c8f8ed/users/5784dd04977449678ddf644996c685db/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:50:30.917832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b353fe-f30a-4077-bf30-b8ebfcc7cfc1 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:30.923286 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e26e7-103c-4ed3-baed-363083c016de admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:30.989732 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959abf9f-1c61-4c38-b6b9-7f8b448b3ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:30.990423 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959abf9f-1c61-4c38-b6b9-7f8b448b3ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:30.990775 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959abf9f-1c61-4c38-b6b9-7f8b448b3ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:30.991168 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959abf9f-1c61-4c38-b6b9-7f8b448b3ec3 admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:30.991805 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959abf9f-1c61-4c38-b6b9-7f8b448b3ec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:30.993275 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b353fe-f30a-4077-bf30-b8ebfcc7cfc1 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:30.994621 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959abf9f-1c61-4c38-b6b9-7f8b448b3ec3 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:31.000614 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a46ea3-2636-432e-9c09-161648b9280a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:31.001730 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a46ea3-2636-432e-9c09-161648b9280a admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:31.002154 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a46ea3-2636-432e-9c09-161648b9280a admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:31.002559 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a46ea3-2636-432e-9c09-161648b9280a admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:31.003676 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a46ea3-2636-432e-9c09-161648b9280a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:50:31.004465 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a46ea3-2636-432e-9c09-161648b9280a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:31.007286 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a46ea3-2636-432e-9c09-161648b9280a admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:31.027058 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 779/1571] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:50:31.028295 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a46ea3-2636-432e-9c09-161648b9280a admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:31.041391 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a46ea3-2636-432e-9c09-161648b9280a admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:31.047939 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813eb215-4ef4-44d9-a405-dba90fd15c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:31.048768 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813eb215-4ef4-44d9-a405-dba90fd15c03 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:31.049078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813eb215-4ef4-44d9-a405-dba90fd15c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:31.049475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813eb215-4ef4-44d9-a405-dba90fd15c03 admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:31.050192 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813eb215-4ef4-44d9-a405-dba90fd15c03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:31.052127 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813eb215-4ef4-44d9-a405-dba90fd15c03 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:31.063642 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 793/1572] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:50:30 2022] POST /identity/v3/users => generated 287 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:50:31.064783 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959abf9f-1c61-4c38-b6b9-7f8b448b3ec3 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:31.075704 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959abf9f-1c61-4c38-b6b9-7f8b448b3ec3 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:31.080326 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329a2f4-b7e3-4095-9f57-1568dfdd28aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:31.080948 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329a2f4-b7e3-4095-9f57-1568dfdd28aa admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:31.081268 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329a2f4-b7e3-4095-9f57-1568dfdd28aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:31.081555 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329a2f4-b7e3-4095-9f57-1568dfdd28aa admin admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:31.082178 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329a2f4-b7e3-4095-9f57-1568dfdd28aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:50:31.082476 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329a2f4-b7e3-4095-9f57-1568dfdd28aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:31.084750 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329a2f4-b7e3-4095-9f57-1568dfdd28aa admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:31.097991 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 794/1573] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:50:31.098828 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329a2f4-b7e3-4095-9f57-1568dfdd28aa admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:31.110823 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329a2f4-b7e3-4095-9f57-1568dfdd28aa admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:31.116046 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463288b-3b54-4a78-9f2f-fc2135784903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:31.116645 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463288b-3b54-4a78-9f2f-fc2135784903 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:31.116924 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463288b-3b54-4a78-9f2f-fc2135784903 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:31.117250 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463288b-3b54-4a78-9f2f-fc2135784903 admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:31.117929 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463288b-3b54-4a78-9f2f-fc2135784903 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:31.119813 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463288b-3b54-4a78-9f2f-fc2135784903 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:31.130044 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:31.159327 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 780/1574] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:50:31 2022] POST /identity/v3/projects => generated 405 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:50:31.159327 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813eb215-4ef4-44d9-a405-dba90fd15c03 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:31.187017 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:31.203797 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 795/1575] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:50:31 2022] POST /identity/v3/projects => generated 389 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:50:31.203797 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463288b-3b54-4a78-9f2f-fc2135784903 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:31.218310 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813eb215-4ef4-44d9-a405-dba90fd15c03 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:31.270451 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463288b-3b54-4a78-9f2f-fc2135784903 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:31.275826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1942fc3-3ae5-445f-9fee-30d38a18d19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:31.276009 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73ed03-08c9-4201-b61a-8346d5c39a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:31.276430 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1942fc3-3ae5-445f-9fee-30d38a18d19f admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:31.276648 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73ed03-08c9-4201-b61a-8346d5c39a41 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:31.276804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1942fc3-3ae5-445f-9fee-30d38a18d19f admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:31.276907 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73ed03-08c9-4201-b61a-8346d5c39a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:31.277000 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1942fc3-3ae5-445f-9fee-30d38a18d19f admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:31.277281 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73ed03-08c9-4201-b61a-8346d5c39a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:31.277705 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1942fc3-3ae5-445f-9fee-30d38a18d19f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:31.277981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73ed03-08c9-4201-b61a-8346d5c39a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:31.279612 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1942fc3-3ae5-445f-9fee-30d38a18d19f admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:31.280057 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73ed03-08c9-4201-b61a-8346d5c39a41 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:31.290271 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 781/1576] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:50:31.291490 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bca51-dd7a-41be-9251-c904240260cb None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:31.291773 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bca51-dd7a-41be-9251-c904240260cb None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:31.292044 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bca51-dd7a-41be-9251-c904240260cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:31.319793 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-130bca51-dd7a-41be-9251-c904240260cb None None] MFA Rules not processed for user `5784dd04977449678ddf644996c685db`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:31.320999 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-130bca51-dd7a-41be-9251-c904240260cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:31.378313 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 796/1577] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:50:31 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:50:31.382957 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1942fc3-3ae5-445f-9fee-30d38a18d19f admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:31.385081 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 782/1578] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:31.385920 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bca51-dd7a-41be-9251-c904240260cb None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:31.397214 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bca51-dd7a-41be-9251-c904240260cb None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:31.454733 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1942fc3-3ae5-445f-9fee-30d38a18d19f admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:31.460594 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb62fc-d717-4dd6-9484-acb72385be78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:31.460928 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458470c1-22ca-46bc-9dc2-3937fb62d13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:31.461239 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb62fc-d717-4dd6-9484-acb72385be78 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:31.461525 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb62fc-d717-4dd6-9484-acb72385be78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:31.461799 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb62fc-d717-4dd6-9484-acb72385be78 admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:31.462017 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458470c1-22ca-46bc-9dc2-3937fb62d13f admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:31.462427 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb62fc-d717-4dd6-9484-acb72385be78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:31.462534 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458470c1-22ca-46bc-9dc2-3937fb62d13f admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:31.462794 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458470c1-22ca-46bc-9dc2-3937fb62d13f admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:31.463680 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458470c1-22ca-46bc-9dc2-3937fb62d13f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:31.465478 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb62fc-d717-4dd6-9484-acb72385be78 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:31.466229 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458470c1-22ca-46bc-9dc2-3937fb62d13f admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:31.469465 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:31.482389 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 783/1579] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:50:31.482389 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458470c1-22ca-46bc-9dc2-3937fb62d13f admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:31.494691 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458470c1-22ca-46bc-9dc2-3937fb62d13f admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:31.499963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe1337-e848-4676-a819-ce8e93740f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:31.500578 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe1337-e848-4676-a819-ce8e93740f3f admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:31.500919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe1337-e848-4676-a819-ce8e93740f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:31.501272 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe1337-e848-4676-a819-ce8e93740f3f admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:31.501900 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe1337-e848-4676-a819-ce8e93740f3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:31.503809 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe1337-e848-4676-a819-ce8e93740f3f admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:31.573099 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 797/1580] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:50:31 2022] POST /identity/v3/projects => generated 381 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:50:31.573099 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb62fc-d717-4dd6-9484-acb72385be78 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:31.596581 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 784/1581] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:50:31 2022] POST /identity/v3/projects => generated 355 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:50:31.600587 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe1337-e848-4676-a819-ce8e93740f3f admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:31.633298 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb62fc-d717-4dd6-9484-acb72385be78 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:31.636946 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:31.659976 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe1337-e848-4676-a819-ce8e93740f3f admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:31.664724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05122564-ac2e-45ae-b575-42f29e523fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:31.665389 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05122564-ac2e-45ae-b575-42f29e523fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:31.668458 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05122564-ac2e-45ae-b575-42f29e523fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:31.668458 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05122564-ac2e-45ae-b575-42f29e523fd0 admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:31.668458 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05122564-ac2e-45ae-b575-42f29e523fd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:31.668728 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05122564-ac2e-45ae-b575-42f29e523fd0 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:31.694519 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda1330-e59c-4682-bb06-e67525a11b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:31.700532 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda1330-e59c-4682-bb06-e67525a11b11 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:31.700532 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda1330-e59c-4682-bb06-e67525a11b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:31.700532 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda1330-e59c-4682-bb06-e67525a11b11 admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:31.700532 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda1330-e59c-4682-bb06-e67525a11b11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:31.700532 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda1330-e59c-4682-bb06-e67525a11b11 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:31.811712 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 785/1582] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:50:31 2022] POST /identity/v3/users => generated 295 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:50:31.812451 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05122564-ac2e-45ae-b575-42f29e523fd0 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:31.822873 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05122564-ac2e-45ae-b575-42f29e523fd0 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:31.827445 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9215bf-b0c4-435e-8cc0-ee003bfe63d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:31.828077 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9215bf-b0c4-435e-8cc0-ee003bfe63d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:31.828356 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9215bf-b0c4-435e-8cc0-ee003bfe63d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:31.828628 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9215bf-b0c4-435e-8cc0-ee003bfe63d9 admin admin] PATH_INFO: `/v3/projects/1942367d28ba49ebab8e79e3c3b4b3ec/users/d26e7b888a914f93a69b179f9e7ad14e/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:31.844291 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9215bf-b0c4-435e-8cc0-ee003bfe63d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1942367d28ba49ebab8e79e3c3b4b3ec, user_id=d26e7b888a914f93a69b179f9e7ad14e, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:31.852103 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9215bf-b0c4-435e-8cc0-ee003bfe63d9 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:31.852257 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 798/1583] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:50:31 2022] POST /identity/v3/users => generated 303 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:50:31.852257 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda1330-e59c-4682-bb06-e67525a11b11 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:31.858387 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda1330-e59c-4682-bb06-e67525a11b11 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:31.863114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673572c1-fcf6-4322-8bfa-b65ae6a3dd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:31.863705 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673572c1-fcf6-4322-8bfa-b65ae6a3dd19 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:31.863991 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673572c1-fcf6-4322-8bfa-b65ae6a3dd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:31.864261 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673572c1-fcf6-4322-8bfa-b65ae6a3dd19 admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:31.864882 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673572c1-fcf6-4322-8bfa-b65ae6a3dd19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:31.867605 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673572c1-fcf6-4322-8bfa-b65ae6a3dd19 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:31.940366 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 786/1584] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:50:31 2022] PUT /identity/v3/projects/1942367d28ba49ebab8e79e3c3b4b3ec/users/d26e7b888a914f93a69b179f9e7ad14e/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:50:31.941673 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9215bf-b0c4-435e-8cc0-ee003bfe63d9 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:31.968411 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 799/1585] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:50:31 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:50:31.972335 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673572c1-fcf6-4322-8bfa-b65ae6a3dd19 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:31.985176 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673572c1-fcf6-4322-8bfa-b65ae6a3dd19 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:32.012655 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9215bf-b0c4-435e-8cc0-ee003bfe63d9 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:32.016540 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb3c93-ca08-479b-b1cf-6689e880e5b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:32.017260 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb3c93-ca08-479b-b1cf-6689e880e5b9 service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:32.017578 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb3c93-ca08-479b-b1cf-6689e880e5b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:32.017869 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb3c93-ca08-479b-b1cf-6689e880e5b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:32.048420 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b2a3c-b516-4355-a016-6db58fc18487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:32.049117 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b2a3c-b516-4355-a016-6db58fc18487 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:32.049402 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b2a3c-b516-4355-a016-6db58fc18487 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:32.049678 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b2a3c-b516-4355-a016-6db58fc18487 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:32.050355 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b2a3c-b516-4355-a016-6db58fc18487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:32.051957 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b2a3c-b516-4355-a016-6db58fc18487 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:32.063211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 800/1586] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:50:32.064153 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b2a3c-b516-4355-a016-6db58fc18487 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:32.075443 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b2a3c-b516-4355-a016-6db58fc18487 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:32.080348 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b51f9-f83c-4be8-bc08-abd6973b3fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:32.080953 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b51f9-f83c-4be8-bc08-abd6973b3fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:32.081297 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b51f9-f83c-4be8-bc08-abd6973b3fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:32.081568 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b51f9-f83c-4be8-bc08-abd6973b3fc2 admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:32.082195 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b51f9-f83c-4be8-bc08-abd6973b3fc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:32.083444 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:32.084449 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b51f9-f83c-4be8-bc08-abd6973b3fc2 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:32.086661 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb3c93-ca08-479b-b1cf-6689e880e5b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:32.088116 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb3c93-ca08-479b-b1cf-6689e880e5b9 service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:32.098258 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 787/1587] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:50:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:50:32.099070 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb3c93-ca08-479b-b1cf-6689e880e5b9 service cinder] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:32.110132 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb3c93-ca08-479b-b1cf-6689e880e5b9 service cinder] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:32.116765 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdedd20-c0b0-49a8-a297-f146be39eafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:32.117410 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdedd20-c0b0-49a8-a297-f146be39eafa admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:32.117690 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdedd20-c0b0-49a8-a297-f146be39eafa admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:32.117971 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdedd20-c0b0-49a8-a297-f146be39eafa admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:32.118697 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdedd20-c0b0-49a8-a297-f146be39eafa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:32.120563 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdedd20-c0b0-49a8-a297-f146be39eafa admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:32.203775 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 801/1588] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:50:32 2022] POST /identity/v3/users => generated 291 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:50:32.203775 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b51f9-f83c-4be8-bc08-abd6973b3fc2 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:32.211360 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b51f9-f83c-4be8-bc08-abd6973b3fc2 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:32.216346 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725bf086-e6d1-4c68-9387-84fe853913ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:32.216954 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725bf086-e6d1-4c68-9387-84fe853913ab admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:32.217267 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725bf086-e6d1-4c68-9387-84fe853913ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:32.217538 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725bf086-e6d1-4c68-9387-84fe853913ab admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:32.218181 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725bf086-e6d1-4c68-9387-84fe853913ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:32.219853 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725bf086-e6d1-4c68-9387-84fe853913ab admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:32.231759 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 802/1589] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:50:32.232616 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725bf086-e6d1-4c68-9387-84fe853913ab admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:32.238739 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 788/1590] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:50:32 2022] POST /identity/v3/users => generated 278 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:50:32.243430 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118a438-03a2-44c6-850f-ed47b0d8c576 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:32.243430 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118a438-03a2-44c6-850f-ed47b0d8c576 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:32.243430 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118a438-03a2-44c6-850f-ed47b0d8c576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:32.243914 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725bf086-e6d1-4c68-9387-84fe853913ab admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:32.248963 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3a5f1-58ef-4c37-8dc2-54ed0bc5aabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:32.249743 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3a5f1-58ef-4c37-8dc2-54ed0bc5aabb admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:32.250029 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3a5f1-58ef-4c37-8dc2-54ed0bc5aabb admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:32.250303 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3a5f1-58ef-4c37-8dc2-54ed0bc5aabb admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:32.250948 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3a5f1-58ef-4c37-8dc2-54ed0bc5aabb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:32.252543 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3a5f1-58ef-4c37-8dc2-54ed0bc5aabb admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:32.262977 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-c118a438-03a2-44c6-850f-ed47b0d8c576 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:32.263659 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 803/1591] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:50:32.264405 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-c118a438-03a2-44c6-850f-ed47b0d8c576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:32.267320 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3a5f1-58ef-4c37-8dc2-54ed0bc5aabb admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:32.274096 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 789/1592] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:32.275478 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118a438-03a2-44c6-850f-ed47b0d8c576 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:32.278227 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3a5f1-58ef-4c37-8dc2-54ed0bc5aabb admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:32.283365 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953975c-8fed-4f29-a8a4-649b49a60b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:32.284962 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953975c-8fed-4f29-a8a4-649b49a60b3f admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:32.284962 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953975c-8fed-4f29-a8a4-649b49a60b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:32.284962 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953975c-8fed-4f29-a8a4-649b49a60b3f admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:32.285421 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b953975c-8fed-4f29-a8a4-649b49a60b3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:32.286250 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118a438-03a2-44c6-850f-ed47b0d8c576 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:32.287867 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b953975c-8fed-4f29-a8a4-649b49a60b3f admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:32.292703 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c6ca9-5893-4b58-8b13-eab936c19dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:32.293395 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c6ca9-5893-4b58-8b13-eab936c19dab admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:32.293689 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c6ca9-5893-4b58-8b13-eab936c19dab admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:32.293935 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c6ca9-5893-4b58-8b13-eab936c19dab admin admin] PATH_INFO: `/v3/projects/b23851d552fe4761a597f6564e0b2f47/users/5037a7b0ba994938ae10d2b3316dab93/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:32.301342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 804/1593] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:50:32.302258 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953975c-8fed-4f29-a8a4-649b49a60b3f admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:32.313434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953975c-8fed-4f29-a8a4-649b49a60b3f admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:32.314372 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c6ca9-5893-4b58-8b13-eab936c19dab admin admin] RBAC: Authorizing `identity:create_grant(project_id=b23851d552fe4761a597f6564e0b2f47, user_id=5037a7b0ba994938ae10d2b3316dab93, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:32.318249 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c6ca9-5893-4b58-8b13-eab936c19dab admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:32.318393 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2b89e-2fea-413f-a30f-1be8c10d157b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:32.318949 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2b89e-2fea-413f-a30f-1be8c10d157b admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:32.319335 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2b89e-2fea-413f-a30f-1be8c10d157b admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:32.319494 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2b89e-2fea-413f-a30f-1be8c10d157b admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:32.320519 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb2b89e-2fea-413f-a30f-1be8c10d157b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:32.321864 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb2b89e-2fea-413f-a30f-1be8c10d157b admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:32.332575 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 805/1594] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:50:32.336421 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2b89e-2fea-413f-a30f-1be8c10d157b admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:32.343690 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2b89e-2fea-413f-a30f-1be8c10d157b admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:32.348323 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8c4e9-c93b-4e4f-a493-8acb92f67b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:32.348909 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8c4e9-c93b-4e4f-a493-8acb92f67b27 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:32.349226 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8c4e9-c93b-4e4f-a493-8acb92f67b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:32.349537 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8c4e9-c93b-4e4f-a493-8acb92f67b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:32.350948 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8c4e9-c93b-4e4f-a493-8acb92f67b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:32.352920 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8c4e9-c93b-4e4f-a493-8acb92f67b27 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:32.364566 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 806/1595] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:50:32.365484 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8c4e9-c93b-4e4f-a493-8acb92f67b27 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:32.370871 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:32.376369 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8c4e9-c93b-4e4f-a493-8acb92f67b27 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:32.381481 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87453d6e-c43e-4bd3-8d08-4a14a2cb736f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:32.382124 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87453d6e-c43e-4bd3-8d08-4a14a2cb736f admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:32.382406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87453d6e-c43e-4bd3-8d08-4a14a2cb736f admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:32.382674 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87453d6e-c43e-4bd3-8d08-4a14a2cb736f admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:32.383306 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87453d6e-c43e-4bd3-8d08-4a14a2cb736f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:32.384900 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87453d6e-c43e-4bd3-8d08-4a14a2cb736f admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:32.392780 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 790/1596] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:50:32 2022] PUT /identity/v3/projects/b23851d552fe4761a597f6564e0b2f47/users/5037a7b0ba994938ae10d2b3316dab93/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:50:32.392780 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c6ca9-5893-4b58-8b13-eab936c19dab admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:32.405201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 807/1597] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:50:32.405201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87453d6e-c43e-4bd3-8d08-4a14a2cb736f admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:32.457174 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c6ca9-5893-4b58-8b13-eab936c19dab admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:32.462654 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf28e52-c6eb-4fd1-8b49-0ca922291ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:32.462834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87453d6e-c43e-4bd3-8d08-4a14a2cb736f admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:32.463555 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf28e52-c6eb-4fd1-8b49-0ca922291ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:32.463819 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf28e52-c6eb-4fd1-8b49-0ca922291ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:32.464100 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf28e52-c6eb-4fd1-8b49-0ca922291ed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:32.464787 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf28e52-c6eb-4fd1-8b49-0ca922291ed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:32.466402 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf28e52-c6eb-4fd1-8b49-0ca922291ed7 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:32.477258 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 791/1598] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:50:32.481231 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf28e52-c6eb-4fd1-8b49-0ca922291ed7 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:32.491601 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf28e52-c6eb-4fd1-8b49-0ca922291ed7 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:32.496326 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195e121-33d3-42e7-8389-e4992efe78c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:32.496907 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195e121-33d3-42e7-8389-e4992efe78c3 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:32.497257 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195e121-33d3-42e7-8389-e4992efe78c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:32.497533 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195e121-33d3-42e7-8389-e4992efe78c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:32.498169 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2195e121-33d3-42e7-8389-e4992efe78c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:32.499783 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2195e121-33d3-42e7-8389-e4992efe78c3 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:32.510368 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 792/1599] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:50:32.511248 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195e121-33d3-42e7-8389-e4992efe78c3 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:32.515042 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c30fbb-6249-4345-a504-85fa2341b471 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:32.515662 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c30fbb-6249-4345-a504-85fa2341b471 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:32.515946 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c30fbb-6249-4345-a504-85fa2341b471 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:32.516392 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c30fbb-6249-4345-a504-85fa2341b471 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:32.521299 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195e121-33d3-42e7-8389-e4992efe78c3 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:32.526520 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c30fbb-6249-4345-a504-85fa2341b471 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:32.527006 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b6242-7029-44ac-812c-98cc1ca6f829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:32.527628 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b6242-7029-44ac-812c-98cc1ca6f829 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:32.527911 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b6242-7029-44ac-812c-98cc1ca6f829 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:32.528113 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c30fbb-6249-4345-a504-85fa2341b471 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:32.528222 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b6242-7029-44ac-812c-98cc1ca6f829 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:32.528804 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b6242-7029-44ac-812c-98cc1ca6f829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:32.530430 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b6242-7029-44ac-812c-98cc1ca6f829 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:32.540231 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 808/1600] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:50:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:50:32.544962 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c30fbb-6249-4345-a504-85fa2341b471 service neutron] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:32.545129 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 793/1601] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:50:32.545129 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ef895-5ba5-48a8-9eca-520058d27b10 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:32.545406 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ef895-5ba5-48a8-9eca-520058d27b10 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:32.545679 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ef895-5ba5-48a8-9eca-520058d27b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:32.555152 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c30fbb-6249-4345-a504-85fa2341b471 service neutron] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:32.560498 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd171e-5949-4e17-a3c3-4ff477955958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:32.561324 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd171e-5949-4e17-a3c3-4ff477955958 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:32.561688 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd171e-5949-4e17-a3c3-4ff477955958 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:32.562077 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd171e-5949-4e17-a3c3-4ff477955958 admin admin] PATH_INFO: `/v3/projects/262fdd56118b426eb90f326b791a20d9/users/56427a32e1044299a1098c911849e601/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:32.571778 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-364ef895-5ba5-48a8-9eca-520058d27b10 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:32.573482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-364ef895-5ba5-48a8-9eca-520058d27b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:32.578880 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd171e-5949-4e17-a3c3-4ff477955958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=262fdd56118b426eb90f326b791a20d9, user_id=56427a32e1044299a1098c911849e601, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:32.581786 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd171e-5949-4e17-a3c3-4ff477955958 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:32.581935 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 794/1602] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:32.587153 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ef895-5ba5-48a8-9eca-520058d27b10 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:32.597799 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ef895-5ba5-48a8-9eca-520058d27b10 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:32.603199 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883ac14-1871-4241-9f36-0ae2790968ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:32.603823 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883ac14-1871-4241-9f36-0ae2790968ab admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:32.604131 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883ac14-1871-4241-9f36-0ae2790968ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:32.604463 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883ac14-1871-4241-9f36-0ae2790968ab admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:32.605144 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883ac14-1871-4241-9f36-0ae2790968ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:32.606779 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883ac14-1871-4241-9f36-0ae2790968ab admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:32.616869 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 795/1603] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:50:32.617780 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883ac14-1871-4241-9f36-0ae2790968ab admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:32.627406 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883ac14-1871-4241-9f36-0ae2790968ab admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:32.632154 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03e400-11b2-4e0c-a0ea-d0016b13f930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:32.632829 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03e400-11b2-4e0c-a0ea-d0016b13f930 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:32.633140 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03e400-11b2-4e0c-a0ea-d0016b13f930 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:32.635587 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03e400-11b2-4e0c-a0ea-d0016b13f930 admin admin] PATH_INFO: `/v3/projects/6335490309af4c76a9ffec448e7c88b6/users/4f334fe4ba7c4a4d95807169210e5a2e/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:32.649294 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a03e400-11b2-4e0c-a0ea-d0016b13f930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6335490309af4c76a9ffec448e7c88b6, user_id=4f334fe4ba7c4a4d95807169210e5a2e, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:32.652037 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a03e400-11b2-4e0c-a0ea-d0016b13f930 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:32.657015 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 809/1604] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:50:32 2022] PUT /identity/v3/projects/262fdd56118b426eb90f326b791a20d9/users/56427a32e1044299a1098c911849e601/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:50:32.657015 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd171e-5949-4e17-a3c3-4ff477955958 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:32.718364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 796/1605] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:50:32 2022] PUT /identity/v3/projects/6335490309af4c76a9ffec448e7c88b6/users/4f334fe4ba7c4a4d95807169210e5a2e/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:50:32.719611 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03e400-11b2-4e0c-a0ea-d0016b13f930 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:32.736487 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd171e-5949-4e17-a3c3-4ff477955958 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:32.772215 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:32.773457 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:32.792114 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03e400-11b2-4e0c-a0ea-d0016b13f930 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:32.797080 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5295b4-c1c1-41c9-a347-78ba7a01cddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:32.800618 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5295b4-c1c1-41c9-a347-78ba7a01cddf admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:32.800618 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5295b4-c1c1-41c9-a347-78ba7a01cddf admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:32.800618 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5295b4-c1c1-41c9-a347-78ba7a01cddf admin admin] PATH_INFO: `/v3/projects/2c03d39bb35345e69139ddfb4067b60a/users/7d84d1d6d0ab469f905d01d8a1276dec/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:32.801230 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4ceb8-4571-45c1-bcaf-bbb91865fa8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:32.801230 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4ceb8-4571-45c1-bcaf-bbb91865fa8f admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:32.801230 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4ceb8-4571-45c1-bcaf-bbb91865fa8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:32.801230 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4ceb8-4571-45c1-bcaf-bbb91865fa8f admin admin] PATH_INFO: `/v3/projects/ba4f1ead6837426688d63fedfae2a398/users/06e952d3f6e245bba9f6d086aea98687/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:32.814398 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5295b4-c1c1-41c9-a347-78ba7a01cddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c03d39bb35345e69139ddfb4067b60a, user_id=7d84d1d6d0ab469f905d01d8a1276dec, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:32.816521 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc4ceb8-4571-45c1-bcaf-bbb91865fa8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba4f1ead6837426688d63fedfae2a398, user_id=06e952d3f6e245bba9f6d086aea98687, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:32.817170 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5295b4-c1c1-41c9-a347-78ba7a01cddf admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:32.819934 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc4ceb8-4571-45c1-bcaf-bbb91865fa8f admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:32.938272 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 810/1606] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:50:32 2022] PUT /identity/v3/projects/ba4f1ead6837426688d63fedfae2a398/users/06e952d3f6e245bba9f6d086aea98687/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:50:32.940606 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 797/1607] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:50:32 2022] PUT /identity/v3/projects/2c03d39bb35345e69139ddfb4067b60a/users/7d84d1d6d0ab469f905d01d8a1276dec/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:50:32.941602 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5295b4-c1c1-41c9-a347-78ba7a01cddf admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:32.941981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4ceb8-4571-45c1-bcaf-bbb91865fa8f admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:33.019505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5295b4-c1c1-41c9-a347-78ba7a01cddf admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:33.045473 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4ceb8-4571-45c1-bcaf-bbb91865fa8f admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:33.050629 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57472b2-9b68-40fd-abb8-629446ac56ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:33.053771 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57472b2-9b68-40fd-abb8-629446ac56ea admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:33.053771 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57472b2-9b68-40fd-abb8-629446ac56ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:33.053771 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57472b2-9b68-40fd-abb8-629446ac56ea admin admin] PATH_INFO: `/v3/projects/f446a2708c1d4d86b9908e4e1c44c609/users/26594bcb0643454db17390521bb4ec1d/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:33.069299 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57472b2-9b68-40fd-abb8-629446ac56ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=f446a2708c1d4d86b9908e4e1c44c609, user_id=26594bcb0643454db17390521bb4ec1d, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:33.072623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57472b2-9b68-40fd-abb8-629446ac56ea admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:33.078290 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22900b19-80dd-4fd9-b9cd-2237e9186ab6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:33.085834 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22900b19-80dd-4fd9-b9cd-2237e9186ab6 service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:33.088098 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22900b19-80dd-4fd9-b9cd-2237e9186ab6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:33.088098 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22900b19-80dd-4fd9-b9cd-2237e9186ab6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:33.098378 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22900b19-80dd-4fd9-b9cd-2237e9186ab6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:33.099963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22900b19-80dd-4fd9-b9cd-2237e9186ab6 service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:33.110799 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 798/1608] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:50:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:50:33.112630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1404bd-38a8-4b54-aacc-71ac5dc32d67 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:33.112630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1404bd-38a8-4b54-aacc-71ac5dc32d67 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:33.112630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1404bd-38a8-4b54-aacc-71ac5dc32d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:33.133430 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-6d1404bd-38a8-4b54-aacc-71ac5dc32d67 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:33.134793 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-6d1404bd-38a8-4b54-aacc-71ac5dc32d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:33.156926 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 811/1609] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:50:32 2022] PUT /identity/v3/projects/f446a2708c1d4d86b9908e4e1c44c609/users/26594bcb0643454db17390521bb4ec1d/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:50:33.156926 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1de2f8-d031-432c-8318-767710e85ff0 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:33.156926 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1de2f8-d031-432c-8318-767710e85ff0 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:33.156926 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1de2f8-d031-432c-8318-767710e85ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:33.184402 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-fe1de2f8-d031-432c-8318-767710e85ff0 None None] MFA Rules not processed for user `4f334fe4ba7c4a4d95807169210e5a2e`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:33.186027 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-fe1de2f8-d031-432c-8318-767710e85ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:33.216293 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 799/1610] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:33.217985 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a4645-8252-4c91-b623-2e5d1719ad20 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:33.218443 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a4645-8252-4c91-b623-2e5d1719ad20 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:33.218948 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a4645-8252-4c91-b623-2e5d1719ad20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:33.258919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-394a4645-8252-4c91-b623-2e5d1719ad20 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:33.260165 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-394a4645-8252-4c91-b623-2e5d1719ad20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:33.269225 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 800/1611] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:33.270721 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b0efd-075d-43f9-b06d-e40d7763af1a None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:33.271016 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b0efd-075d-43f9-b06d-e40d7763af1a None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:33.271302 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b0efd-075d-43f9-b06d-e40d7763af1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:33.278181 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 812/1612] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:33 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:33.280020 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac7da6-2ca9-4b36-b32d-7ada10c68077 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:33.280320 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac7da6-2ca9-4b36-b32d-7ada10c68077 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:33.280579 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac7da6-2ca9-4b36-b32d-7ada10c68077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:33.308465 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-8d5b0efd-075d-43f9-b06d-e40d7763af1a None None] MFA Rules not processed for user `06e952d3f6e245bba9f6d086aea98687`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:33.309860 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-8d5b0efd-075d-43f9-b06d-e40d7763af1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:33.311831 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-bbac7da6-2ca9-4b36-b32d-7ada10c68077 None None] MFA Rules not processed for user `26594bcb0643454db17390521bb4ec1d`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:33.313406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-bbac7da6-2ca9-4b36-b32d-7ada10c68077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:33.314676 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:33.337435 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:33.401788 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 801/1613] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:33.401788 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b0efd-075d-43f9-b06d-e40d7763af1a None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:33.402127 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 813/1614] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:33 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:33.402127 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac7da6-2ca9-4b36-b32d-7ada10c68077 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:33.403607 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-8d5b0efd-075d-43f9-b06d-e40d7763af1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:33.403734 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-bbac7da6-2ca9-4b36-b32d-7ada10c68077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:33.480053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac7da6-2ca9-4b36-b32d-7ada10c68077 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:33.484018 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9e2df-ae89-4198-a1e7-e70584e10cb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:33.484707 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9e2df-ae89-4198-a1e7-e70584e10cb0 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:33.484995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9e2df-ae89-4198-a1e7-e70584e10cb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:33.485389 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9e2df-ae89-4198-a1e7-e70584e10cb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:33.488852 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b0efd-075d-43f9-b06d-e40d7763af1a None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:33.493784 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fbaa1-e5d2-42ce-b9ee-df18643103c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:33.494401 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fbaa1-e5d2-42ce-b9ee-df18643103c8 service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:33.494676 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fbaa1-e5d2-42ce-b9ee-df18643103c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:33.494952 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fbaa1-e5d2-42ce-b9ee-df18643103c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:33.495073 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9e2df-ae89-4198-a1e7-e70584e10cb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:33.496491 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9e2df-ae89-4198-a1e7-e70584e10cb0 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:33.507086 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3fbaa1-e5d2-42ce-b9ee-df18643103c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:33.508054 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 814/1615] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:50:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:50:33.508758 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3fbaa1-e5d2-42ce-b9ee-df18643103c8 service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:33.508901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9e2df-ae89-4198-a1e7-e70584e10cb0 service neutron] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:33.520295 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9e2df-ae89-4198-a1e7-e70584e10cb0 service neutron] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:33.521280 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 802/1616] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:50:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:50:33.522248 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fbaa1-e5d2-42ce-b9ee-df18643103c8 service neutron] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:33.534482 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419df28-9aa1-4b9e-aa87-9deedd20d238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:33.534482 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419df28-9aa1-4b9e-aa87-9deedd20d238 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:33.534482 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419df28-9aa1-4b9e-aa87-9deedd20d238 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:33.534482 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419df28-9aa1-4b9e-aa87-9deedd20d238 admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:33.534925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419df28-9aa1-4b9e-aa87-9deedd20d238 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:33.535028 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fbaa1-e5d2-42ce-b9ee-df18643103c8 service neutron] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:33.536379 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419df28-9aa1-4b9e-aa87-9deedd20d238 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:33.541270 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd2d45-1902-4051-9e2f-af8fa5c6cedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:33.542865 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd2d45-1902-4051-9e2f-af8fa5c6cedb admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:33.543222 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd2d45-1902-4051-9e2f-af8fa5c6cedb admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:33.543823 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd2d45-1902-4051-9e2f-af8fa5c6cedb admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:33.544659 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd2d45-1902-4051-9e2f-af8fa5c6cedb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:33.547089 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd2d45-1902-4051-9e2f-af8fa5c6cedb admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:33.656482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 803/1617] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:50:33 2022] POST /identity/v3/projects => generated 355 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:50:33.660248 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d23fe-f4cc-497f-b5c9-88bfaa23a630 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:33.660695 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d23fe-f4cc-497f-b5c9-88bfaa23a630 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:33.664331 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 815/1618] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:50:33 2022] POST /identity/v3/projects => generated 403 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:50:33.665146 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d23fe-f4cc-497f-b5c9-88bfaa23a630 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:33.665356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419df28-9aa1-4b9e-aa87-9deedd20d238 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:33.668052 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 804/1619] 10.222.0.70 () {54 vars in 962 bytes} [Mon Aug 8 17:50:33 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:50:33.669416 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d23fe-f4cc-497f-b5c9-88bfaa23a630 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:33.747839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419df28-9aa1-4b9e-aa87-9deedd20d238 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:33.752505 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161955e6-7096-401f-b23d-f2c8996d31ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:33.753216 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161955e6-7096-401f-b23d-f2c8996d31ee admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:33.753485 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161955e6-7096-401f-b23d-f2c8996d31ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:33.754125 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161955e6-7096-401f-b23d-f2c8996d31ee admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:33.754403 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161955e6-7096-401f-b23d-f2c8996d31ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:33.756936 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161955e6-7096-401f-b23d-f2c8996d31ee admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:33.759248 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d23fe-f4cc-497f-b5c9-88bfaa23a630 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:33.764721 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c343b7-5fa1-45a1-847d-4e957a0d986c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:33.765371 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c343b7-5fa1-45a1-847d-4e957a0d986c admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:33.765666 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c343b7-5fa1-45a1-847d-4e957a0d986c admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:33.765925 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c343b7-5fa1-45a1-847d-4e957a0d986c admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:33.766583 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c343b7-5fa1-45a1-847d-4e957a0d986c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:33.768628 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c343b7-5fa1-45a1-847d-4e957a0d986c admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:33.889849 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 816/1620] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:50:33 2022] POST /identity/v3/users => generated 284 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:50:33.891011 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184652c-d7f9-4901-be7c-4409b9cfcbe7 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:33.892002 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184652c-d7f9-4901-be7c-4409b9cfcbe7 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:33.892491 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184652c-d7f9-4901-be7c-4409b9cfcbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:33.893086 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 805/1621] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:50:33 2022] POST /identity/v3/users => generated 308 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:50:33.894675 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c343b7-5fa1-45a1-847d-4e957a0d986c admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:33.908905 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c343b7-5fa1-45a1-847d-4e957a0d986c admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:33.917345 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107e35a-1ead-442f-b5c5-19990ebcec2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:33.919697 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107e35a-1ead-442f-b5c5-19990ebcec2d admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:33.920245 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107e35a-1ead-442f-b5c5-19990ebcec2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:33.920785 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107e35a-1ead-442f-b5c5-19990ebcec2d admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:33.921808 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107e35a-1ead-442f-b5c5-19990ebcec2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:33.928326 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107e35a-1ead-442f-b5c5-19990ebcec2d admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:33.942068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 806/1622] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:50:33.945386 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107e35a-1ead-442f-b5c5-19990ebcec2d admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:33.951375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:33.955985 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107e35a-1ead-442f-b5c5-19990ebcec2d admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:33.962729 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe80ab-39ba-4063-b2ea-229df760fa34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:33.968238 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe80ab-39ba-4063-b2ea-229df760fa34 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:33.968238 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe80ab-39ba-4063-b2ea-229df760fa34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:33.968238 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe80ab-39ba-4063-b2ea-229df760fa34 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:33.968238 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe80ab-39ba-4063-b2ea-229df760fa34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:33.968238 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe80ab-39ba-4063-b2ea-229df760fa34 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:33.984906 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 807/1623] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:50:33.989271 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe80ab-39ba-4063-b2ea-229df760fa34 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:33.999832 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-5184652c-d7f9-4901-be7c-4409b9cfcbe7 None None] MFA Rules not processed for user `3973b8fbfbb9475896e4e110ca8aa615`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:34.002595 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe80ab-39ba-4063-b2ea-229df760fa34 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:34.003093 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-5184652c-d7f9-4901-be7c-4409b9cfcbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:34.019647 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f829703-ff25-4bcc-86a6-d63b48a62eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:34.019647 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f829703-ff25-4bcc-86a6-d63b48a62eb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:34.019647 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f829703-ff25-4bcc-86a6-d63b48a62eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:34.019647 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f829703-ff25-4bcc-86a6-d63b48a62eb7 admin admin] PATH_INFO: `/v3/projects/f56cc84057ad4fdc91c1cec44b31664a/users/cb42cd97e68147b49d5e8f895e5f8d0a/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:34.025176 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:34.034198 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f829703-ff25-4bcc-86a6-d63b48a62eb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f56cc84057ad4fdc91c1cec44b31664a, user_id=cb42cd97e68147b49d5e8f895e5f8d0a, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:34.037799 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f829703-ff25-4bcc-86a6-d63b48a62eb7 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:34.128620 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 817/1624] 10.222.0.70 () {58 vars in 1059 bytes} [Mon Aug 8 17:50:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:34.128620 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184652c-d7f9-4901-be7c-4409b9cfcbe7 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:34.133860 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184652c-d7f9-4901-be7c-4409b9cfcbe7 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:34.139831 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7309bd3-ece5-4841-815e-7fd870527bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:34.140590 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7309bd3-ece5-4841-815e-7fd870527bb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:34.140942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7309bd3-ece5-4841-815e-7fd870527bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:34.141323 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7309bd3-ece5-4841-815e-7fd870527bb4 admin admin] PATH_INFO: `/v3/projects/9ec98c1e6af3470c8f2cdc7c7b16b602/users/f907bba9b1ab4a5787062a599c26a431/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:34.163423 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 808/1625] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:50:33 2022] PUT /identity/v3/projects/f56cc84057ad4fdc91c1cec44b31664a/users/cb42cd97e68147b49d5e8f895e5f8d0a/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:50:34.164384 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f829703-ff25-4bcc-86a6-d63b48a62eb7 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:34.200876 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7309bd3-ece5-4841-815e-7fd870527bb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ec98c1e6af3470c8f2cdc7c7b16b602, user_id=f907bba9b1ab4a5787062a599c26a431, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:34.205631 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7309bd3-ece5-4841-815e-7fd870527bb4 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:34.275261 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f829703-ff25-4bcc-86a6-d63b48a62eb7 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:34.289567 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 818/1626] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:50:34 2022] PUT /identity/v3/projects/9ec98c1e6af3470c8f2cdc7c7b16b602/users/f907bba9b1ab4a5787062a599c26a431/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:50:34.293190 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7309bd3-ece5-4841-815e-7fd870527bb4 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:34.317918 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cee6a-eedc-4944-bba1-46a65cf8c65f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:34.324272 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cee6a-eedc-4944-bba1-46a65cf8c65f service nova] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:34.324459 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cee6a-eedc-4944-bba1-46a65cf8c65f service nova] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:34.324702 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cee6a-eedc-4944-bba1-46a65cf8c65f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:34.477474 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039cee6a-eedc-4944-bba1-46a65cf8c65f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:34.479790 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039cee6a-eedc-4944-bba1-46a65cf8c65f service nova] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:34.491417 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 809/1627] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:50:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:50:34.491662 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7309bd3-ece5-4841-815e-7fd870527bb4 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:34.492590 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cee6a-eedc-4944-bba1-46a65cf8c65f service nova] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:34.505673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a58c7e-e6de-4f16-bab7-82bf6f383578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:34.510761 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a58c7e-e6de-4f16-bab7-82bf6f383578 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:34.510761 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a58c7e-e6de-4f16-bab7-82bf6f383578 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:34.510761 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a58c7e-e6de-4f16-bab7-82bf6f383578 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:34.510761 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a58c7e-e6de-4f16-bab7-82bf6f383578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:34.510761 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a58c7e-e6de-4f16-bab7-82bf6f383578 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:34.533658 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 819/1628] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:50:34.534951 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37374497-fd25-45db-b6e7-7bb85fab7db5 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:34.535241 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37374497-fd25-45db-b6e7-7bb85fab7db5 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:34.535791 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37374497-fd25-45db-b6e7-7bb85fab7db5 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:34.538027 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 820/1629] 10.222.0.70 () {54 vars in 962 bytes} [Mon Aug 8 17:50:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:50:34.538769 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37374497-fd25-45db-b6e7-7bb85fab7db5 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:34.551583 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37374497-fd25-45db-b6e7-7bb85fab7db5 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:34.557773 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f33a2-dae4-43d1-9cdb-575912c730fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:34.558805 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f33a2-dae4-43d1-9cdb-575912c730fc admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:34.559089 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f33a2-dae4-43d1-9cdb-575912c730fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:34.559579 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f33a2-dae4-43d1-9cdb-575912c730fc admin admin] PATH_INFO: `/v3/projects/f56cc84057ad4fdc91c1cec44b31664a/users/cb42cd97e68147b49d5e8f895e5f8d0a/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:34.561996 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f33a2-dae4-43d1-9cdb-575912c730fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f56cc84057ad4fdc91c1cec44b31664a, user_id=cb42cd97e68147b49d5e8f895e5f8d0a, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:34.565346 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f33a2-dae4-43d1-9cdb-575912c730fc admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:34.580367 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 821/1630] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:50:34 2022] PUT /identity/v3/projects/f56cc84057ad4fdc91c1cec44b31664a/users/cb42cd97e68147b49d5e8f895e5f8d0a/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:50:34.581916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afb074-4c5b-4226-adf9-9026279295c1 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:34.585633 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afb074-4c5b-4226-adf9-9026279295c1 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:34.585633 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afb074-4c5b-4226-adf9-9026279295c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:34.592916 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cee6a-eedc-4944-bba1-46a65cf8c65f service nova] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:34.609800 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:34.636950 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-40afb074-4c5b-4226-adf9-9026279295c1 None None] MFA Rules not processed for user `3973b8fbfbb9475896e4e110ca8aa615`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:34.639995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-40afb074-4c5b-4226-adf9-9026279295c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:34.729534 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef675d-1991-47ea-8eed-38b36bf2a6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:34.730212 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef675d-1991-47ea-8eed-38b36bf2a6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:34.730363 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef675d-1991-47ea-8eed-38b36bf2a6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:34.730638 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef675d-1991-47ea-8eed-38b36bf2a6b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:34.731294 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef675d-1991-47ea-8eed-38b36bf2a6b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:34.733074 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef675d-1991-47ea-8eed-38b36bf2a6b2 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:34.770593 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 822/1631] 10.222.0.70 () {58 vars in 1059 bytes} [Mon Aug 8 17:50:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:34.772109 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 810/1632] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:50:34.797704 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2b620-aa4c-46c7-aaf9-e77a7e417923 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:34.797704 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2b620-aa4c-46c7-aaf9-e77a7e417923 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:34.797704 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2b620-aa4c-46c7-aaf9-e77a7e417923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:34.798022 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef675d-1991-47ea-8eed-38b36bf2a6b2 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:34.798022 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef675d-1991-47ea-8eed-38b36bf2a6b2 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:34.806660 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-14f2b620-aa4c-46c7-aaf9-e77a7e417923 None None] MFA Rules not processed for user `cb42cd97e68147b49d5e8f895e5f8d0a`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:34.808260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-14f2b620-aa4c-46c7-aaf9-e77a7e417923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:34.811803 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee27a0-c51a-413d-a48e-2e4e7bbc9659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:34.812543 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee27a0-c51a-413d-a48e-2e4e7bbc9659 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:34.812831 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee27a0-c51a-413d-a48e-2e4e7bbc9659 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:34.813131 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee27a0-c51a-413d-a48e-2e4e7bbc9659 admin admin] PATH_INFO: `/v3/projects/9ec98c1e6af3470c8f2cdc7c7b16b602/users/f907bba9b1ab4a5787062a599c26a431/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:34.820421 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee27a0-c51a-413d-a48e-2e4e7bbc9659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ec98c1e6af3470c8f2cdc7c7b16b602, user_id=f907bba9b1ab4a5787062a599c26a431, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:34.826664 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee27a0-c51a-413d-a48e-2e4e7bbc9659 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:34.854095 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 811/1633] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:50:34 2022] PUT /identity/v3/projects/9ec98c1e6af3470c8f2cdc7c7b16b602/users/f907bba9b1ab4a5787062a599c26a431/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:50:34.857348 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794615b1-0d3c-4a9d-aa70-45f64b92b335 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:34.857484 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794615b1-0d3c-4a9d-aa70-45f64b92b335 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:34.857711 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794615b1-0d3c-4a9d-aa70-45f64b92b335 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:34.862761 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 812/1634] 10.222.0.70 () {54 vars in 912 bytes} [Mon Aug 8 17:50:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:50:34.864032 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784c5a6-5c95-434c-aa41-2e059af26f35 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:34.864321 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784c5a6-5c95-434c-aa41-2e059af26f35 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:34.864599 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784c5a6-5c95-434c-aa41-2e059af26f35 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:34.870165 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:34.870921 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 813/1635] 10.222.0.70 () {54 vars in 912 bytes} [Mon Aug 8 17:50:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:50:34.872843 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbedbf-20ee-47bc-ba49-b55843b74d0b None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:34.873164 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbedbf-20ee-47bc-ba49-b55843b74d0b None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:34.876017 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbedbf-20ee-47bc-ba49-b55843b74d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:34.928235 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 823/1636] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:34 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:34.929299 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbba669-5f3a-47c7-941d-5d4436816040 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:34.930769 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbba669-5f3a-47c7-941d-5d4436816040 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:34.931059 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbba669-5f3a-47c7-941d-5d4436816040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:34.944429 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-12fbedbf-20ee-47bc-ba49-b55843b74d0b None None] MFA Rules not processed for user `f907bba9b1ab4a5787062a599c26a431`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:34.946983 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-12fbedbf-20ee-47bc-ba49-b55843b74d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:34.971952 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-6cbba669-5f3a-47c7-941d-5d4436816040 None None] MFA Rules not processed for user `3973b8fbfbb9475896e4e110ca8aa615`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:34.979623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-6cbba669-5f3a-47c7-941d-5d4436816040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:35.039712 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 814/1637] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:34 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:35.041311 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457dc37-4ebb-44e8-a128-c809da33fff9 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:35.041797 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457dc37-4ebb-44e8-a128-c809da33fff9 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:35.042224 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457dc37-4ebb-44e8-a128-c809da33fff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:35.066109 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-9457dc37-4ebb-44e8-a128-c809da33fff9 None None] MFA Rules not processed for user `3973b8fbfbb9475896e4e110ca8aa615`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:35.067772 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-9457dc37-4ebb-44e8-a128-c809da33fff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:35.120667 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 824/1638] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Aug 8 17:50:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:35.121667 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbba669-5f3a-47c7-941d-5d4436816040 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:35.161293 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 815/1639] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Aug 8 17:50:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:35.168730 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457dc37-4ebb-44e8-a128-c809da33fff9 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:35.244357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbba669-5f3a-47c7-941d-5d4436816040 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:35.255756 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487a408-7ab5-4b84-9536-4657f72abe39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:35.258106 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487a408-7ab5-4b84-9536-4657f72abe39 service cinder] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:35.258923 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487a408-7ab5-4b84-9536-4657f72abe39 service cinder] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:35.259302 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487a408-7ab5-4b84-9536-4657f72abe39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:35.267847 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457dc37-4ebb-44e8-a128-c809da33fff9 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:35.278263 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d7670-4ede-4066-8414-fa2112063e02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:35.278849 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d7670-4ede-4066-8414-fa2112063e02 service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:35.279139 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d7670-4ede-4066-8414-fa2112063e02 service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:35.279417 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d7670-4ede-4066-8414-fa2112063e02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:35.291871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034d7670-4ede-4066-8414-fa2112063e02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:35.293545 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034d7670-4ede-4066-8414-fa2112063e02 service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:35.307277 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 816/1640] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:50:35 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:50:35.382938 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d7670-4ede-4066-8414-fa2112063e02 service cinder] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:35.394791 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d7670-4ede-4066-8414-fa2112063e02 service cinder] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:35.403113 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c5407-1681-43b0-a00e-b6d53684552b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:35.404568 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c5407-1681-43b0-a00e-b6d53684552b service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:35.404894 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c5407-1681-43b0-a00e-b6d53684552b service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:35.405269 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c5407-1681-43b0-a00e-b6d53684552b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:35.417244 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e487a408-7ab5-4b84-9536-4657f72abe39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:35.418853 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e487a408-7ab5-4b84-9536-4657f72abe39 service cinder] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:35.432001 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c5407-1681-43b0-a00e-b6d53684552b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:35.435475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c5407-1681-43b0-a00e-b6d53684552b service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:35.441388 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 825/1641] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:50:35 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:50:35.457216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 817/1642] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:50:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:50:35.545942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487a408-7ab5-4b84-9536-4657f72abe39 service cinder] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:35.555997 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487a408-7ab5-4b84-9536-4657f72abe39 service cinder] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:35.560201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f99dd-eaed-46f3-aa97-592e952ec1ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:35.560928 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f99dd-eaed-46f3-aa97-592e952ec1ef service cinder] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:35.561375 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f99dd-eaed-46f3-aa97-592e952ec1ef service cinder] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:35.561754 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f99dd-eaed-46f3-aa97-592e952ec1ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:35.577644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f99dd-eaed-46f3-aa97-592e952ec1ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:35.581436 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f99dd-eaed-46f3-aa97-592e952ec1ef service cinder] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:35.593647 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 826/1643] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:50:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:50:36.149666 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:36.377765 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:36.915727 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c5407-1681-43b0-a00e-b6d53684552b service cinder] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:36.915727 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c5407-1681-43b0-a00e-b6d53684552b service cinder] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:36.915727 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5f9fd-fa95-4f07-a895-2ff2d2602881 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:36.915727 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5f9fd-fa95-4f07-a895-2ff2d2602881 service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:36.924202 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5f9fd-fa95-4f07-a895-2ff2d2602881 service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:36.924202 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5f9fd-fa95-4f07-a895-2ff2d2602881 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:36.958682 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5f9fd-fa95-4f07-a895-2ff2d2602881 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:36.960762 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5f9fd-fa95-4f07-a895-2ff2d2602881 service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:36.976033 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 818/1644] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:50:36 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:50:37.118758 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f99dd-eaed-46f3-aa97-592e952ec1ef service cinder] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:37.211568 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f99dd-eaed-46f3-aa97-592e952ec1ef service cinder] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:37.223902 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d25426-4f2a-48b8-89f6-c24492501ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:37.225464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d25426-4f2a-48b8-89f6-c24492501ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:37.225633 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d25426-4f2a-48b8-89f6-c24492501ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:37.226040 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d25426-4f2a-48b8-89f6-c24492501ac9 admin admin] PATH_INFO: `/v3/users/4f334fe4ba7c4a4d95807169210e5a2e` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:37.227285 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d25426-4f2a-48b8-89f6-c24492501ac9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f334fe4ba7c4a4d95807169210e5a2e)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:37.229749 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d25426-4f2a-48b8-89f6-c24492501ac9 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:37.516525 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-43d25426-4f2a-48b8-89f6-c24492501ac9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f334fe4ba7c4a4d95807169210e5a2e'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:37.566525 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-43d25426-4f2a-48b8-89f6-c24492501ac9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f334fe4ba7c4a4d95807169210e5a2e'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:37.567716 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-43d25426-4f2a-48b8-89f6-c24492501ac9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f334fe4ba7c4a4d95807169210e5a2e'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:37.575932 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-43d25426-4f2a-48b8-89f6-c24492501ac9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f334fe4ba7c4a4d95807169210e5a2e'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:37.607776 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-43d25426-4f2a-48b8-89f6-c24492501ac9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f334fe4ba7c4a4d95807169210e5a2e'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:37.734503 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 827/1645] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:50:37 2022] DELETE /identity/v3/users/4f334fe4ba7c4a4d95807169210e5a2e => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:50:37.740279 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc27c11-742a-4e90-9355-2c2f8f19afa2 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:37.741637 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc27c11-742a-4e90-9355-2c2f8f19afa2 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:37.742399 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc27c11-742a-4e90-9355-2c2f8f19afa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:37.809731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-dbc27c11-742a-4e90-9355-2c2f8f19afa2 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:37.815696 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-dbc27c11-742a-4e90-9355-2c2f8f19afa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:37.968748 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 819/1646] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:37.980037 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d25426-4f2a-48b8-89f6-c24492501ac9 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:37.982310 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-43d25426-4f2a-48b8-89f6-c24492501ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:38.045066 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:38.083806 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d25426-4f2a-48b8-89f6-c24492501ac9 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:38.091030 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4152308-7e39-442d-be82-fdf898f89291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:38.097537 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4152308-7e39-442d-be82-fdf898f89291 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:38.097537 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4152308-7e39-442d-be82-fdf898f89291 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:38.097537 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4152308-7e39-442d-be82-fdf898f89291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:38.108703 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4152308-7e39-442d-be82-fdf898f89291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:38.108703 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4152308-7e39-442d-be82-fdf898f89291 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:38.120950 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 828/1647] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:50:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:50:39.622022 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc27c11-742a-4e90-9355-2c2f8f19afa2 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:39.623496 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-dbc27c11-742a-4e90-9355-2c2f8f19afa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:39.650372 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc27c11-742a-4e90-9355-2c2f8f19afa2 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:39.668679 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78551ce-d909-421f-a7ec-b9abd123eb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:39.669676 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78551ce-d909-421f-a7ec-b9abd123eb5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:39.669676 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78551ce-d909-421f-a7ec-b9abd123eb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:39.669930 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78551ce-d909-421f-a7ec-b9abd123eb5b admin admin] PATH_INFO: `/v3/projects/6335490309af4c76a9ffec448e7c88b6` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:39.671100 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78551ce-d909-421f-a7ec-b9abd123eb5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6335490309af4c76a9ffec448e7c88b6)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:39.673095 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78551ce-d909-421f-a7ec-b9abd123eb5b admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:39.905816 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:39.928695 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a78551ce-d909-421f-a7ec-b9abd123eb5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6335490309af4c76a9ffec448e7c88b6', 'request_id': 'req-a78551ce-d909-421f-a7ec-b9abd123eb5b'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:39.947746 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a78551ce-d909-421f-a7ec-b9abd123eb5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6335490309af4c76a9ffec448e7c88b6', 'request_id': 'req-a78551ce-d909-421f-a7ec-b9abd123eb5b'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:40.107699 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a78551ce-d909-421f-a7ec-b9abd123eb5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6335490309af4c76a9ffec448e7c88b6', 'request_id': 'req-a78551ce-d909-421f-a7ec-b9abd123eb5b'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:40.129784 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a78551ce-d909-421f-a7ec-b9abd123eb5b admin admin] The token cache is being invalidate because project 6335490309af4c76a9ffec448e7c88b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:50:40.130078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a78551ce-d909-421f-a7ec-b9abd123eb5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:40.145055 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a78551ce-d909-421f-a7ec-b9abd123eb5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:40.148553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 820/1648] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:50:39 2022] DELETE /identity/v3/projects/6335490309af4c76a9ffec448e7c88b6 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:50:40.152449 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4152308-7e39-442d-be82-fdf898f89291 service neutron] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:40.165207 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4152308-7e39-442d-be82-fdf898f89291 service neutron] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:40.383989 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef199d0a-df25-4713-b181-87dccd45fefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:40.385020 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef199d0a-df25-4713-b181-87dccd45fefc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:40.385468 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef199d0a-df25-4713-b181-87dccd45fefc admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:40.385897 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef199d0a-df25-4713-b181-87dccd45fefc admin admin] PATH_INFO: `/v3/users/f907bba9b1ab4a5787062a599c26a431` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:40.387397 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef199d0a-df25-4713-b181-87dccd45fefc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f907bba9b1ab4a5787062a599c26a431)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:40.395657 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef199d0a-df25-4713-b181-87dccd45fefc admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:40.659318 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-ef199d0a-df25-4713-b181-87dccd45fefc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f907bba9b1ab4a5787062a599c26a431'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:40.729076 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-ef199d0a-df25-4713-b181-87dccd45fefc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f907bba9b1ab4a5787062a599c26a431'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:40.730221 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-ef199d0a-df25-4713-b181-87dccd45fefc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f907bba9b1ab4a5787062a599c26a431'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:40.731118 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-ef199d0a-df25-4713-b181-87dccd45fefc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f907bba9b1ab4a5787062a599c26a431'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:40.743594 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-ef199d0a-df25-4713-b181-87dccd45fefc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f907bba9b1ab4a5787062a599c26a431'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:40.807284 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 829/1649] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:50:40 2022] DELETE /identity/v3/users/f907bba9b1ab4a5787062a599c26a431 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:50:43.258886 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78551ce-d909-421f-a7ec-b9abd123eb5b admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:43.260794 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-a78551ce-d909-421f-a7ec-b9abd123eb5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:43.300775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78551ce-d909-421f-a7ec-b9abd123eb5b admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:43.489603 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5159b0-70bc-49e3-8a68-8f8b12bfbe0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:43.490395 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5159b0-70bc-49e3-8a68-8f8b12bfbe0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:43.491492 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5159b0-70bc-49e3-8a68-8f8b12bfbe0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:43.491985 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5159b0-70bc-49e3-8a68-8f8b12bfbe0c admin admin] PATH_INFO: `/v3/projects/9ec98c1e6af3470c8f2cdc7c7b16b602` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:43.493839 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5159b0-70bc-49e3-8a68-8f8b12bfbe0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ec98c1e6af3470c8f2cdc7c7b16b602)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:43.496534 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5159b0-70bc-49e3-8a68-8f8b12bfbe0c admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:43.774563 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-ef5159b0-70bc-49e3-8a68-8f8b12bfbe0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ec98c1e6af3470c8f2cdc7c7b16b602', 'request_id': 'req-ef5159b0-70bc-49e3-8a68-8f8b12bfbe0c'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:43.798030 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-ef5159b0-70bc-49e3-8a68-8f8b12bfbe0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ec98c1e6af3470c8f2cdc7c7b16b602', 'request_id': 'req-ef5159b0-70bc-49e3-8a68-8f8b12bfbe0c'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:43.901046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-ef5159b0-70bc-49e3-8a68-8f8b12bfbe0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ec98c1e6af3470c8f2cdc7c7b16b602', 'request_id': 'req-ef5159b0-70bc-49e3-8a68-8f8b12bfbe0c'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:43.931460 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-ef5159b0-70bc-49e3-8a68-8f8b12bfbe0c admin admin] The token cache is being invalidate because project 9ec98c1e6af3470c8f2cdc7c7b16b602 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:50:43.931460 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-ef5159b0-70bc-49e3-8a68-8f8b12bfbe0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:43.933581 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-ef5159b0-70bc-49e3-8a68-8f8b12bfbe0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:43.940781 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 821/1650] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:50:43 2022] DELETE /identity/v3/projects/9ec98c1e6af3470c8f2cdc7c7b16b602 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:50:43.946792 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a6791-2ad6-46fc-81de-d3d6b73273b8 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:43.948052 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a6791-2ad6-46fc-81de-d3d6b73273b8 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:43.948337 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a6791-2ad6-46fc-81de-d3d6b73273b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:43.992314 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-842a6791-2ad6-46fc-81de-d3d6b73273b8 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:43.996351 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-842a6791-2ad6-46fc-81de-d3d6b73273b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:44.104712 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:44.151293 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 830/1651] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:44.153174 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bc3fd-c659-4792-adbb-c967534808ca None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:44.153479 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bc3fd-c659-4792-adbb-c967534808ca None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:44.153754 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bc3fd-c659-4792-adbb-c967534808ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:44.228427 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-165bc3fd-c659-4792-adbb-c967534808ca None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:44.230577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-165bc3fd-c659-4792-adbb-c967534808ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:44.259266 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 822/1652] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:44.262649 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a6791-2ad6-46fc-81de-d3d6b73273b8 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:44.276153 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a6791-2ad6-46fc-81de-d3d6b73273b8 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:44.297726 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f558c8-8a71-4e5f-b26f-c47792e26d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:44.302294 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f558c8-8a71-4e5f-b26f-c47792e26d10 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:44.302294 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f558c8-8a71-4e5f-b26f-c47792e26d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:44.302294 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f558c8-8a71-4e5f-b26f-c47792e26d10 admin admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:44.302688 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f558c8-8a71-4e5f-b26f-c47792e26d10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:50:44.304472 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f558c8-8a71-4e5f-b26f-c47792e26d10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:44.308482 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f558c8-8a71-4e5f-b26f-c47792e26d10 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:44.361313 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 831/1653] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:50:44.361981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165bc3fd-c659-4792-adbb-c967534808ca None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:44.375695 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165bc3fd-c659-4792-adbb-c967534808ca None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:44.390624 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434cc80d-f3bd-497d-a4e1-c6fa479d5977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:44.391472 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434cc80d-f3bd-497d-a4e1-c6fa479d5977 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:44.391893 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434cc80d-f3bd-497d-a4e1-c6fa479d5977 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:44.392322 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434cc80d-f3bd-497d-a4e1-c6fa479d5977 admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:44.392987 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434cc80d-f3bd-497d-a4e1-c6fa479d5977 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:44.400349 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434cc80d-f3bd-497d-a4e1-c6fa479d5977 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:44.449664 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2fcf4-f9d0-45a9-98ec-55e38c81195e None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:44.450146 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2fcf4-f9d0-45a9-98ec-55e38c81195e None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:44.451629 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2fcf4-f9d0-45a9-98ec-55e38c81195e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:44.508911 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-67e2fcf4-f9d0-45a9-98ec-55e38c81195e None None] MFA Rules not processed for user `d26e7b888a914f93a69b179f9e7ad14e`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:44.510480 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-67e2fcf4-f9d0-45a9-98ec-55e38c81195e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:44.539334 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 823/1654] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:50:44 2022] POST /identity/v3/projects => generated 367 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:50:44.543691 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434cc80d-f3bd-497d-a4e1-c6fa479d5977 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:44.615541 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:44.678020 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 832/1655] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:44.692097 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2fcf4-f9d0-45a9-98ec-55e38c81195e None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:44.693420 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434cc80d-f3bd-497d-a4e1-c6fa479d5977 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:44.695172 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-67e2fcf4-f9d0-45a9-98ec-55e38c81195e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:44.703679 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e328e8-8c15-4027-a085-0cd7187c56b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:44.704585 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e328e8-8c15-4027-a085-0cd7187c56b3 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:44.705068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e328e8-8c15-4027-a085-0cd7187c56b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:44.705571 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e328e8-8c15-4027-a085-0cd7187c56b3 admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:44.706443 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e328e8-8c15-4027-a085-0cd7187c56b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:44.708980 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e328e8-8c15-4027-a085-0cd7187c56b3 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:44.811712 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 824/1656] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:50:44 2022] POST /identity/v3/users => generated 284 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:50:44.813162 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e328e8-8c15-4027-a085-0cd7187c56b3 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:44.844957 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e328e8-8c15-4027-a085-0cd7187c56b3 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:44.891982 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c1206-62e7-4954-b691-e19dfb30587d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:44.895064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c1206-62e7-4954-b691-e19dfb30587d admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:44.896329 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2fcf4-f9d0-45a9-98ec-55e38c81195e None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:44.897705 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c1206-62e7-4954-b691-e19dfb30587d admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:44.898287 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c1206-62e7-4954-b691-e19dfb30587d admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:44.904563 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c1206-62e7-4954-b691-e19dfb30587d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:44.908958 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c1206-62e7-4954-b691-e19dfb30587d admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:44.942433 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 825/1657] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:50:44.945501 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c1206-62e7-4954-b691-e19dfb30587d admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:45.000242 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c1206-62e7-4954-b691-e19dfb30587d admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:45.032022 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac06f5e-2b85-444e-a8ca-722fb48f1880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:45.034356 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac06f5e-2b85-444e-a8ca-722fb48f1880 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:45.034825 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac06f5e-2b85-444e-a8ca-722fb48f1880 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:45.039267 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac06f5e-2b85-444e-a8ca-722fb48f1880 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:45.040197 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac06f5e-2b85-444e-a8ca-722fb48f1880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:45.046113 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac06f5e-2b85-444e-a8ca-722fb48f1880 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:45.080417 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 826/1658] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:50:45.092141 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac06f5e-2b85-444e-a8ca-722fb48f1880 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:45.105884 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67083eb0-ebbe-4330-81f8-7d65c11aec1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:45.106512 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67083eb0-ebbe-4330-81f8-7d65c11aec1d service nova] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:45.106794 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67083eb0-ebbe-4330-81f8-7d65c11aec1d service nova] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:45.107067 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67083eb0-ebbe-4330-81f8-7d65c11aec1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:45.120800 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac06f5e-2b85-444e-a8ca-722fb48f1880 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:45.139689 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e58ae-7b41-4e79-ac21-0f39651ff606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:45.140371 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e58ae-7b41-4e79-ac21-0f39651ff606 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:45.140647 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e58ae-7b41-4e79-ac21-0f39651ff606 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:45.140918 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e58ae-7b41-4e79-ac21-0f39651ff606 admin admin] PATH_INFO: `/v3/projects/c1f700986d774a7eb00651edc0e50036/users/41b96be3a78246ab9e30dd61b5d1aa05/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:45.176603 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e58ae-7b41-4e79-ac21-0f39651ff606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1f700986d774a7eb00651edc0e50036, user_id=41b96be3a78246ab9e30dd61b5d1aa05, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:45.181440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e58ae-7b41-4e79-ac21-0f39651ff606 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:45.260708 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 827/1659] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:50:45 2022] PUT /identity/v3/projects/c1f700986d774a7eb00651edc0e50036/users/41b96be3a78246ab9e30dd61b5d1aa05/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:50:45.261621 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e58ae-7b41-4e79-ac21-0f39651ff606 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:45.271180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-2b6e58ae-7b41-4e79-ac21-0f39651ff606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:45.289158 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67083eb0-ebbe-4330-81f8-7d65c11aec1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:45.289158 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67083eb0-ebbe-4330-81f8-7d65c11aec1d service nova] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:45.324660 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 833/1660] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:50:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:50:45.333825 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ea0f8-921e-4c33-a286-51715a0414f5 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:45.334126 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ea0f8-921e-4c33-a286-51715a0414f5 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:45.337692 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ea0f8-921e-4c33-a286-51715a0414f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:45.368561 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:45.439548 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-d37ea0f8-921e-4c33-a286-51715a0414f5 None None] MFA Rules not processed for user `41b96be3a78246ab9e30dd61b5d1aa05`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:45.441335 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-d37ea0f8-921e-4c33-a286-51715a0414f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:45.502709 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e58ae-7b41-4e79-ac21-0f39651ff606 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:45.519860 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b7ebff-283f-4b7a-b86f-706471893f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:45.523620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7ebff-283f-4b7a-b86f-706471893f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:45.523620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7ebff-283f-4b7a-b86f-706471893f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:45.523620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7ebff-283f-4b7a-b86f-706471893f36 admin admin] PATH_INFO: `/v3/users/06e952d3f6e245bba9f6d086aea98687` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:45.523620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b7ebff-283f-4b7a-b86f-706471893f36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06e952d3f6e245bba9f6d086aea98687)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:45.524481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: WARNING py.warnings [None req-b9b7ebff-283f-4b7a-b86f-706471893f36 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 17:50:45.524481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: warnings.warn(msg) Aug 08 17:50:45.524481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: Aug 08 17:50:45.526060 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b7ebff-283f-4b7a-b86f-706471893f36 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:45.585515 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 834/1661] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:45.589952 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ea0f8-921e-4c33-a286-51715a0414f5 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:45.606465 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ea0f8-921e-4c33-a286-51715a0414f5 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:45.617183 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cef37e-ffba-41d0-ae75-1b070750e36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:45.617183 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cef37e-ffba-41d0-ae75-1b070750e36f admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:45.617183 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cef37e-ffba-41d0-ae75-1b070750e36f admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:45.617183 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cef37e-ffba-41d0-ae75-1b070750e36f admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:45.617792 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cef37e-ffba-41d0-ae75-1b070750e36f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:45.619717 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cef37e-ffba-41d0-ae75-1b070750e36f admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:45.719877 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 835/1662] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:50:45 2022] POST /identity/v3/projects => generated 369 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:50:45.723771 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cef37e-ffba-41d0-ae75-1b070750e36f admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:45.880940 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-b9b7ebff-283f-4b7a-b86f-706471893f36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06e952d3f6e245bba9f6d086aea98687'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:45.911007 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cef37e-ffba-41d0-ae75-1b070750e36f admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:45.920100 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4577f7-a9e9-4593-a25e-f8a9f34ae0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:45.921746 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4577f7-a9e9-4593-a25e-f8a9f34ae0b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:45.925286 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4577f7-a9e9-4593-a25e-f8a9f34ae0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:45.925286 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4577f7-a9e9-4593-a25e-f8a9f34ae0b0 admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:45.925286 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4577f7-a9e9-4593-a25e-f8a9f34ae0b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:45.928959 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4577f7-a9e9-4593-a25e-f8a9f34ae0b0 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:45.996649 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-b9b7ebff-283f-4b7a-b86f-706471893f36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06e952d3f6e245bba9f6d086aea98687'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:45.997424 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-b9b7ebff-283f-4b7a-b86f-706471893f36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06e952d3f6e245bba9f6d086aea98687'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:45.999107 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-b9b7ebff-283f-4b7a-b86f-706471893f36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06e952d3f6e245bba9f6d086aea98687'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:46.034839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 836/1663] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:50:45 2022] POST /identity/v3/users => generated 291 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:50:46.040467 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4577f7-a9e9-4593-a25e-f8a9f34ae0b0 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:46.045094 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-4a4577f7-a9e9-4593-a25e-f8a9f34ae0b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:46.045951 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-b9b7ebff-283f-4b7a-b86f-706471893f36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06e952d3f6e245bba9f6d086aea98687'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:46.115278 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4577f7-a9e9-4593-a25e-f8a9f34ae0b0 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:46.115807 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:46.129949 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e9c91-c05f-43d1-9d58-b3c2c5ce6374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:46.133954 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e9c91-c05f-43d1-9d58-b3c2c5ce6374 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:46.134260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e9c91-c05f-43d1-9d58-b3c2c5ce6374 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:46.134542 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e9c91-c05f-43d1-9d58-b3c2c5ce6374 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:46.135240 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e9c91-c05f-43d1-9d58-b3c2c5ce6374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:46.140389 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e9c91-c05f-43d1-9d58-b3c2c5ce6374 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:46.156780 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:46.165792 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 828/1664] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:50:45 2022] DELETE /identity/v3/users/06e952d3f6e245bba9f6d086aea98687 => generated 0 bytes in 904 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:50:46.170543 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f310f27-18d6-4171-a2e2-a048dace242d None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:46.170853 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f310f27-18d6-4171-a2e2-a048dace242d None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:46.171283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f310f27-18d6-4171-a2e2-a048dace242d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:46.179576 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 837/1665] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:50:46.184290 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e9c91-c05f-43d1-9d58-b3c2c5ce6374 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:46.219916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e9c91-c05f-43d1-9d58-b3c2c5ce6374 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:46.254417 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-7f310f27-18d6-4171-a2e2-a048dace242d None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:46.267088 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-7f310f27-18d6-4171-a2e2-a048dace242d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:46.421816 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fcf41b-666c-4db0-93b7-14f4eb29dbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:46.429148 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fcf41b-666c-4db0-93b7-14f4eb29dbac admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:46.429148 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fcf41b-666c-4db0-93b7-14f4eb29dbac admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:46.429148 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fcf41b-666c-4db0-93b7-14f4eb29dbac admin admin] PATH_INFO: `/v3/projects/c2d01d2c4a324e289fac9fb7e791b8ce/users/d65337393e804e1d8432a15d5b0ce57a/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:46.434333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 829/1666] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:46.444644 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f310f27-18d6-4171-a2e2-a048dace242d None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:46.447001 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-7f310f27-18d6-4171-a2e2-a048dace242d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:46.470076 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fcf41b-666c-4db0-93b7-14f4eb29dbac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2d01d2c4a324e289fac9fb7e791b8ce, user_id=d65337393e804e1d8432a15d5b0ce57a, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:46.478058 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fcf41b-666c-4db0-93b7-14f4eb29dbac admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:46.574897 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 838/1667] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:50:46 2022] PUT /identity/v3/projects/c2d01d2c4a324e289fac9fb7e791b8ce/users/d65337393e804e1d8432a15d5b0ce57a/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:50:46.581073 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fcf41b-666c-4db0-93b7-14f4eb29dbac admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:46.608206 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f310f27-18d6-4171-a2e2-a048dace242d None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:46.698516 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fcf41b-666c-4db0-93b7-14f4eb29dbac admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:46.714885 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d910bca-dfd6-4904-a61b-3ec5c400ec06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:46.723507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d910bca-dfd6-4904-a61b-3ec5c400ec06 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:46.723507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d910bca-dfd6-4904-a61b-3ec5c400ec06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:46.723507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d910bca-dfd6-4904-a61b-3ec5c400ec06 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:46.723507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d910bca-dfd6-4904-a61b-3ec5c400ec06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:46.723507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d910bca-dfd6-4904-a61b-3ec5c400ec06 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:46.741817 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a8b85-4e7f-4972-8adf-3bbd0794ba51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:46.742003 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 839/1668] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:50:46.743166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a8b85-4e7f-4972-8adf-3bbd0794ba51 service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:46.743514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a8b85-4e7f-4972-8adf-3bbd0794ba51 service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:46.743859 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a8b85-4e7f-4972-8adf-3bbd0794ba51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:46.746033 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d910bca-dfd6-4904-a61b-3ec5c400ec06 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:46.762131 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d910bca-dfd6-4904-a61b-3ec5c400ec06 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:46.764600 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a8b85-4e7f-4972-8adf-3bbd0794ba51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:46.767074 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a8b85-4e7f-4972-8adf-3bbd0794ba51 service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:46.768569 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb51f1-9569-4695-b62d-a1a079418933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:46.769394 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb51f1-9569-4695-b62d-a1a079418933 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:46.769713 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb51f1-9569-4695-b62d-a1a079418933 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:46.770078 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb51f1-9569-4695-b62d-a1a079418933 admin admin] PATH_INFO: `/v3/projects/c2d01d2c4a324e289fac9fb7e791b8ce/users/d65337393e804e1d8432a15d5b0ce57a/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:46.774719 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb51f1-9569-4695-b62d-a1a079418933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2d01d2c4a324e289fac9fb7e791b8ce, user_id=d65337393e804e1d8432a15d5b0ce57a, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:46.778380 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb51f1-9569-4695-b62d-a1a079418933 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:46.806356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 840/1669] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:50:46 2022] PUT /identity/v3/projects/c2d01d2c4a324e289fac9fb7e791b8ce/users/d65337393e804e1d8432a15d5b0ce57a/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:50:46.810174 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 830/1670] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:50:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:50:46.818280 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0742d3-3012-4654-8338-54939b0bdb38 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:46.818612 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0742d3-3012-4654-8338-54939b0bdb38 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:46.818911 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0742d3-3012-4654-8338-54939b0bdb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:46.921782 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-1e0742d3-3012-4654-8338-54939b0bdb38 None None] MFA Rules not processed for user `d65337393e804e1d8432a15d5b0ce57a`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:46.923074 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-1e0742d3-3012-4654-8338-54939b0bdb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:47.137637 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 841/1671] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:46 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:47.148959 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a8b85-4e7f-4972-8adf-3bbd0794ba51 service neutron] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:47.154179 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-758a8b85-4e7f-4972-8adf-3bbd0794ba51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:47.297997 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a8b85-4e7f-4972-8adf-3bbd0794ba51 service neutron] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:47.427469 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c3540-c854-4a80-b778-16ccabbde27c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:47.428191 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c3540-c854-4a80-b778-16ccabbde27c service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:47.428424 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c3540-c854-4a80-b778-16ccabbde27c service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:47.428891 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c3540-c854-4a80-b778-16ccabbde27c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:47.447704 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c3540-c854-4a80-b778-16ccabbde27c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:47.449225 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c3540-c854-4a80-b778-16ccabbde27c service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:47.481296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 831/1672] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:50:47 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:50:47.485137 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0f1a9-6158-4f4c-8d1d-5a0cba3216ac None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:47.485767 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0f1a9-6158-4f4c-8d1d-5a0cba3216ac None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:47.486195 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0f1a9-6158-4f4c-8d1d-5a0cba3216ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:47.589513 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-23a0f1a9-6158-4f4c-8d1d-5a0cba3216ac None None] MFA Rules not processed for user `5037a7b0ba994938ae10d2b3316dab93`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:47.594137 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-23a0f1a9-6158-4f4c-8d1d-5a0cba3216ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:47.863594 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871d4e8-62fd-46dc-bcc5-59f8bef51b52 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:47.864127 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871d4e8-62fd-46dc-bcc5-59f8bef51b52 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:47.864582 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871d4e8-62fd-46dc-bcc5-59f8bef51b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:47.869677 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 842/1673] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:47.887403 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:47.912529 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-e871d4e8-62fd-46dc-bcc5-59f8bef51b52 None None] MFA Rules not processed for user `5037a7b0ba994938ae10d2b3316dab93`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:47.917973 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-e871d4e8-62fd-46dc-bcc5-59f8bef51b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:47.950686 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0f1a9-6158-4f4c-8d1d-5a0cba3216ac None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:47.951732 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-23a0f1a9-6158-4f4c-8d1d-5a0cba3216ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:47.959804 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 832/1674] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:50:48.139604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871d4e8-62fd-46dc-bcc5-59f8bef51b52 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:48.141398 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-e871d4e8-62fd-46dc-bcc5-59f8bef51b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:48.231109 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0f1a9-6158-4f4c-8d1d-5a0cba3216ac None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:48.253995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab25cf1-066f-43a1-b7f2-d0507039ce0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:48.254989 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab25cf1-066f-43a1-b7f2-d0507039ce0d service nova] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:48.255415 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab25cf1-066f-43a1-b7f2-d0507039ce0d service nova] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:48.255845 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab25cf1-066f-43a1-b7f2-d0507039ce0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:48.298009 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab25cf1-066f-43a1-b7f2-d0507039ce0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:48.305199 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab25cf1-066f-43a1-b7f2-d0507039ce0d service nova] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:48.349264 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:48.357942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 843/1675] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:50:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:50:48.375442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab25cf1-066f-43a1-b7f2-d0507039ce0d service nova] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:48.379168 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-dab25cf1-066f-43a1-b7f2-d0507039ce0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:48.412148 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871d4e8-62fd-46dc-bcc5-59f8bef51b52 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:48.430342 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f74662-d166-4245-abfb-386e80608876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:48.432523 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f74662-d166-4245-abfb-386e80608876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:48.432523 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f74662-d166-4245-abfb-386e80608876 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:48.432523 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f74662-d166-4245-abfb-386e80608876 admin admin] PATH_INFO: `/v3/projects/ba4f1ead6837426688d63fedfae2a398` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:48.439764 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f74662-d166-4245-abfb-386e80608876 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba4f1ead6837426688d63fedfae2a398)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:48.447645 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab25cf1-066f-43a1-b7f2-d0507039ce0d service nova] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:48.452335 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f74662-d166-4245-abfb-386e80608876 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:48.475230 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af54002-9e02-4a1b-af59-66d26c971e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:48.475230 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af54002-9e02-4a1b-af59-66d26c971e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:48.475230 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af54002-9e02-4a1b-af59-66d26c971e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:48.476463 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af54002-9e02-4a1b-af59-66d26c971e6c admin admin] PATH_INFO: `/v3/users/5784dd04977449678ddf644996c685db` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:48.479027 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af54002-9e02-4a1b-af59-66d26c971e6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5784dd04977449678ddf644996c685db)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:48.489967 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af54002-9e02-4a1b-af59-66d26c971e6c admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:48.765610 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-f3f74662-d166-4245-abfb-386e80608876 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba4f1ead6837426688d63fedfae2a398', 'request_id': 'req-f3f74662-d166-4245-abfb-386e80608876'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:48.767237 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-8af54002-9e02-4a1b-af59-66d26c971e6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5784dd04977449678ddf644996c685db'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:48.782003 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-f3f74662-d166-4245-abfb-386e80608876 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba4f1ead6837426688d63fedfae2a398', 'request_id': 'req-f3f74662-d166-4245-abfb-386e80608876'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:48.828408 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:48.828408 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-8af54002-9e02-4a1b-af59-66d26c971e6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5784dd04977449678ddf644996c685db'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:48.828408 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-8af54002-9e02-4a1b-af59-66d26c971e6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5784dd04977449678ddf644996c685db'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:48.828408 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-8af54002-9e02-4a1b-af59-66d26c971e6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5784dd04977449678ddf644996c685db'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:48.841407 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-8af54002-9e02-4a1b-af59-66d26c971e6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5784dd04977449678ddf644996c685db'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:48.891298 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 844/1676] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:50:48 2022] DELETE /identity/v3/users/5784dd04977449678ddf644996c685db => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:50:48.893415 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8e42b-2562-4098-8e4f-a0b8bc992cc8 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:48.894263 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8e42b-2562-4098-8e4f-a0b8bc992cc8 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:48.895350 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8e42b-2562-4098-8e4f-a0b8bc992cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:48.935430 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-f3f74662-d166-4245-abfb-386e80608876 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba4f1ead6837426688d63fedfae2a398', 'request_id': 'req-f3f74662-d166-4245-abfb-386e80608876'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:48.940173 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-c0a8e42b-2562-4098-8e4f-a0b8bc992cc8 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:48.957682 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-c0a8e42b-2562-4098-8e4f-a0b8bc992cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:48.971578 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-f3f74662-d166-4245-abfb-386e80608876 admin admin] The token cache is being invalidate because project ba4f1ead6837426688d63fedfae2a398 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:50:48.975544 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-f3f74662-d166-4245-abfb-386e80608876 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:48.975544 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-f3f74662-d166-4245-abfb-386e80608876 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:48.976333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 833/1677] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:50:48 2022] DELETE /identity/v3/projects/ba4f1ead6837426688d63fedfae2a398 => generated 0 bytes in 837 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:50:48.983185 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a97c4d-84e5-4c90-920f-c3bf9845107f None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:48.983483 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a97c4d-84e5-4c90-920f-c3bf9845107f None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:48.983964 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a97c4d-84e5-4c90-920f-c3bf9845107f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:49.046921 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-e5a97c4d-84e5-4c90-920f-c3bf9845107f None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:49.048189 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-e5a97c4d-84e5-4c90-920f-c3bf9845107f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:49.130523 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 845/1678] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:49.169918 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8e42b-2562-4098-8e4f-a0b8bc992cc8 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:49.171872 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-c0a8e42b-2562-4098-8e4f-a0b8bc992cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:49.209144 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 834/1679] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:49.211230 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fc08f-c4b2-4141-8c98-72f3ce985dd1 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:49.211683 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fc08f-c4b2-4141-8c98-72f3ce985dd1 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:49.212209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fc08f-c4b2-4141-8c98-72f3ce985dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:49.242029 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-8b0fc08f-c4b2-4141-8c98-72f3ce985dd1 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:49.245454 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-8b0fc08f-c4b2-4141-8c98-72f3ce985dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:49.258976 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 835/1680] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:49.261494 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fc08f-c4b2-4141-8c98-72f3ce985dd1 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:49.309054 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fc08f-c4b2-4141-8c98-72f3ce985dd1 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:49.310294 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8e42b-2562-4098-8e4f-a0b8bc992cc8 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:49.319813 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5d0a1-f955-40f1-b3ca-346c54e64c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:49.320468 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5d0a1-f955-40f1-b3ca-346c54e64c7d admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:49.320746 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5d0a1-f955-40f1-b3ca-346c54e64c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:49.321021 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5d0a1-f955-40f1-b3ca-346c54e64c7d admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:49.321627 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24a74b-c8f1-4e06-adc9-b2425e839454 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:49.324481 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24a74b-c8f1-4e06-adc9-b2425e839454 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:49.325308 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24a74b-c8f1-4e06-adc9-b2425e839454 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:49.329772 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb5d0a1-f955-40f1-b3ca-346c54e64c7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:50:49.329772 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb5d0a1-f955-40f1-b3ca-346c54e64c7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:49.330081 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24a74b-c8f1-4e06-adc9-b2425e839454 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:49.330162 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb5d0a1-f955-40f1-b3ca-346c54e64c7d admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:49.355866 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:49.365926 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24a74b-c8f1-4e06-adc9-b2425e839454 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:49.375566 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24a74b-c8f1-4e06-adc9-b2425e839454 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:49.385508 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 836/1681] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:50:49.386483 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5d0a1-f955-40f1-b3ca-346c54e64c7d admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:49.408003 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5d0a1-f955-40f1-b3ca-346c54e64c7d admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:49.418839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 846/1682] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:50:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:50:49.427299 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b54620-5a41-413a-a636-a598988f90c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:49.428157 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b54620-5a41-413a-a636-a598988f90c9 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:49.428432 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b54620-5a41-413a-a636-a598988f90c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:49.429629 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b54620-5a41-413a-a636-a598988f90c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:49.430962 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b54620-5a41-413a-a636-a598988f90c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:49.432887 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b54620-5a41-413a-a636-a598988f90c9 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:49.553445 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 837/1683] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:50:49 2022] POST /identity/v3/projects => generated 399 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:50:49.562149 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24a74b-c8f1-4e06-adc9-b2425e839454 service neutron] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:49.576817 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24a74b-c8f1-4e06-adc9-b2425e839454 service neutron] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:49.739263 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e00304-b841-471d-a979-f3310fe1f441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:49.740169 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e00304-b841-471d-a979-f3310fe1f441 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:49.740624 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e00304-b841-471d-a979-f3310fe1f441 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:49.741756 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e00304-b841-471d-a979-f3310fe1f441 admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:49.743267 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e00304-b841-471d-a979-f3310fe1f441 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:49.749251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e00304-b841-471d-a979-f3310fe1f441 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:49.864179 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 847/1684] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:50:49 2022] POST /identity/v3/users => generated 300 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:50:49.867508 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b54620-5a41-413a-a636-a598988f90c9 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:49.884391 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b54620-5a41-413a-a636-a598988f90c9 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:49.904847 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951bc183-c888-462e-a62c-02c829c20885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:49.905785 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bc183-c888-462e-a62c-02c829c20885 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:49.913892 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bc183-c888-462e-a62c-02c829c20885 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:49.914890 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bc183-c888-462e-a62c-02c829c20885 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:49.916048 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951bc183-c888-462e-a62c-02c829c20885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:49.918439 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951bc183-c888-462e-a62c-02c829c20885 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:49.941200 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e00304-b841-471d-a979-f3310fe1f441 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:49.948228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 838/1685] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:50:49.962983 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e00304-b841-471d-a979-f3310fe1f441 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:49.996517 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1153113-af00-41a3-9c83-65388eed26aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:50.120902 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1153113-af00-41a3-9c83-65388eed26aa admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:50.120902 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1153113-af00-41a3-9c83-65388eed26aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:50.120902 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1153113-af00-41a3-9c83-65388eed26aa admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:50.120902 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1153113-af00-41a3-9c83-65388eed26aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:50.120902 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1153113-af00-41a3-9c83-65388eed26aa admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:50.120902 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 848/1686] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:50:50.123224 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1de6d-5ba2-492d-8afe-5da2a21c892e None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:50.123224 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1de6d-5ba2-492d-8afe-5da2a21c892e None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:50.123224 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1de6d-5ba2-492d-8afe-5da2a21c892e None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:50.123224 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 839/1687] 10.222.0.70 () {54 vars in 912 bytes} [Mon Aug 8 17:50:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:50:50.123709 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cb0fe-0e8d-4467-a20d-d4fb82d02369 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:50.123709 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cb0fe-0e8d-4467-a20d-d4fb82d02369 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:50.123709 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cb0fe-0e8d-4467-a20d-d4fb82d02369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:50.123928 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1de6d-5ba2-492d-8afe-5da2a21c892e None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:50.172047 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1de6d-5ba2-492d-8afe-5da2a21c892e None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:50.193681 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35892e40-a8f4-4faa-9f6e-897c5afb60a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:50.207901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-944cb0fe-0e8d-4467-a20d-d4fb82d02369 None None] MFA Rules not processed for user `bdb6f0f0cde24b05a34b78d48dc45c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:50.208013 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35892e40-a8f4-4faa-9f6e-897c5afb60a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:50.208109 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-944cb0fe-0e8d-4467-a20d-d4fb82d02369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:50.208199 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35892e40-a8f4-4faa-9f6e-897c5afb60a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:50.208199 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35892e40-a8f4-4faa-9f6e-897c5afb60a6 admin admin] PATH_INFO: `/v3/projects/5452ccbf02d54d40a0430833fd8accea/users/fc30305a1a7d4326bf5981277016043e/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:50.278244 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35892e40-a8f4-4faa-9f6e-897c5afb60a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5452ccbf02d54d40a0430833fd8accea, user_id=fc30305a1a7d4326bf5981277016043e, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:50.281105 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35892e40-a8f4-4faa-9f6e-897c5afb60a6 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:50.375655 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 849/1688] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Aug 8 17:50:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:50.426432 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 840/1689] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:50:50 2022] PUT /identity/v3/projects/5452ccbf02d54d40a0430833fd8accea/users/fc30305a1a7d4326bf5981277016043e/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:50:50.426922 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944cb0fe-0e8d-4467-a20d-d4fb82d02369 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:50.428041 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da7b95-95a3-4188-af06-582dea37763e None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:50.428445 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da7b95-95a3-4188-af06-582dea37763e None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:50.429337 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da7b95-95a3-4188-af06-582dea37763e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:50.459552 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944cb0fe-0e8d-4467-a20d-d4fb82d02369 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:50.500601 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-55da7b95-95a3-4188-af06-582dea37763e None None] MFA Rules not processed for user `fc30305a1a7d4326bf5981277016043e`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:50.504702 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-55da7b95-95a3-4188-af06-582dea37763e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:50.602955 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbff7d7-3fc4-4bce-9b46-001c63f03b3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:50.603614 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbff7d7-3fc4-4bce-9b46-001c63f03b3a service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:50.603896 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbff7d7-3fc4-4bce-9b46-001c63f03b3a service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:50.604191 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbff7d7-3fc4-4bce-9b46-001c63f03b3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:50.641719 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbff7d7-3fc4-4bce-9b46-001c63f03b3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:50.641719 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbff7d7-3fc4-4bce-9b46-001c63f03b3a service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:50.691953 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 850/1690] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:50:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:50:50.695244 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b80e6-1328-4999-90b7-8aebab43a9e8 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:50.695411 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b80e6-1328-4999-90b7-8aebab43a9e8 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:50.695692 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b80e6-1328-4999-90b7-8aebab43a9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:50.742517 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 841/1691] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:50 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:50:50.743605 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da7b95-95a3-4188-af06-582dea37763e None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:50.797695 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-070b80e6-1328-4999-90b7-8aebab43a9e8 None None] MFA Rules not processed for user `7d84d1d6d0ab469f905d01d8a1276dec`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:50.801508 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-070b80e6-1328-4999-90b7-8aebab43a9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:50.904721 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da7b95-95a3-4188-af06-582dea37763e None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:50.920055 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d7eeb-36a5-425a-a934-4c4dba628382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:50.925350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d7eeb-36a5-425a-a934-4c4dba628382 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:50.925350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d7eeb-36a5-425a-a934-4c4dba628382 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:50.925350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d7eeb-36a5-425a-a934-4c4dba628382 admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:50.926245 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d7eeb-36a5-425a-a934-4c4dba628382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:50.933807 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d7eeb-36a5-425a-a934-4c4dba628382 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:51.031395 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 851/1692] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:51.038591 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b80e6-1328-4999-90b7-8aebab43a9e8 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:51.040270 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-070b80e6-1328-4999-90b7-8aebab43a9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:51.095930 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:51.118064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 842/1693] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:50:50 2022] POST /identity/v3/projects => generated 399 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:50:51.119225 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d7eeb-36a5-425a-a934-4c4dba628382 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:51.380458 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b80e6-1328-4999-90b7-8aebab43a9e8 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:51.399374 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d7eeb-36a5-425a-a934-4c4dba628382 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:51.426945 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f792bcc-e83c-404a-9333-a8314a3d1c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:51.427664 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f792bcc-e83c-404a-9333-a8314a3d1c1c admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:51.427956 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f792bcc-e83c-404a-9333-a8314a3d1c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:51.428253 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f792bcc-e83c-404a-9333-a8314a3d1c1c admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:51.429529 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f792bcc-e83c-404a-9333-a8314a3d1c1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:51.451385 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:51.452490 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f792bcc-e83c-404a-9333-a8314a3d1c1c admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:51.546451 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be6f57-1cb5-4611-b7c1-2e3c8a320f34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:51.547087 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be6f57-1cb5-4611-b7c1-2e3c8a320f34 service nova] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:51.547458 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be6f57-1cb5-4611-b7c1-2e3c8a320f34 service nova] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:51.547741 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be6f57-1cb5-4611-b7c1-2e3c8a320f34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:51.594956 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 843/1694] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:50:51 2022] POST /identity/v3/users => generated 306 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:50:51.598773 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f792bcc-e83c-404a-9333-a8314a3d1c1c admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:51.631761 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f792bcc-e83c-404a-9333-a8314a3d1c1c admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:51.657055 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb653f-48d6-49b5-815b-acd169ab5183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:51.657903 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb653f-48d6-49b5-815b-acd169ab5183 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:51.658350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb653f-48d6-49b5-815b-acd169ab5183 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:51.658907 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb653f-48d6-49b5-815b-acd169ab5183 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:51.659770 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb653f-48d6-49b5-815b-acd169ab5183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:51.661585 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb653f-48d6-49b5-815b-acd169ab5183 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:51.684195 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 844/1695] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:50:51.688210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb653f-48d6-49b5-815b-acd169ab5183 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:51.708033 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be6f57-1cb5-4611-b7c1-2e3c8a320f34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:51.711008 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb653f-48d6-49b5-815b-acd169ab5183 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:51.712815 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be6f57-1cb5-4611-b7c1-2e3c8a320f34 service nova] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:51.726379 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df83cf8-4137-42c6-ab75-9ec0ca070705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:51.727456 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df83cf8-4137-42c6-ab75-9ec0ca070705 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:51.727969 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df83cf8-4137-42c6-ab75-9ec0ca070705 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:51.728458 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df83cf8-4137-42c6-ab75-9ec0ca070705 admin admin] PATH_INFO: `/v3/projects/12e7a40c685546ce808695b7102bdc4f/users/954edac64da64fb5adbb812a8ba5c397/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:51.734268 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 852/1696] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:50:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 697 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:50:51.773534 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f370b-436d-4a5a-bc48-793553fed702 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:51.776276 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f370b-436d-4a5a-bc48-793553fed702 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:51.776572 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f370b-436d-4a5a-bc48-793553fed702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:51.792941 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df83cf8-4137-42c6-ab75-9ec0ca070705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12e7a40c685546ce808695b7102bdc4f, user_id=954edac64da64fb5adbb812a8ba5c397, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:51.799216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df83cf8-4137-42c6-ab75-9ec0ca070705 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:51.864742 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-c42f370b-436d-4a5a-bc48-793553fed702 None None] MFA Rules not processed for user `56427a32e1044299a1098c911849e601`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:51.872074 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-c42f370b-436d-4a5a-bc48-793553fed702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:51.898272 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 845/1697] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:50:51 2022] PUT /identity/v3/projects/12e7a40c685546ce808695b7102bdc4f/users/954edac64da64fb5adbb812a8ba5c397/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:50:51.899076 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df83cf8-4137-42c6-ab75-9ec0ca070705 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:52.047919 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 853/1698] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:52.047919 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f370b-436d-4a5a-bc48-793553fed702 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:52.061935 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-c42f370b-436d-4a5a-bc48-793553fed702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:52.071178 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df83cf8-4137-42c6-ab75-9ec0ca070705 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:52.112642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4c13e-23b0-4d07-96c2-96c5e4e4cdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:52.114535 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4c13e-23b0-4d07-96c2-96c5e4e4cdcb admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:52.114974 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4c13e-23b0-4d07-96c2-96c5e4e4cdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:52.116160 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f370b-436d-4a5a-bc48-793553fed702 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:52.116825 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4c13e-23b0-4d07-96c2-96c5e4e4cdcb admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:52.119607 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4c13e-23b0-4d07-96c2-96c5e4e4cdcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:52.125800 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4c13e-23b0-4d07-96c2-96c5e4e4cdcb admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:52.150627 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5de9d4-913f-4e6f-9fa0-1fb2236858d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:52.151276 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5de9d4-913f-4e6f-9fa0-1fb2236858d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:52.151727 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5de9d4-913f-4e6f-9fa0-1fb2236858d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:52.152140 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5de9d4-913f-4e6f-9fa0-1fb2236858d4 admin admin] PATH_INFO: `/v3/projects/f326bd7f01544f94853e14afc9c8f8ed` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:52.153447 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5de9d4-913f-4e6f-9fa0-1fb2236858d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f326bd7f01544f94853e14afc9c8f8ed)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:52.160389 dv-cinder-852364-1-smb devstack@keystone.service[86919]: WARNING py.warnings [None req-6a5de9d4-913f-4e6f-9fa0-1fb2236858d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 17:50:52.160389 dv-cinder-852364-1-smb devstack@keystone.service[86919]: warnings.warn(msg) Aug 08 17:50:52.160389 dv-cinder-852364-1-smb devstack@keystone.service[86919]: Aug 08 17:50:52.177931 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5de9d4-913f-4e6f-9fa0-1fb2236858d4 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:52.178194 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 846/1699] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:50:52.182965 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4c13e-23b0-4d07-96c2-96c5e4e4cdcb admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:52.475978 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4c13e-23b0-4d07-96c2-96c5e4e4cdcb admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:52.490333 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-6a5de9d4-913f-4e6f-9fa0-1fb2236858d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f326bd7f01544f94853e14afc9c8f8ed', 'request_id': 'req-6a5de9d4-913f-4e6f-9fa0-1fb2236858d4'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:52.540907 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-6a5de9d4-913f-4e6f-9fa0-1fb2236858d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f326bd7f01544f94853e14afc9c8f8ed', 'request_id': 'req-6a5de9d4-913f-4e6f-9fa0-1fb2236858d4'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:52.631657 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-6a5de9d4-913f-4e6f-9fa0-1fb2236858d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f326bd7f01544f94853e14afc9c8f8ed', 'request_id': 'req-6a5de9d4-913f-4e6f-9fa0-1fb2236858d4'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:52.648452 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac5744-94e4-4910-a742-fd12c28ce73c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:52.649347 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac5744-94e4-4910-a742-fd12c28ce73c service nova] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:52.650023 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac5744-94e4-4910-a742-fd12c28ce73c service nova] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:52.650479 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac5744-94e4-4910-a742-fd12c28ce73c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:52.673775 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-6a5de9d4-913f-4e6f-9fa0-1fb2236858d4 admin admin] The token cache is being invalidate because project f326bd7f01544f94853e14afc9c8f8ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:50:52.673775 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-6a5de9d4-913f-4e6f-9fa0-1fb2236858d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:52.673775 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-6a5de9d4-913f-4e6f-9fa0-1fb2236858d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:52.677204 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 854/1700] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:50:52 2022] DELETE /identity/v3/projects/f326bd7f01544f94853e14afc9c8f8ed => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:50:52.677204 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5de9d4-913f-4e6f-9fa0-1fb2236858d4 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:52.683441 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-6a5de9d4-913f-4e6f-9fa0-1fb2236858d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:52.773548 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac5744-94e4-4910-a742-fd12c28ce73c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:52.776066 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac5744-94e4-4910-a742-fd12c28ce73c service nova] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:52.788246 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 847/1701] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:50:52 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:50:52.790476 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51069e-3980-4962-8b5a-50fac612d629 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:52.790844 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51069e-3980-4962-8b5a-50fac612d629 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:52.791032 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51069e-3980-4962-8b5a-50fac612d629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:52.807428 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5de9d4-913f-4e6f-9fa0-1fb2236858d4 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:52.815163 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-ee51069e-3980-4962-8b5a-50fac612d629 None None] MFA Rules not processed for user `d26e7b888a914f93a69b179f9e7ad14e`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:52.816114 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-ee51069e-3980-4962-8b5a-50fac612d629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:52.823718 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5abad-d2b9-437a-9524-66c9c022d73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:52.825845 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5abad-d2b9-437a-9524-66c9c022d73d admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:52.826142 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5abad-d2b9-437a-9524-66c9c022d73d admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:52.827649 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5abad-d2b9-437a-9524-66c9c022d73d admin admin] PATH_INFO: `/v3/projects/12e7a40c685546ce808695b7102bdc4f/users/954edac64da64fb5adbb812a8ba5c397/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:52.836520 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5abad-d2b9-437a-9524-66c9c022d73d admin admin] RBAC: Authorizing `identity:create_grant(project_id=12e7a40c685546ce808695b7102bdc4f, user_id=954edac64da64fb5adbb812a8ba5c397, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:52.862382 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5abad-d2b9-437a-9524-66c9c022d73d admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:52.881555 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:52.899357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 855/1702] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:50:52 2022] PUT /identity/v3/projects/12e7a40c685546ce808695b7102bdc4f/users/954edac64da64fb5adbb812a8ba5c397/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:50:52.911678 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285cef1-5a5f-46e6-a755-b91ec16251b4 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:52.912327 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285cef1-5a5f-46e6-a755-b91ec16251b4 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:52.914603 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285cef1-5a5f-46e6-a755-b91ec16251b4 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:52.916647 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 856/1703] 10.222.0.70 () {54 vars in 961 bytes} [Mon Aug 8 17:50:52 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:50:52.918099 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ba4ab-b07a-4124-be3a-9687b99d00c6 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:52.922114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ba4ab-b07a-4124-be3a-9687b99d00c6 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:52.922114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ba4ab-b07a-4124-be3a-9687b99d00c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:52.942388 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 848/1704] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:52.943761 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f151ad0-8159-49a9-8c00-1cc3d537bbb9 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:52.944166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f151ad0-8159-49a9-8c00-1cc3d537bbb9 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:52.944484 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f151ad0-8159-49a9-8c00-1cc3d537bbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:52.970816 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-b14ba4ab-b07a-4124-be3a-9687b99d00c6 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:52.975697 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-b14ba4ab-b07a-4124-be3a-9687b99d00c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:52.993111 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-1f151ad0-8159-49a9-8c00-1cc3d537bbb9 None None] MFA Rules not processed for user `954edac64da64fb5adbb812a8ba5c397`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:52.999272 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-1f151ad0-8159-49a9-8c00-1cc3d537bbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:53.129627 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 857/1705] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:53.131865 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b472d-4d66-4804-b99c-cef73e2fd52f None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:53.132205 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b472d-4d66-4804-b99c-cef73e2fd52f None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:53.132477 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b472d-4d66-4804-b99c-cef73e2fd52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:53.143421 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 849/1706] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:52 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:53.145317 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd2b50-4d96-4867-857d-8c28eff63c7c None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:53.145478 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd2b50-4d96-4867-857d-8c28eff63c7c None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:53.147993 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd2b50-4d96-4867-857d-8c28eff63c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:53.165514 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-601b472d-4d66-4804-b99c-cef73e2fd52f None None] MFA Rules not processed for user `68717c19e74e434da825d9b1d6ca202a`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:53.170011 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-601b472d-4d66-4804-b99c-cef73e2fd52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:53.201939 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-76dd2b50-4d96-4867-857d-8c28eff63c7c None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:53.203342 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-76dd2b50-4d96-4867-857d-8c28eff63c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:53.234072 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 850/1707] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:53.234072 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd2b50-4d96-4867-857d-8c28eff63c7c None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:53.242109 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-76dd2b50-4d96-4867-857d-8c28eff63c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:53.340040 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 858/1708] 10.222.0.70 () {58 vars in 1058 bytes} [Mon Aug 8 17:50:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:53.341636 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b472d-4d66-4804-b99c-cef73e2fd52f None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:53.353337 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b472d-4d66-4804-b99c-cef73e2fd52f None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:53.359531 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c5fdf-b682-41e5-858c-3db1a6c3b355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:53.360815 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c5fdf-b682-41e5-858c-3db1a6c3b355 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:53.360815 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c5fdf-b682-41e5-858c-3db1a6c3b355 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:53.361415 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c5fdf-b682-41e5-858c-3db1a6c3b355 admin admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:53.362281 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c5fdf-b682-41e5-858c-3db1a6c3b355 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:50:53.362730 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c5fdf-b682-41e5-858c-3db1a6c3b355 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:53.364705 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c5fdf-b682-41e5-858c-3db1a6c3b355 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:53.368812 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd2b50-4d96-4867-857d-8c28eff63c7c None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:53.373123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5f54b-eb08-4432-b616-f34fba64907e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:53.373784 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5f54b-eb08-4432-b616-f34fba64907e service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:53.374818 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5f54b-eb08-4432-b616-f34fba64907e service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:53.374818 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5f54b-eb08-4432-b616-f34fba64907e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:53.401164 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 859/1709] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:50:53.401164 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c5fdf-b682-41e5-858c-3db1a6c3b355 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:53.402560 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5f54b-eb08-4432-b616-f34fba64907e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:53.404088 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5f54b-eb08-4432-b616-f34fba64907e service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:53.414447 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c5fdf-b682-41e5-858c-3db1a6c3b355 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:53.423176 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f089450-5c31-4bab-a528-8e77c82edb1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68717c19e74e434da825d9b1d6ca202a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:53.434879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f089450-5c31-4bab-a528-8e77c82edb1c service placement] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:53.436288 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 851/1710] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:50:53 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:50:53.437180 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f089450-5c31-4bab-a528-8e77c82edb1c service placement] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:53.437614 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5f54b-eb08-4432-b616-f34fba64907e service cinder] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:53.437884 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f089450-5c31-4bab-a528-8e77c82edb1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:53.444536 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-6f089450-5c31-4bab-a528-8e77c82edb1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:53.460510 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f089450-5c31-4bab-a528-8e77c82edb1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:53.462263 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5f54b-eb08-4432-b616-f34fba64907e service cinder] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:53.464932 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f089450-5c31-4bab-a528-8e77c82edb1c service placement] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:53.475802 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b58e05-dece-4354-b1b9-e85189738a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:53.477103 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b58e05-dece-4354-b1b9-e85189738a26 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:53.478314 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b58e05-dece-4354-b1b9-e85189738a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:53.478772 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b58e05-dece-4354-b1b9-e85189738a26 admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:53.479753 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b58e05-dece-4354-b1b9-e85189738a26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:53.481884 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b58e05-dece-4354-b1b9-e85189738a26 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:53.483544 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:53.500451 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 860/1711] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:50:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:50:53.501382 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f089450-5c31-4bab-a528-8e77c82edb1c service placement] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:53.502817 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-6f089450-5c31-4bab-a528-8e77c82edb1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:53.525435 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f089450-5c31-4bab-a528-8e77c82edb1c service placement] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:53.531741 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26af05b-c436-40b5-b8e6-462bcc3e36fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:53.532581 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26af05b-c436-40b5-b8e6-462bcc3e36fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:53.535424 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26af05b-c436-40b5-b8e6-462bcc3e36fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:53.535719 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26af05b-c436-40b5-b8e6-462bcc3e36fe admin admin] PATH_INFO: `/v3/users/41b96be3a78246ab9e30dd61b5d1aa05` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:53.537313 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26af05b-c436-40b5-b8e6-462bcc3e36fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=41b96be3a78246ab9e30dd61b5d1aa05)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:53.540097 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26af05b-c436-40b5-b8e6-462bcc3e36fe admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:53.680826 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 852/1712] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:50:53 2022] POST /identity/v3/projects => generated 389 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:50:53.688806 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b58e05-dece-4354-b1b9-e85189738a26 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:53.835805 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-d26af05b-c436-40b5-b8e6-462bcc3e36fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41b96be3a78246ab9e30dd61b5d1aa05'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:53.892963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b58e05-dece-4354-b1b9-e85189738a26 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:53.918164 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-d26af05b-c436-40b5-b8e6-462bcc3e36fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41b96be3a78246ab9e30dd61b5d1aa05'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:53.918164 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-d26af05b-c436-40b5-b8e6-462bcc3e36fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41b96be3a78246ab9e30dd61b5d1aa05'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:53.918505 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-d26af05b-c436-40b5-b8e6-462bcc3e36fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41b96be3a78246ab9e30dd61b5d1aa05'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:53.940357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-d26af05b-c436-40b5-b8e6-462bcc3e36fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41b96be3a78246ab9e30dd61b5d1aa05'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:53.953570 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1774f-e066-45c1-a2d0-a8df856a6b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:53.953570 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1774f-e066-45c1-a2d0-a8df856a6b73 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:53.953570 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1774f-e066-45c1-a2d0-a8df856a6b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:53.953570 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1774f-e066-45c1-a2d0-a8df856a6b73 admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:53.953874 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1774f-e066-45c1-a2d0-a8df856a6b73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:53.958541 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1774f-e066-45c1-a2d0-a8df856a6b73 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:54.018826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 861/1713] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:50:53 2022] DELETE /identity/v3/users/41b96be3a78246ab9e30dd61b5d1aa05 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:50:54.020715 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26af05b-c436-40b5-b8e6-462bcc3e36fe admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:54.030994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-d26af05b-c436-40b5-b8e6-462bcc3e36fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:54.082619 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 853/1714] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:50:53 2022] POST /identity/v3/users => generated 295 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:50:54.082619 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a776c-03a2-4d55-896e-ade75e2e2d65 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:54.082619 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a776c-03a2-4d55-896e-ade75e2e2d65 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:54.082619 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a776c-03a2-4d55-896e-ade75e2e2d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:54.134564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-173a776c-03a2-4d55-896e-ade75e2e2d65 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:54.150677 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-173a776c-03a2-4d55-896e-ade75e2e2d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:54.227964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26af05b-c436-40b5-b8e6-462bcc3e36fe admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:54.250989 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffcd078-efe5-4055-a698-6949dd6f156b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:54.250989 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffcd078-efe5-4055-a698-6949dd6f156b service cinder] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:54.250989 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffcd078-efe5-4055-a698-6949dd6f156b service cinder] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:54.250989 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffcd078-efe5-4055-a698-6949dd6f156b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:54.251333 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-fffcd078-efe5-4055-a698-6949dd6f156b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:54.280171 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 854/1715] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:54.281196 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a776c-03a2-4d55-896e-ade75e2e2d65 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:54.282504 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-173a776c-03a2-4d55-896e-ade75e2e2d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:54.298530 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a776c-03a2-4d55-896e-ade75e2e2d65 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:54.305016 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:54.313160 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5762f2-790d-4eb3-9aea-fe9ff04ff660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:54.313797 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5762f2-790d-4eb3-9aea-fe9ff04ff660 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:54.314077 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5762f2-790d-4eb3-9aea-fe9ff04ff660 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:54.314358 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5762f2-790d-4eb3-9aea-fe9ff04ff660 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:54.315067 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5762f2-790d-4eb3-9aea-fe9ff04ff660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:54.316695 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5762f2-790d-4eb3-9aea-fe9ff04ff660 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:54.350178 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 855/1716] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:50:54.352013 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5762f2-790d-4eb3-9aea-fe9ff04ff660 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:54.354357 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-ee5762f2-790d-4eb3-9aea-fe9ff04ff660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:54.433353 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffcd078-efe5-4055-a698-6949dd6f156b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:54.436685 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffcd078-efe5-4055-a698-6949dd6f156b service cinder] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:54.462567 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 862/1717] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:50:54 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:50:54.462567 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffcd078-efe5-4055-a698-6949dd6f156b service cinder] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:54.490946 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffcd078-efe5-4055-a698-6949dd6f156b service cinder] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:54.518823 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b87fe4-bd1b-49ce-8f0b-d5028d1fb44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:54.519510 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b87fe4-bd1b-49ce-8f0b-d5028d1fb44c admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:54.519877 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b87fe4-bd1b-49ce-8f0b-d5028d1fb44c admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:54.519999 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5762f2-790d-4eb3-9aea-fe9ff04ff660 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:54.520378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b87fe4-bd1b-49ce-8f0b-d5028d1fb44c admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:54.520646 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b87fe4-bd1b-49ce-8f0b-d5028d1fb44c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:54.522293 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b87fe4-bd1b-49ce-8f0b-d5028d1fb44c admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:54.529282 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9708cf-233d-436b-897f-4933e87a424c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:54.529915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9708cf-233d-436b-897f-4933e87a424c service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:54.530188 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9708cf-233d-436b-897f-4933e87a424c service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:54.530455 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9708cf-233d-436b-897f-4933e87a424c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:54.556725 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 863/1718] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:50:54.558267 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b87fe4-bd1b-49ce-8f0b-d5028d1fb44c admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:54.560594 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9708cf-233d-436b-897f-4933e87a424c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:54.562136 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9708cf-233d-436b-897f-4933e87a424c service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:54.579460 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 856/1719] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:50:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:50:54.592868 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b87fe4-bd1b-49ce-8f0b-d5028d1fb44c admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:54.598542 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a77c3-6413-4dae-9e17-13f36bf2db78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:54.599196 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a77c3-6413-4dae-9e17-13f36bf2db78 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:54.599492 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a77c3-6413-4dae-9e17-13f36bf2db78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:54.600654 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a77c3-6413-4dae-9e17-13f36bf2db78 admin admin] PATH_INFO: `/v3/projects/41151233a55646078581edf0513a98fb/users/322329404c8942e69ffec9cf1efaf1d9/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:54.647316 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a77c3-6413-4dae-9e17-13f36bf2db78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41151233a55646078581edf0513a98fb, user_id=322329404c8942e69ffec9cf1efaf1d9, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:54.653284 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a77c3-6413-4dae-9e17-13f36bf2db78 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:54.654635 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:54.759615 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 864/1720] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:50:54 2022] PUT /identity/v3/projects/41151233a55646078581edf0513a98fb/users/322329404c8942e69ffec9cf1efaf1d9/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:50:54.761563 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7abdca-92de-453d-9082-7513cb5bec5d None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:54.762080 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7abdca-92de-453d-9082-7513cb5bec5d None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:54.762543 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7abdca-92de-453d-9082-7513cb5bec5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:54.831211 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-1a7abdca-92de-453d-9082-7513cb5bec5d None None] MFA Rules not processed for user `322329404c8942e69ffec9cf1efaf1d9`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:54.832724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-1a7abdca-92de-453d-9082-7513cb5bec5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:55.051572 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:55.074969 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a77c3-6413-4dae-9e17-13f36bf2db78 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:55.078425 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 857/1721] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:50:55.175443 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a77c3-6413-4dae-9e17-13f36bf2db78 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:55.184260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f8ff5-3caa-4908-808f-d46bf9bb812c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:55.185145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f8ff5-3caa-4908-808f-d46bf9bb812c admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:55.185595 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f8ff5-3caa-4908-808f-d46bf9bb812c admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:55.186831 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f8ff5-3caa-4908-808f-d46bf9bb812c admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:55.188222 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f8ff5-3caa-4908-808f-d46bf9bb812c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:55.191964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f8ff5-3caa-4908-808f-d46bf9bb812c admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:55.366169 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7abdca-92de-453d-9082-7513cb5bec5d None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:55.373596 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 865/1722] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:50:55 2022] POST /identity/v3/projects => generated 387 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:50:55.380241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7abdca-92de-453d-9082-7513cb5bec5d None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:55.503398 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:55.607923 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d68c9f-207e-4634-8e08-345fd9042eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:55.608560 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d68c9f-207e-4634-8e08-345fd9042eb2 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:55.608825 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d68c9f-207e-4634-8e08-345fd9042eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:55.609223 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d68c9f-207e-4634-8e08-345fd9042eb2 admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:55.620918 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d68c9f-207e-4634-8e08-345fd9042eb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:55.622526 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d68c9f-207e-4634-8e08-345fd9042eb2 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:55.803742 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 858/1723] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:50:55 2022] POST /identity/v3/users => generated 300 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:50:55.807322 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f8ff5-3caa-4908-808f-d46bf9bb812c admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:55.834710 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f8ff5-3caa-4908-808f-d46bf9bb812c admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:55.845235 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ed6ea-d08c-4b55-b074-2a9ac2fb7dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:55.845873 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ed6ea-d08c-4b55-b074-2a9ac2fb7dae admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:55.846707 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ed6ea-d08c-4b55-b074-2a9ac2fb7dae admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:55.846970 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ed6ea-d08c-4b55-b074-2a9ac2fb7dae admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:55.847628 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ed6ea-d08c-4b55-b074-2a9ac2fb7dae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:55.854868 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ed6ea-d08c-4b55-b074-2a9ac2fb7dae admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:55.902469 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d68c9f-207e-4634-8e08-345fd9042eb2 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:55.903246 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 866/1724] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:50:55.926696 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d68c9f-207e-4634-8e08-345fd9042eb2 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:55.929090 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d53d94-af1f-4039-8ead-bb68e9057be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:55.930983 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d53d94-af1f-4039-8ead-bb68e9057be1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:55.931430 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d53d94-af1f-4039-8ead-bb68e9057be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:55.931980 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d53d94-af1f-4039-8ead-bb68e9057be1 admin admin] PATH_INFO: `/v3/projects/fdaa5249885147579123fa3afffc0775/users/422b12b73bf14e10a59bc67ce6347acc/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:55.970607 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d53d94-af1f-4039-8ead-bb68e9057be1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdaa5249885147579123fa3afffc0775, user_id=422b12b73bf14e10a59bc67ce6347acc, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:55.974597 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d53d94-af1f-4039-8ead-bb68e9057be1 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:56.120738 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 859/1725] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:50:55 2022] PUT /identity/v3/projects/fdaa5249885147579123fa3afffc0775/users/422b12b73bf14e10a59bc67ce6347acc/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:50:56.124865 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ed6ea-d08c-4b55-b074-2a9ac2fb7dae admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:56.155378 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d53d94-af1f-4039-8ead-bb68e9057be1 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:56.157915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-d3d53d94-af1f-4039-8ead-bb68e9057be1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:56.161575 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ed6ea-d08c-4b55-b074-2a9ac2fb7dae admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:56.306380 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c9ae3-204b-4292-833b-c0f4385ad71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:56.308928 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c9ae3-204b-4292-833b-c0f4385ad71f admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:56.310082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c9ae3-204b-4292-833b-c0f4385ad71f admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:56.311195 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c9ae3-204b-4292-833b-c0f4385ad71f admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:56.313149 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c9ae3-204b-4292-833b-c0f4385ad71f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:56.316184 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c9ae3-204b-4292-833b-c0f4385ad71f admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:56.338168 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 867/1726] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:50:56.338764 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c9ae3-204b-4292-833b-c0f4385ad71f admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:56.364466 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c9ae3-204b-4292-833b-c0f4385ad71f admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:56.372398 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06919034-acd3-4bd0-bcaa-e7b8be391974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:56.373554 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06919034-acd3-4bd0-bcaa-e7b8be391974 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:56.374553 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06919034-acd3-4bd0-bcaa-e7b8be391974 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:56.375069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06919034-acd3-4bd0-bcaa-e7b8be391974 admin admin] PATH_INFO: `/v3/projects/fdaa5249885147579123fa3afffc0775/users/422b12b73bf14e10a59bc67ce6347acc/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:56.377630 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06919034-acd3-4bd0-bcaa-e7b8be391974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdaa5249885147579123fa3afffc0775, user_id=422b12b73bf14e10a59bc67ce6347acc, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:56.380757 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06919034-acd3-4bd0-bcaa-e7b8be391974 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:56.414475 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 868/1727] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:50:56 2022] PUT /identity/v3/projects/fdaa5249885147579123fa3afffc0775/users/422b12b73bf14e10a59bc67ce6347acc/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:50:56.418756 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca6a99-b134-4280-8eef-34daa71bb03d None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:56.419260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca6a99-b134-4280-8eef-34daa71bb03d None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:56.419737 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca6a99-b134-4280-8eef-34daa71bb03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:56.429706 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d53d94-af1f-4039-8ead-bb68e9057be1 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:56.482180 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-beca6a99-b134-4280-8eef-34daa71bb03d None None] MFA Rules not processed for user `422b12b73bf14e10a59bc67ce6347acc`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:56.498320 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-beca6a99-b134-4280-8eef-34daa71bb03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:56.524513 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a576653-45c8-44df-aca9-e59631e17625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:56.525443 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a576653-45c8-44df-aca9-e59631e17625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:56.525880 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a576653-45c8-44df-aca9-e59631e17625 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:56.526308 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a576653-45c8-44df-aca9-e59631e17625 admin admin] PATH_INFO: `/v3/projects/c1f700986d774a7eb00651edc0e50036` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:56.528238 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a576653-45c8-44df-aca9-e59631e17625 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1f700986d774a7eb00651edc0e50036)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:56.530664 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a576653-45c8-44df-aca9-e59631e17625 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:56.657924 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 869/1728] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:56 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:56.659601 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1a576653-45c8-44df-aca9-e59631e17625 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1f700986d774a7eb00651edc0e50036', 'request_id': 'req-1a576653-45c8-44df-aca9-e59631e17625'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:56.666499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca6a99-b134-4280-8eef-34daa71bb03d None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:56.668748 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-beca6a99-b134-4280-8eef-34daa71bb03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:56.685951 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1a576653-45c8-44df-aca9-e59631e17625 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1f700986d774a7eb00651edc0e50036', 'request_id': 'req-1a576653-45c8-44df-aca9-e59631e17625'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:56.737644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca6a99-b134-4280-8eef-34daa71bb03d None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:56.793915 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32be1e-b90c-4aa5-975f-96b0301b0dc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:56.794536 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32be1e-b90c-4aa5-975f-96b0301b0dc5 service cinder] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:56.794814 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32be1e-b90c-4aa5-975f-96b0301b0dc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:56.795083 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32be1e-b90c-4aa5-975f-96b0301b0dc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:56.807075 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1a576653-45c8-44df-aca9-e59631e17625 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1f700986d774a7eb00651edc0e50036', 'request_id': 'req-1a576653-45c8-44df-aca9-e59631e17625'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:56.858204 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1a576653-45c8-44df-aca9-e59631e17625 admin admin] The token cache is being invalidate because project c1f700986d774a7eb00651edc0e50036 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:50:56.858521 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1a576653-45c8-44df-aca9-e59631e17625 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:56.862074 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1a576653-45c8-44df-aca9-e59631e17625 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:56.867990 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 860/1729] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:50:56 2022] DELETE /identity/v3/projects/c1f700986d774a7eb00651edc0e50036 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:50:56.871886 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a576653-45c8-44df-aca9-e59631e17625 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:56.893707 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-1a576653-45c8-44df-aca9-e59631e17625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:57.047925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32be1e-b90c-4aa5-975f-96b0301b0dc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:57.051382 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32be1e-b90c-4aa5-975f-96b0301b0dc5 service cinder] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:57.074350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a576653-45c8-44df-aca9-e59631e17625 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:57.075958 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 870/1730] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:50:56 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:50:57.077359 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1df97b-7a63-4838-88dd-ac16eb5b3ce7 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:57.077652 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1df97b-7a63-4838-88dd-ac16eb5b3ce7 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:57.077929 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1df97b-7a63-4838-88dd-ac16eb5b3ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:57.122109 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b123d-d816-4483-827e-296c552a9375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:57.127132 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b123d-d816-4483-827e-296c552a9375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:57.127630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b123d-d816-4483-827e-296c552a9375 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:57.129113 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b123d-d816-4483-827e-296c552a9375 admin admin] PATH_INFO: `/v3/users/d65337393e804e1d8432a15d5b0ce57a` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:57.130945 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-af1df97b-7a63-4838-88dd-ac16eb5b3ce7 None None] MFA Rules not processed for user `7d84d1d6d0ab469f905d01d8a1276dec`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:57.133083 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-af1df97b-7a63-4838-88dd-ac16eb5b3ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:57.138848 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b123d-d816-4483-827e-296c552a9375 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d65337393e804e1d8432a15d5b0ce57a)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:57.143923 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b123d-d816-4483-827e-296c552a9375 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:57.287870 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 871/1731] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:57.327805 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1df97b-7a63-4838-88dd-ac16eb5b3ce7 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:57.332984 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-af1df97b-7a63-4838-88dd-ac16eb5b3ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:57.365005 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1df97b-7a63-4838-88dd-ac16eb5b3ce7 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:57.371963 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40808b7f-fbf6-4284-b2d8-26e8ce4420d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:57.372610 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40808b7f-fbf6-4284-b2d8-26e8ce4420d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:57.372888 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40808b7f-fbf6-4284-b2d8-26e8ce4420d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:57.373198 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40808b7f-fbf6-4284-b2d8-26e8ce4420d0 admin admin] PATH_INFO: `/v3/users/322329404c8942e69ffec9cf1efaf1d9` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:57.374341 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40808b7f-fbf6-4284-b2d8-26e8ce4420d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=322329404c8942e69ffec9cf1efaf1d9)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:57.377516 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40808b7f-fbf6-4284-b2d8-26e8ce4420d0 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:57.426601 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-360b123d-d816-4483-827e-296c552a9375 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd65337393e804e1d8432a15d5b0ce57a'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:57.524266 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-360b123d-d816-4483-827e-296c552a9375 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd65337393e804e1d8432a15d5b0ce57a'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:57.524266 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-360b123d-d816-4483-827e-296c552a9375 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd65337393e804e1d8432a15d5b0ce57a'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:57.524266 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-360b123d-d816-4483-827e-296c552a9375 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd65337393e804e1d8432a15d5b0ce57a'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:57.543115 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-360b123d-d816-4483-827e-296c552a9375 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd65337393e804e1d8432a15d5b0ce57a'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:57.562621 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:57.591641 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 861/1732] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:50:56 2022] DELETE /identity/v3/users/d65337393e804e1d8432a15d5b0ce57a => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:50:57.692096 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-40808b7f-fbf6-4284-b2d8-26e8ce4420d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '322329404c8942e69ffec9cf1efaf1d9'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:57.807537 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e29fb-9ff7-4dd6-9191-ff909ffa4f8f None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:57.808414 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e29fb-9ff7-4dd6-9191-ff909ffa4f8f None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:57.809229 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e29fb-9ff7-4dd6-9191-ff909ffa4f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:57.826688 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-40808b7f-fbf6-4284-b2d8-26e8ce4420d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '322329404c8942e69ffec9cf1efaf1d9'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:57.827611 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-40808b7f-fbf6-4284-b2d8-26e8ce4420d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '322329404c8942e69ffec9cf1efaf1d9'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:57.828510 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-40808b7f-fbf6-4284-b2d8-26e8ce4420d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '322329404c8942e69ffec9cf1efaf1d9'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:57.847055 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-40808b7f-fbf6-4284-b2d8-26e8ce4420d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '322329404c8942e69ffec9cf1efaf1d9'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:57.855295 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-c09e29fb-9ff7-4dd6-9191-ff909ffa4f8f None None] MFA Rules not processed for user `56427a32e1044299a1098c911849e601`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:57.859402 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-c09e29fb-9ff7-4dd6-9191-ff909ffa4f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:57.894436 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 872/1733] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:50:57 2022] DELETE /identity/v3/users/322329404c8942e69ffec9cf1efaf1d9 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:50:57.900131 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee12c5-da7a-47af-9474-126f24c00308 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:57.900423 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee12c5-da7a-47af-9474-126f24c00308 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:57.900701 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee12c5-da7a-47af-9474-126f24c00308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:57.942138 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-18ee12c5-da7a-47af-9474-126f24c00308 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:57.950121 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-18ee12c5-da7a-47af-9474-126f24c00308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:57.989134 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 862/1734] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:58.085989 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 873/1735] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:58.181748 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e29fb-9ff7-4dd6-9191-ff909ffa4f8f None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:58.183205 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-c09e29fb-9ff7-4dd6-9191-ff909ffa4f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:58.191191 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:58.271087 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e29fb-9ff7-4dd6-9191-ff909ffa4f8f None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:58.366226 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79a073-e10d-419a-b9c0-258936806fc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:58.368196 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79a073-e10d-419a-b9c0-258936806fc6 service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:58.368580 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79a073-e10d-419a-b9c0-258936806fc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:58.368921 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79a073-e10d-419a-b9c0-258936806fc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:58.380666 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79a073-e10d-419a-b9c0-258936806fc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:58.383037 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79a073-e10d-419a-b9c0-258936806fc6 service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:58.395566 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 863/1736] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:50:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:50:58.881621 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee12c5-da7a-47af-9474-126f24c00308 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:58.884347 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-18ee12c5-da7a-47af-9474-126f24c00308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:58.909666 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60467347-3e84-4e88-8989-faf1b02f83ce None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:58.910212 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60467347-3e84-4e88-8989-faf1b02f83ce None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:58.910447 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60467347-3e84-4e88-8989-faf1b02f83ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:58.935480 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee12c5-da7a-47af-9474-126f24c00308 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:58.967038 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed7c13-961e-46b4-981d-f748591dc902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:58.967825 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed7c13-961e-46b4-981d-f748591dc902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:58.971152 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed7c13-961e-46b4-981d-f748591dc902 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:58.971829 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed7c13-961e-46b4-981d-f748591dc902 admin admin] PATH_INFO: `/v3/projects/c2d01d2c4a324e289fac9fb7e791b8ce` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:58.979828 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed7c13-961e-46b4-981d-f748591dc902 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2d01d2c4a324e289fac9fb7e791b8ce)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:58.984981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed7c13-961e-46b4-981d-f748591dc902 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:59.153329 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-60467347-3e84-4e88-8989-faf1b02f83ce None None] MFA Rules not processed for user `c880ab908c114c5897d11aad7fb48607`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:59.157314 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-60467347-3e84-4e88-8989-faf1b02f83ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:59.183793 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:50:59.261549 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-13ed7c13-961e-46b4-981d-f748591dc902 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2d01d2c4a324e289fac9fb7e791b8ce', 'request_id': 'req-13ed7c13-961e-46b4-981d-f748591dc902'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:59.297166 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-13ed7c13-961e-46b4-981d-f748591dc902 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2d01d2c4a324e289fac9fb7e791b8ce', 'request_id': 'req-13ed7c13-961e-46b4-981d-f748591dc902'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:59.362373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 864/1737] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Aug 8 17:50:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:50:59.424737 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-13ed7c13-961e-46b4-981d-f748591dc902 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2d01d2c4a324e289fac9fb7e791b8ce', 'request_id': 'req-13ed7c13-961e-46b4-981d-f748591dc902'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:59.440790 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-13ed7c13-961e-46b4-981d-f748591dc902 admin admin] The token cache is being invalidate because project c2d01d2c4a324e289fac9fb7e791b8ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:50:59.441314 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-13ed7c13-961e-46b4-981d-f748591dc902 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:59.442360 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-13ed7c13-961e-46b4-981d-f748591dc902 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:50:59.445582 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 874/1738] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:50:58 2022] DELETE /identity/v3/projects/c2d01d2c4a324e289fac9fb7e791b8ce => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:50:59.451218 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74681499-f5dc-4510-86a2-b344ba156971 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:59.452029 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74681499-f5dc-4510-86a2-b344ba156971 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:59.452317 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74681499-f5dc-4510-86a2-b344ba156971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:59.496723 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-74681499-f5dc-4510-86a2-b344ba156971 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:59.498642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-74681499-f5dc-4510-86a2-b344ba156971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:59.533664 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30ade3-c59b-4ce5-866a-3dd1505570f5 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:59.540098 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30ade3-c59b-4ce5-866a-3dd1505570f5 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:59.540098 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30ade3-c59b-4ce5-866a-3dd1505570f5 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:59.540098 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 875/1739] 10.222.0.70 () {54 vars in 912 bytes} [Mon Aug 8 17:50:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:50:59.543757 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60a6ea-2665-4afa-bd07-35c9119a4fd1 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:59.543954 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60a6ea-2665-4afa-bd07-35c9119a4fd1 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:59.547255 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60a6ea-2665-4afa-bd07-35c9119a4fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:59.591918 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 865/1740] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:59.597662 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-1c60a6ea-2665-4afa-bd07-35c9119a4fd1 None None] MFA Rules not processed for user `bdb6f0f0cde24b05a34b78d48dc45c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:59.599265 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-1c60a6ea-2665-4afa-bd07-35c9119a4fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:59.600523 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f96532-42f6-442a-8c8e-bc5d6c7231fb None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:59.600803 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f96532-42f6-442a-8c8e-bc5d6c7231fb None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:59.601639 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f96532-42f6-442a-8c8e-bc5d6c7231fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:59.629577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-44f96532-42f6-442a-8c8e-bc5d6c7231fb None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:50:59.631063 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-44f96532-42f6-442a-8c8e-bc5d6c7231fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:59.645493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 866/1741] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:59.650694 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f96532-42f6-442a-8c8e-bc5d6c7231fb None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:59.661711 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f96532-42f6-442a-8c8e-bc5d6c7231fb None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:59.669084 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bd717-3537-4033-868d-ab7b51a6a6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:59.669997 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bd717-3537-4033-868d-ab7b51a6a6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:59.670374 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bd717-3537-4033-868d-ab7b51a6a6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:59.670993 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bd717-3537-4033-868d-ab7b51a6a6f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:59.671835 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699bd717-3537-4033-868d-ab7b51a6a6f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:50:59.672400 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699bd717-3537-4033-868d-ab7b51a6a6f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:59.674352 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699bd717-3537-4033-868d-ab7b51a6a6f7 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:59.695150 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 867/1742] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:50:59.696772 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bd717-3537-4033-868d-ab7b51a6a6f7 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:59.709682 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bd717-3537-4033-868d-ab7b51a6a6f7 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:59.733340 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0491e939-14b5-419f-9c5e-8428da9e68a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:59.733340 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491e939-14b5-419f-9c5e-8428da9e68a9 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:59.733340 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491e939-14b5-419f-9c5e-8428da9e68a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:59.733340 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491e939-14b5-419f-9c5e-8428da9e68a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:59.733969 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0491e939-14b5-419f-9c5e-8428da9e68a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:59.733969 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0491e939-14b5-419f-9c5e-8428da9e68a9 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:50:59.747977 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 876/1743] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Aug 8 17:50:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:50:59.815460 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60a6ea-2665-4afa-bd07-35c9119a4fd1 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:59.817696 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-1c60a6ea-2665-4afa-bd07-35c9119a4fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:50:59.866724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 868/1744] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:50:59 2022] POST /identity/v3/projects => generated 367 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:50:59.873627 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0491e939-14b5-419f-9c5e-8428da9e68a9 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:50:59.973814 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0491e939-14b5-419f-9c5e-8428da9e68a9 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:50:59.973814 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc27b23-4625-4ea3-a2b9-0b3289b1a0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:50:59.983092 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc27b23-4625-4ea3-a2b9-0b3289b1a0db admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:50:59.983092 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc27b23-4625-4ea3-a2b9-0b3289b1a0db admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:50:59.983285 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc27b23-4625-4ea3-a2b9-0b3289b1a0db admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:50:59.987478 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc27b23-4625-4ea3-a2b9-0b3289b1a0db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:50:59.995913 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc27b23-4625-4ea3-a2b9-0b3289b1a0db admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:00.103269 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60a6ea-2665-4afa-bd07-35c9119a4fd1 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:00.167800 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 869/1745] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:50:59 2022] POST /identity/v3/users => generated 284 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:00.171153 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc27b23-4625-4ea3-a2b9-0b3289b1a0db admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:00.180764 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-3cc27b23-4625-4ea3-a2b9-0b3289b1a0db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:00.300175 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:00.372787 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc27b23-4625-4ea3-a2b9-0b3289b1a0db admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:00.377013 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2a1c3-dbed-4637-be1b-986f230a1850 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b83ff95ed44f35af2e412a700ca567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:00.377678 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2a1c3-dbed-4637-be1b-986f230a1850 service swift] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:00.377967 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2a1c3-dbed-4637-be1b-986f230a1850 service swift] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:00.378248 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2a1c3-dbed-4637-be1b-986f230a1850 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:00.380530 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-89a2a1c3-dbed-4637-be1b-986f230a1850 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:00.380832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115b14e-cd8a-49e6-96ea-d63efe716b4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:00.381529 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115b14e-cd8a-49e6-96ea-d63efe716b4f service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:00.381864 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115b14e-cd8a-49e6-96ea-d63efe716b4f service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:00.382145 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115b14e-cd8a-49e6-96ea-d63efe716b4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:00.403804 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8115b14e-cd8a-49e6-96ea-d63efe716b4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:00.405407 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8115b14e-cd8a-49e6-96ea-d63efe716b4f service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:00.447505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 870/1746] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:51:00.448622 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115b14e-cd8a-49e6-96ea-d63efe716b4f service neutron] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:00.494483 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115b14e-cd8a-49e6-96ea-d63efe716b4f service neutron] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:00.516346 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c724b-1459-463b-9a77-26635391ef7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:00.516346 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c724b-1459-463b-9a77-26635391ef7a admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:00.519199 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c724b-1459-463b-9a77-26635391ef7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:00.523184 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c724b-1459-463b-9a77-26635391ef7a admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:00.523184 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c724b-1459-463b-9a77-26635391ef7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:00.533835 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c724b-1459-463b-9a77-26635391ef7a admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:00.563861 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 871/1747] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:51:00.569023 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c724b-1459-463b-9a77-26635391ef7a admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:00.575054 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-a16c724b-1459-463b-9a77-26635391ef7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:00.592452 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2a1c3-dbed-4637-be1b-986f230a1850 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:00.594664 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2a1c3-dbed-4637-be1b-986f230a1850 service swift] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:00.604211 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c724b-1459-463b-9a77-26635391ef7a admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:00.643230 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 877/1748] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Aug 8 17:50:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 829 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 08 17:51:00.644245 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2a1c3-dbed-4637-be1b-986f230a1850 service swift] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:00.646966 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95a88c-d4b3-4e29-b94e-292d4c492d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:00.647613 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95a88c-d4b3-4e29-b94e-292d4c492d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:00.647890 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95a88c-d4b3-4e29-b94e-292d4c492d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:00.648209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95a88c-d4b3-4e29-b94e-292d4c492d99 admin admin] PATH_INFO: `/v3/projects/41151233a55646078581edf0513a98fb` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:00.654895 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95a88c-d4b3-4e29-b94e-292d4c492d99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41151233a55646078581edf0513a98fb)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:00.657234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95a88c-d4b3-4e29-b94e-292d4c492d99 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:00.710103 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2a1c3-dbed-4637-be1b-986f230a1850 service swift] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:00.727677 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555deee-f0ea-4b66-bff9-02ff948e2300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:00.729365 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555deee-f0ea-4b66-bff9-02ff948e2300 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:00.731008 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555deee-f0ea-4b66-bff9-02ff948e2300 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:00.733338 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555deee-f0ea-4b66-bff9-02ff948e2300 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:00.736226 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555deee-f0ea-4b66-bff9-02ff948e2300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:00.738496 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555deee-f0ea-4b66-bff9-02ff948e2300 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:00.769533 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 878/1749] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:51:00.777001 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555deee-f0ea-4b66-bff9-02ff948e2300 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:00.814310 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555deee-f0ea-4b66-bff9-02ff948e2300 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:00.832005 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e6769-6855-4bc7-a0b3-a1d0933c6e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:00.832696 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e6769-6855-4bc7-a0b3-a1d0933c6e1e admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:00.832983 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e6769-6855-4bc7-a0b3-a1d0933c6e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:00.833329 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e6769-6855-4bc7-a0b3-a1d0933c6e1e admin admin] PATH_INFO: `/v3/projects/ea2a5ddad821434bbebe157f142f80ba/users/926bf93b7d214bb0a2c2ffdddc2f4323/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:00.912705 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e6769-6855-4bc7-a0b3-a1d0933c6e1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea2a5ddad821434bbebe157f142f80ba, user_id=926bf93b7d214bb0a2c2ffdddc2f4323, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:00.921850 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e6769-6855-4bc7-a0b3-a1d0933c6e1e admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:00.926334 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1d95a88c-d4b3-4e29-b94e-292d4c492d99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41151233a55646078581edf0513a98fb', 'request_id': 'req-1d95a88c-d4b3-4e29-b94e-292d4c492d99'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:00.953174 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1d95a88c-d4b3-4e29-b94e-292d4c492d99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41151233a55646078581edf0513a98fb', 'request_id': 'req-1d95a88c-d4b3-4e29-b94e-292d4c492d99'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:01.076429 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1d95a88c-d4b3-4e29-b94e-292d4c492d99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41151233a55646078581edf0513a98fb', 'request_id': 'req-1d95a88c-d4b3-4e29-b94e-292d4c492d99'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:01.098488 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1d95a88c-d4b3-4e29-b94e-292d4c492d99 admin admin] The token cache is being invalidate because project 41151233a55646078581edf0513a98fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:51:01.098964 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1d95a88c-d4b3-4e29-b94e-292d4c492d99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:01.109912 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1d95a88c-d4b3-4e29-b94e-292d4c492d99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:01.121121 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 879/1750] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:51:00 2022] PUT /identity/v3/projects/ea2a5ddad821434bbebe157f142f80ba/users/926bf93b7d214bb0a2c2ffdddc2f4323/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:51:01.121385 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 872/1751] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:51:00 2022] DELETE /identity/v3/projects/41151233a55646078581edf0513a98fb => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:01.121469 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8d525-4008-4622-9525-5939c47a3778 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:01.121469 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8d525-4008-4622-9525-5939c47a3778 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:01.121469 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8d525-4008-4622-9525-5939c47a3778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:01.124364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95a88c-d4b3-4e29-b94e-292d4c492d99 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:01.126175 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-1d95a88c-d4b3-4e29-b94e-292d4c492d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:01.298514 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-ddf8d525-4008-4622-9525-5939c47a3778 None None] MFA Rules not processed for user `926bf93b7d214bb0a2c2ffdddc2f4323`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:01.302179 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-ddf8d525-4008-4622-9525-5939c47a3778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:01.375323 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95a88c-d4b3-4e29-b94e-292d4c492d99 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:01.499999 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:01.552856 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 880/1752] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:01.579211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8d525-4008-4622-9525-5939c47a3778 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:01.580387 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-ddf8d525-4008-4622-9525-5939c47a3778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:01.652772 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d687ef9-c39d-4f12-be07-5f50d59ee2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:01.655520 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d687ef9-c39d-4f12-be07-5f50d59ee2d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:01.660328 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d687ef9-c39d-4f12-be07-5f50d59ee2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:01.660328 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d687ef9-c39d-4f12-be07-5f50d59ee2d8 admin admin] PATH_INFO: `/v3/users/422b12b73bf14e10a59bc67ce6347acc` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:01.661958 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d687ef9-c39d-4f12-be07-5f50d59ee2d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=422b12b73bf14e10a59bc67ce6347acc)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:01.666529 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d687ef9-c39d-4f12-be07-5f50d59ee2d8 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:01.819550 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8d525-4008-4622-9525-5939c47a3778 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:01.864832 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a36bd-a107-45de-a269-44fa9509dcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:01.865215 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a36bd-a107-45de-a269-44fa9509dcd1 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:01.865497 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a36bd-a107-45de-a269-44fa9509dcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:01.865771 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a36bd-a107-45de-a269-44fa9509dcd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:01.866420 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a36bd-a107-45de-a269-44fa9509dcd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:01.868437 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a36bd-a107-45de-a269-44fa9509dcd1 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:02.146202 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-3d687ef9-c39d-4f12-be07-5f50d59ee2d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '422b12b73bf14e10a59bc67ce6347acc'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:02.161077 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 881/1753] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:51:01 2022] POST /identity/v3/projects => generated 369 bytes in 604 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:02.163470 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a36bd-a107-45de-a269-44fa9509dcd1 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:02.170599 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-ce1a36bd-a107-45de-a269-44fa9509dcd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:02.225185 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-3d687ef9-c39d-4f12-be07-5f50d59ee2d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '422b12b73bf14e10a59bc67ce6347acc'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:02.226077 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-3d687ef9-c39d-4f12-be07-5f50d59ee2d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '422b12b73bf14e10a59bc67ce6347acc'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:02.227790 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-3d687ef9-c39d-4f12-be07-5f50d59ee2d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '422b12b73bf14e10a59bc67ce6347acc'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:02.235654 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-3d687ef9-c39d-4f12-be07-5f50d59ee2d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '422b12b73bf14e10a59bc67ce6347acc'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:02.287862 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 873/1754] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:51:01 2022] DELETE /identity/v3/users/422b12b73bf14e10a59bc67ce6347acc => generated 0 bytes in 1161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:51:02.291916 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d687ef9-c39d-4f12-be07-5f50d59ee2d8 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:02.303146 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-3d687ef9-c39d-4f12-be07-5f50d59ee2d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:02.387126 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a36bd-a107-45de-a269-44fa9509dcd1 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:02.437448 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d687ef9-c39d-4f12-be07-5f50d59ee2d8 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:02.443263 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc451e-5004-475b-b0db-fb0a9a9c3daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:02.444101 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc451e-5004-475b-b0db-fb0a9a9c3daf admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:02.444567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc451e-5004-475b-b0db-fb0a9a9c3daf admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:02.445124 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc451e-5004-475b-b0db-fb0a9a9c3daf admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:02.445918 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc451e-5004-475b-b0db-fb0a9a9c3daf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:02.448275 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc451e-5004-475b-b0db-fb0a9a9c3daf admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:02.558544 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecdb5ed-c20e-45c2-b3c1-a97b6d8e9149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:02.558544 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecdb5ed-c20e-45c2-b3c1-a97b6d8e9149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:02.558544 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecdb5ed-c20e-45c2-b3c1-a97b6d8e9149 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:02.559046 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecdb5ed-c20e-45c2-b3c1-a97b6d8e9149 admin admin] PATH_INFO: `/v3/users/fc30305a1a7d4326bf5981277016043e` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:02.559946 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecdb5ed-c20e-45c2-b3c1-a97b6d8e9149 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc30305a1a7d4326bf5981277016043e)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:02.563431 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecdb5ed-c20e-45c2-b3c1-a97b6d8e9149 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:02.643193 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:02.653740 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 874/1755] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:51:02 2022] POST /identity/v3/users => generated 291 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:02.659621 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce2fd2-d024-4e17-b18b-4b46ff9ab08d None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:02.659621 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce2fd2-d024-4e17-b18b-4b46ff9ab08d None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:02.659621 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce2fd2-d024-4e17-b18b-4b46ff9ab08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:02.695403 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-34ce2fd2-d024-4e17-b18b-4b46ff9ab08d None None] MFA Rules not processed for user `bdb6f0f0cde24b05a34b78d48dc45c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:02.695403 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-34ce2fd2-d024-4e17-b18b-4b46ff9ab08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:02.777886 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 875/1756] 10.222.0.75 () {58 vars in 1015 bytes} [Mon Aug 8 17:51:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:02.779011 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce2fd2-d024-4e17-b18b-4b46ff9ab08d None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:02.791755 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce2fd2-d024-4e17-b18b-4b46ff9ab08d None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:02.796904 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771c813-83c6-4a22-8e3f-3aa0a3609c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:02.803056 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771c813-83c6-4a22-8e3f-3aa0a3609c56 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:02.803056 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771c813-83c6-4a22-8e3f-3aa0a3609c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:02.803056 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771c813-83c6-4a22-8e3f-3aa0a3609c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:02.803056 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771c813-83c6-4a22-8e3f-3aa0a3609c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:02.803056 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771c813-83c6-4a22-8e3f-3aa0a3609c56 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:02.840011 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 876/1757] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:51:02.840228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771c813-83c6-4a22-8e3f-3aa0a3609c56 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:02.846399 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-9771c813-83c6-4a22-8e3f-3aa0a3609c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:02.868930 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-2ecdb5ed-c20e-45c2-b3c1-a97b6d8e9149 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc30305a1a7d4326bf5981277016043e'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:02.882151 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771c813-83c6-4a22-8e3f-3aa0a3609c56 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:02.886777 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0f3d2-1508-47e3-85ea-125f771385a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:02.887522 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0f3d2-1508-47e3-85ea-125f771385a5 service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:02.887843 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0f3d2-1508-47e3-85ea-125f771385a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:02.888193 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0f3d2-1508-47e3-85ea-125f771385a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:02.909424 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0f3d2-1508-47e3-85ea-125f771385a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:02.911396 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0f3d2-1508-47e3-85ea-125f771385a5 service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:02.956872 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-2ecdb5ed-c20e-45c2-b3c1-a97b6d8e9149 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc30305a1a7d4326bf5981277016043e'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:02.957792 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-2ecdb5ed-c20e-45c2-b3c1-a97b6d8e9149 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc30305a1a7d4326bf5981277016043e'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:02.958600 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-2ecdb5ed-c20e-45c2-b3c1-a97b6d8e9149 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc30305a1a7d4326bf5981277016043e'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:02.970734 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-2ecdb5ed-c20e-45c2-b3c1-a97b6d8e9149 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc30305a1a7d4326bf5981277016043e'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:02.971033 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 877/1758] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:51:02.972105 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0f3d2-1508-47e3-85ea-125f771385a5 service neutron] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:03.008232 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 882/1759] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:51:02 2022] DELETE /identity/v3/users/fc30305a1a7d4326bf5981277016043e => generated 0 bytes in 846 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:03.015004 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d0788-5255-40dc-be9f-8df4a6aacfcc None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:03.017702 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0f3d2-1508-47e3-85ea-125f771385a5 service neutron] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:03.017856 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d0788-5255-40dc-be9f-8df4a6aacfcc None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:03.019480 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d0788-5255-40dc-be9f-8df4a6aacfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:03.113143 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-6b7d0788-5255-40dc-be9f-8df4a6aacfcc None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:03.119098 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-6b7d0788-5255-40dc-be9f-8df4a6aacfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:03.135447 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae5da4-28a9-4b08-bd15-20f99567c98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:03.136288 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae5da4-28a9-4b08-bd15-20f99567c98d admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:03.136636 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae5da4-28a9-4b08-bd15-20f99567c98d admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:03.136985 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae5da4-28a9-4b08-bd15-20f99567c98d admin admin] PATH_INFO: `/v3/projects/9c8e6aeb120342198f05a3b3737e5d43/users/88612baa62de4680bb33ac8781b2f0d9/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:03.385875 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae5da4-28a9-4b08-bd15-20f99567c98d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c8e6aeb120342198f05a3b3737e5d43, user_id=88612baa62de4680bb33ac8781b2f0d9, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:03.385875 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae5da4-28a9-4b08-bd15-20f99567c98d admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:03.388152 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 883/1760] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:03.388152 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d0788-5255-40dc-be9f-8df4a6aacfcc None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:03.388152 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-6b7d0788-5255-40dc-be9f-8df4a6aacfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:03.510297 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 878/1761] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:51:02 2022] PUT /identity/v3/projects/9c8e6aeb120342198f05a3b3737e5d43/users/88612baa62de4680bb33ac8781b2f0d9/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:03.514678 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d0788-5255-40dc-be9f-8df4a6aacfcc None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:03.516506 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae5da4-28a9-4b08-bd15-20f99567c98d admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:03.519034 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-c3ae5da4-28a9-4b08-bd15-20f99567c98d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:03.692330 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199badb4-83db-4645-978a-d7d2190d7795 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:03.695924 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199badb4-83db-4645-978a-d7d2190d7795 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:03.695924 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199badb4-83db-4645-978a-d7d2190d7795 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:03.695924 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199badb4-83db-4645-978a-d7d2190d7795 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:03.728250 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199badb4-83db-4645-978a-d7d2190d7795 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:03.735387 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae5da4-28a9-4b08-bd15-20f99567c98d admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:03.737071 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199badb4-83db-4645-978a-d7d2190d7795 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:03.757389 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae409e7a-3079-499e-881f-52a7bd980100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:03.769307 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae409e7a-3079-499e-881f-52a7bd980100 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:03.769307 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae409e7a-3079-499e-881f-52a7bd980100 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:03.769307 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae409e7a-3079-499e-881f-52a7bd980100 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:03.769307 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae409e7a-3079-499e-881f-52a7bd980100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:03.769307 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae409e7a-3079-499e-881f-52a7bd980100 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:03.769722 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 884/1762] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:51:03.788308 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 879/1763] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:51:03.788706 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199badb4-83db-4645-978a-d7d2190d7795 service neutron] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:03.805384 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199badb4-83db-4645-978a-d7d2190d7795 service neutron] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:03.812590 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d61b05-81a2-4d76-81b9-d144e6bc6c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:03.814049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d61b05-81a2-4d76-81b9-d144e6bc6c36 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:03.814538 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d61b05-81a2-4d76-81b9-d144e6bc6c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:03.861987 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d61b05-81a2-4d76-81b9-d144e6bc6c36 admin admin] PATH_INFO: `/v3/projects/9c8e6aeb120342198f05a3b3737e5d43/users/88612baa62de4680bb33ac8781b2f0d9/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:03.873815 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d61b05-81a2-4d76-81b9-d144e6bc6c36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c8e6aeb120342198f05a3b3737e5d43, user_id=88612baa62de4680bb33ac8781b2f0d9, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:03.881883 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d61b05-81a2-4d76-81b9-d144e6bc6c36 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:03.925902 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30386f3-46cf-426b-9f04-541afc6499e4 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:03.926477 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30386f3-46cf-426b-9f04-541afc6499e4 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:03.926897 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30386f3-46cf-426b-9f04-541afc6499e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:03.931695 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 885/1764] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:51:03 2022] PUT /identity/v3/projects/9c8e6aeb120342198f05a3b3737e5d43/users/88612baa62de4680bb33ac8781b2f0d9/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:51:03.984504 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-d30386f3-46cf-426b-9f04-541afc6499e4 None None] MFA Rules not processed for user `88612baa62de4680bb33ac8781b2f0d9`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:03.986012 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-d30386f3-46cf-426b-9f04-541afc6499e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:04.070736 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d61b05-81a2-4d76-81b9-d144e6bc6c36 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:04.072662 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-a1d61b05-81a2-4d76-81b9-d144e6bc6c36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:04.134447 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 880/1765] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:03 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:51:04.150176 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30386f3-46cf-426b-9f04-541afc6499e4 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:04.161836 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-d30386f3-46cf-426b-9f04-541afc6499e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:04.197967 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d61b05-81a2-4d76-81b9-d144e6bc6c36 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:04.208036 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be057f9-921e-41fa-aacd-265ff77301e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:04.209157 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be057f9-921e-41fa-aacd-265ff77301e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:04.209704 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be057f9-921e-41fa-aacd-265ff77301e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:04.210178 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be057f9-921e-41fa-aacd-265ff77301e1 admin admin] PATH_INFO: `/v3/users/26594bcb0643454db17390521bb4ec1d` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:04.212362 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be057f9-921e-41fa-aacd-265ff77301e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26594bcb0643454db17390521bb4ec1d)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:04.217503 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be057f9-921e-41fa-aacd-265ff77301e1 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:04.349262 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30386f3-46cf-426b-9f04-541afc6499e4 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:04.361766 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea4201-4a1c-45cf-a508-b9fe8843b5ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:04.363159 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea4201-4a1c-45cf-a508-b9fe8843b5ca service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:04.363490 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea4201-4a1c-45cf-a508-b9fe8843b5ca service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:04.363763 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea4201-4a1c-45cf-a508-b9fe8843b5ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:04.381989 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea4201-4a1c-45cf-a508-b9fe8843b5ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:04.391682 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea4201-4a1c-45cf-a508-b9fe8843b5ca service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:04.429233 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 881/1766] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:04 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:51:04.467511 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-9be057f9-921e-41fa-aacd-265ff77301e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26594bcb0643454db17390521bb4ec1d'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:04.490172 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea4201-4a1c-45cf-a508-b9fe8843b5ca service cinder] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:04.497074 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-84ea4201-4a1c-45cf-a508-b9fe8843b5ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:04.544309 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea4201-4a1c-45cf-a508-b9fe8843b5ca service cinder] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:04.565107 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233cc6b7-8571-4ab3-8eeb-398d82069239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:04.566384 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cc6b7-8571-4ab3-8eeb-398d82069239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:04.566846 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cc6b7-8571-4ab3-8eeb-398d82069239 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:04.567309 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cc6b7-8571-4ab3-8eeb-398d82069239 admin admin] PATH_INFO: `/v3/projects/fdaa5249885147579123fa3afffc0775` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:04.569274 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233cc6b7-8571-4ab3-8eeb-398d82069239 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdaa5249885147579123fa3afffc0775)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:04.572881 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233cc6b7-8571-4ab3-8eeb-398d82069239 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:04.786759 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-9be057f9-921e-41fa-aacd-265ff77301e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26594bcb0643454db17390521bb4ec1d'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:04.788310 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-9be057f9-921e-41fa-aacd-265ff77301e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26594bcb0643454db17390521bb4ec1d'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:04.790321 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-9be057f9-921e-41fa-aacd-265ff77301e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26594bcb0643454db17390521bb4ec1d'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:04.813310 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-9be057f9-921e-41fa-aacd-265ff77301e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26594bcb0643454db17390521bb4ec1d'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:04.854150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 886/1767] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:51:04 2022] DELETE /identity/v3/users/26594bcb0643454db17390521bb4ec1d => generated 0 bytes in 781 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:04.855321 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be057f9-921e-41fa-aacd-265ff77301e1 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:04.856951 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-9be057f9-921e-41fa-aacd-265ff77301e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:04.949946 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-233cc6b7-8571-4ab3-8eeb-398d82069239 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdaa5249885147579123fa3afffc0775', 'request_id': 'req-233cc6b7-8571-4ab3-8eeb-398d82069239'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:04.959570 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-233cc6b7-8571-4ab3-8eeb-398d82069239 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdaa5249885147579123fa3afffc0775', 'request_id': 'req-233cc6b7-8571-4ab3-8eeb-398d82069239'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:04.968241 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be057f9-921e-41fa-aacd-265ff77301e1 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:05.029118 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:05.057404 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56c1f5-706d-48ec-91cd-9c8cbe2b5c93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:05.058355 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56c1f5-706d-48ec-91cd-9c8cbe2b5c93 service cinder] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:05.058802 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56c1f5-706d-48ec-91cd-9c8cbe2b5c93 service cinder] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:05.059357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56c1f5-706d-48ec-91cd-9c8cbe2b5c93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:05.062860 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-1c56c1f5-706d-48ec-91cd-9c8cbe2b5c93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:05.225368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56c1f5-706d-48ec-91cd-9c8cbe2b5c93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:05.227366 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56c1f5-706d-48ec-91cd-9c8cbe2b5c93 service cinder] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:05.246401 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 887/1768] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:51:05.247823 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1af6f-dc88-454c-965e-aae0dc62dc85 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:05.248863 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1af6f-dc88-454c-965e-aae0dc62dc85 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:05.249267 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1af6f-dc88-454c-965e-aae0dc62dc85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:05.289399 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-233cc6b7-8571-4ab3-8eeb-398d82069239 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdaa5249885147579123fa3afffc0775', 'request_id': 'req-233cc6b7-8571-4ab3-8eeb-398d82069239'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:05.310221 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-233cc6b7-8571-4ab3-8eeb-398d82069239 admin admin] The token cache is being invalidate because project fdaa5249885147579123fa3afffc0775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:51:05.311208 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-233cc6b7-8571-4ab3-8eeb-398d82069239 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:05.312847 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-233cc6b7-8571-4ab3-8eeb-398d82069239 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:05.322382 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:05.326374 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 882/1769] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:51:04 2022] DELETE /identity/v3/projects/fdaa5249885147579123fa3afffc0775 => generated 0 bytes in 825 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:51:05.328809 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d22289-7ebc-4760-b199-8bc0807fae2f None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:05.329291 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d22289-7ebc-4760-b199-8bc0807fae2f None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:05.330491 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d22289-7ebc-4760-b199-8bc0807fae2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:05.351078 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-20f1af6f-dc88-454c-965e-aae0dc62dc85 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:05.354368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-20f1af6f-dc88-454c-965e-aae0dc62dc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:05.365195 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-f6d22289-7ebc-4760-b199-8bc0807fae2f None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:05.368078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-f6d22289-7ebc-4760-b199-8bc0807fae2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:05.500468 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 883/1770] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:05.625446 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 888/1771] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:05.635926 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a84120-79f7-4f7a-9bce-ade73613dbb1 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:05.636639 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a84120-79f7-4f7a-9bce-ade73613dbb1 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:05.637469 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a84120-79f7-4f7a-9bce-ade73613dbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:05.686847 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-b2a84120-79f7-4f7a-9bce-ade73613dbb1 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:05.688396 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-b2a84120-79f7-4f7a-9bce-ade73613dbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:05.714475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 884/1772] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:05.716649 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1af6f-dc88-454c-965e-aae0dc62dc85 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:05.732604 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1af6f-dc88-454c-965e-aae0dc62dc85 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:05.744146 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6eff3c-171a-41f0-9f36-305f3a4bb4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:05.744778 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6eff3c-171a-41f0-9f36-305f3a4bb4bb admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:05.745102 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6eff3c-171a-41f0-9f36-305f3a4bb4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:05.745386 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6eff3c-171a-41f0-9f36-305f3a4bb4bb admin admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:05.746844 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6eff3c-171a-41f0-9f36-305f3a4bb4bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:51:05.747042 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6eff3c-171a-41f0-9f36-305f3a4bb4bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:05.751708 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6eff3c-171a-41f0-9f36-305f3a4bb4bb admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:05.777645 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 889/1773] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:51:05.782958 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a84120-79f7-4f7a-9bce-ade73613dbb1 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:05.783130 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6eff3c-171a-41f0-9f36-305f3a4bb4bb admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:05.785446 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-cf6eff3c-171a-41f0-9f36-305f3a4bb4bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:05.803914 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a84120-79f7-4f7a-9bce-ade73613dbb1 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:05.816824 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79e6cb-d04f-49ef-97e4-9412ea460607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:05.818247 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79e6cb-d04f-49ef-97e4-9412ea460607 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:05.818753 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79e6cb-d04f-49ef-97e4-9412ea460607 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:05.820610 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79e6cb-d04f-49ef-97e4-9412ea460607 admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:05.822383 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79e6cb-d04f-49ef-97e4-9412ea460607 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:05.828291 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79e6cb-d04f-49ef-97e4-9412ea460607 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:05.921813 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6eff3c-171a-41f0-9f36-305f3a4bb4bb admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:05.926245 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0a738-aeef-48fc-b08f-6b73da9eccf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:05.932248 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0a738-aeef-48fc-b08f-6b73da9eccf4 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:05.932248 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0a738-aeef-48fc-b08f-6b73da9eccf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:05.932248 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0a738-aeef-48fc-b08f-6b73da9eccf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:05.969925 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 885/1774] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:51:05 2022] POST /identity/v3/projects => generated 407 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:05.970289 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca505fd3-8b8c-4fbc-80db-5a55c7828477 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:05.972571 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca505fd3-8b8c-4fbc-80db-5a55c7828477 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:05.972571 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca505fd3-8b8c-4fbc-80db-5a55c7828477 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:05.973696 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0a738-aeef-48fc-b08f-6b73da9eccf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:05.978950 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0a738-aeef-48fc-b08f-6b73da9eccf4 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:05.987607 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 886/1775] 10.222.0.70 () {54 vars in 921 bytes} [Mon Aug 8 17:51:05 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:51:05.988510 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca505fd3-8b8c-4fbc-80db-5a55c7828477 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:06.006841 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 890/1776] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:51:06.009932 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183ca52-5dbd-4734-bd44-6b6e74455394 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:06.010788 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183ca52-5dbd-4734-bd44-6b6e74455394 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:06.011596 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183ca52-5dbd-4734-bd44-6b6e74455394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:06.050382 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-3183ca52-5dbd-4734-bd44-6b6e74455394 None None] MFA Rules not processed for user `3973b8fbfbb9475896e4e110ca8aa615`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:06.052485 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-3183ca52-5dbd-4734-bd44-6b6e74455394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:06.134767 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca505fd3-8b8c-4fbc-80db-5a55c7828477 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:06.141698 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d7d88-9518-42cf-9a21-276ac320f932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:06.142419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d7d88-9518-42cf-9a21-276ac320f932 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:06.142772 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d7d88-9518-42cf-9a21-276ac320f932 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:06.143114 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d7d88-9518-42cf-9a21-276ac320f932 admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:06.143815 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d7d88-9518-42cf-9a21-276ac320f932 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:06.147035 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d7d88-9518-42cf-9a21-276ac320f932 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:06.279230 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 891/1777] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Aug 8 17:51:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:06.419422 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 887/1778] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:51:05 2022] POST /identity/v3/users => generated 304 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:06.421016 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183ca52-5dbd-4734-bd44-6b6e74455394 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:06.436979 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183ca52-5dbd-4734-bd44-6b6e74455394 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:06.446354 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570cfc2-a0ce-4e3a-93ef-74b3670280af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:06.447288 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570cfc2-a0ce-4e3a-93ef-74b3670280af admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:06.447728 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570cfc2-a0ce-4e3a-93ef-74b3670280af admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:06.448175 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570cfc2-a0ce-4e3a-93ef-74b3670280af admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:06.449459 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c570cfc2-a0ce-4e3a-93ef-74b3670280af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:06.457732 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c570cfc2-a0ce-4e3a-93ef-74b3670280af admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:06.501695 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d7d88-9518-42cf-9a21-276ac320f932 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:06.503518 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-dd0d7d88-9518-42cf-9a21-276ac320f932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:06.512560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 892/1779] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:51:06.528604 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570cfc2-a0ce-4e3a-93ef-74b3670280af admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:06.540328 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570cfc2-a0ce-4e3a-93ef-74b3670280af admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:06.540720 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d7d88-9518-42cf-9a21-276ac320f932 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:06.549657 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e861a-417a-4850-9415-5ce6f1da0b64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:06.550777 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e861a-417a-4850-9415-5ce6f1da0b64 service nova] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:06.551232 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e861a-417a-4850-9415-5ce6f1da0b64 service nova] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:06.552027 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e861a-417a-4850-9415-5ce6f1da0b64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:06.571289 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e861a-417a-4850-9415-5ce6f1da0b64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:06.573938 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e861a-417a-4850-9415-5ce6f1da0b64 service nova] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:06.575977 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe1442-718c-48b8-b25d-9099936b5456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:06.576587 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe1442-718c-48b8-b25d-9099936b5456 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:06.576945 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe1442-718c-48b8-b25d-9099936b5456 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:06.577328 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe1442-718c-48b8-b25d-9099936b5456 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:06.578134 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe1442-718c-48b8-b25d-9099936b5456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:06.585012 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe1442-718c-48b8-b25d-9099936b5456 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:06.589760 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 888/1780] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:51:06.616347 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 893/1781] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:51:06.617875 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e861a-417a-4850-9415-5ce6f1da0b64 service nova] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:06.626839 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:06.634904 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e861a-417a-4850-9415-5ce6f1da0b64 service nova] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:06.638469 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3a55a-c618-43e5-84f0-e97add9df844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:06.639377 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3a55a-c618-43e5-84f0-e97add9df844 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:06.639861 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3a55a-c618-43e5-84f0-e97add9df844 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:06.640456 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3a55a-c618-43e5-84f0-e97add9df844 admin admin] PATH_INFO: `/v3/projects/bbf67ea058fe46baaf5b978778498987/users/4320d8ff3ec4484d88a3db0bd2fa08b4/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:06.695104 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3a55a-c618-43e5-84f0-e97add9df844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbf67ea058fe46baaf5b978778498987, user_id=4320d8ff3ec4484d88a3db0bd2fa08b4, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:06.698700 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3a55a-c618-43e5-84f0-e97add9df844 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:06.737994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe1442-718c-48b8-b25d-9099936b5456 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:06.739610 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-37fe1442-718c-48b8-b25d-9099936b5456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:06.756770 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe1442-718c-48b8-b25d-9099936b5456 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:06.768996 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762dbf64-f085-436c-bcae-f41ed7d2397a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:06.769727 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dbf64-f085-436c-bcae-f41ed7d2397a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:06.770077 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dbf64-f085-436c-bcae-f41ed7d2397a admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:06.770364 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dbf64-f085-436c-bcae-f41ed7d2397a admin admin] PATH_INFO: `/v3/projects/5452ccbf02d54d40a0430833fd8accea` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:06.771621 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762dbf64-f085-436c-bcae-f41ed7d2397a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5452ccbf02d54d40a0430833fd8accea)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:06.775019 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762dbf64-f085-436c-bcae-f41ed7d2397a admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:06.790893 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 889/1782] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:51:06 2022] PUT /identity/v3/projects/bbf67ea058fe46baaf5b978778498987/users/4320d8ff3ec4484d88a3db0bd2fa08b4/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:51:06.813101 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93697747-4140-400e-a701-157692873aeb None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:06.814155 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93697747-4140-400e-a701-157692873aeb None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:06.814758 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93697747-4140-400e-a701-157692873aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:06.970649 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-93697747-4140-400e-a701-157692873aeb None None] MFA Rules not processed for user `4320d8ff3ec4484d88a3db0bd2fa08b4`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:06.970649 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-93697747-4140-400e-a701-157692873aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:07.064726 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 890/1783] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:06 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:07.071782 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1dd97-effb-40d9-b294-0a84e444cb0f None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:07.071782 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1dd97-effb-40d9-b294-0a84e444cb0f None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:07.085074 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1dd97-effb-40d9-b294-0a84e444cb0f None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:07.095736 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 891/1784] 10.222.0.70 () {54 vars in 921 bytes} [Mon Aug 8 17:51:07 2022] GET /identity => generated 270 bytes in 30 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:51:07.098401 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1dd97-effb-40d9-b294-0a84e444cb0f None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:07.207137 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-762dbf64-f085-436c-bcae-f41ed7d2397a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5452ccbf02d54d40a0430833fd8accea', 'request_id': 'req-762dbf64-f085-436c-bcae-f41ed7d2397a'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:07.224476 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-762dbf64-f085-436c-bcae-f41ed7d2397a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5452ccbf02d54d40a0430833fd8accea', 'request_id': 'req-762dbf64-f085-436c-bcae-f41ed7d2397a'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:07.273179 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1dd97-effb-40d9-b294-0a84e444cb0f None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:07.335118 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-762dbf64-f085-436c-bcae-f41ed7d2397a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5452ccbf02d54d40a0430833fd8accea', 'request_id': 'req-762dbf64-f085-436c-bcae-f41ed7d2397a'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:07.372982 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-762dbf64-f085-436c-bcae-f41ed7d2397a admin admin] The token cache is being invalidate because project 5452ccbf02d54d40a0430833fd8accea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:51:07.373318 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-762dbf64-f085-436c-bcae-f41ed7d2397a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:07.374082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-762dbf64-f085-436c-bcae-f41ed7d2397a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:07.376947 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 894/1785] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:51:06 2022] DELETE /identity/v3/projects/5452ccbf02d54d40a0430833fd8accea => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:07.378878 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793bd20-2b6d-43ec-9f14-0728998412f6 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:07.379213 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793bd20-2b6d-43ec-9f14-0728998412f6 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:07.379881 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793bd20-2b6d-43ec-9f14-0728998412f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:07.420910 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-0793bd20-2b6d-43ec-9f14-0728998412f6 None None] MFA Rules not processed for user `3973b8fbfbb9475896e4e110ca8aa615`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:07.422304 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-0793bd20-2b6d-43ec-9f14-0728998412f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:07.470551 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad554ad-884a-4f39-bb8e-c12db9761909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:07.472438 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad554ad-884a-4f39-bb8e-c12db9761909 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:07.474849 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad554ad-884a-4f39-bb8e-c12db9761909 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:07.475586 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad554ad-884a-4f39-bb8e-c12db9761909 admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:07.477528 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad554ad-884a-4f39-bb8e-c12db9761909 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:07.485245 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad554ad-884a-4f39-bb8e-c12db9761909 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:07.586580 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 892/1786] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:51:07 2022] POST /identity/v3/projects => generated 407 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:07.588068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad554ad-884a-4f39-bb8e-c12db9761909 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:07.590210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-fad554ad-884a-4f39-bb8e-c12db9761909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:07.677332 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 895/1787] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Aug 8 17:51:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:07.678189 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793bd20-2b6d-43ec-9f14-0728998412f6 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:07.684419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad554ad-884a-4f39-bb8e-c12db9761909 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:07.692765 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-0793bd20-2b6d-43ec-9f14-0728998412f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:07.692929 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a0ac4-d5af-47c2-9e08-da206c6e5881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:07.692929 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a0ac4-d5af-47c2-9e08-da206c6e5881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:07.692929 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a0ac4-d5af-47c2-9e08-da206c6e5881 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:07.692929 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a0ac4-d5af-47c2-9e08-da206c6e5881 admin admin] PATH_INFO: `/v3/users/954edac64da64fb5adbb812a8ba5c397` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:07.715950 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a0ac4-d5af-47c2-9e08-da206c6e5881 admin admin] RBAC: Authorizing `identity:delete_user(user_id=954edac64da64fb5adbb812a8ba5c397)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:07.722233 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a0ac4-d5af-47c2-9e08-da206c6e5881 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:07.728389 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793bd20-2b6d-43ec-9f14-0728998412f6 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:07.756162 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618a1c1-ea72-4ac3-8d55-98038666d7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:07.757614 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618a1c1-ea72-4ac3-8d55-98038666d7aa admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:07.758858 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618a1c1-ea72-4ac3-8d55-98038666d7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:07.759519 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618a1c1-ea72-4ac3-8d55-98038666d7aa admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:07.760364 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618a1c1-ea72-4ac3-8d55-98038666d7aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:07.763126 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618a1c1-ea72-4ac3-8d55-98038666d7aa admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:07.865818 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 896/1788] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:51:07 2022] POST /identity/v3/users => generated 310 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:07.870568 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618a1c1-ea72-4ac3-8d55-98038666d7aa admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:07.874278 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-9618a1c1-ea72-4ac3-8d55-98038666d7aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:08.032745 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618a1c1-ea72-4ac3-8d55-98038666d7aa admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:08.042296 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5fd3c-89f9-49cc-bf0d-f6640da75115 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:08.048954 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5fd3c-89f9-49cc-bf0d-f6640da75115 service nova] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:08.048954 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5fd3c-89f9-49cc-bf0d-f6640da75115 service nova] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:08.048954 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5fd3c-89f9-49cc-bf0d-f6640da75115 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:08.099231 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e5fd3c-89f9-49cc-bf0d-f6640da75115 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:08.100134 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e5fd3c-89f9-49cc-bf0d-f6640da75115 service nova] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:08.127908 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 897/1789] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:51:08.130268 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5fd3c-89f9-49cc-bf0d-f6640da75115 service nova] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:08.161809 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5fd3c-89f9-49cc-bf0d-f6640da75115 service nova] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:08.173416 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd245a2-3cdb-40a8-893d-b0250d7a8589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:08.174044 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd245a2-3cdb-40a8-893d-b0250d7a8589 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:08.174318 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd245a2-3cdb-40a8-893d-b0250d7a8589 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:08.174620 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd245a2-3cdb-40a8-893d-b0250d7a8589 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:08.175226 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd245a2-3cdb-40a8-893d-b0250d7a8589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:08.177082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd245a2-3cdb-40a8-893d-b0250d7a8589 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:08.193452 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 898/1790] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:51:08.197883 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd245a2-3cdb-40a8-893d-b0250d7a8589 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:08.222371 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:08.228972 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd245a2-3cdb-40a8-893d-b0250d7a8589 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:08.234244 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69300ef8-82a9-4c78-b778-804dbb13f923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:08.235960 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69300ef8-82a9-4c78-b778-804dbb13f923 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:08.235960 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69300ef8-82a9-4c78-b778-804dbb13f923 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:08.238691 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69300ef8-82a9-4c78-b778-804dbb13f923 admin admin] PATH_INFO: `/v3/projects/87940f2183ec4a678e6224e84125cccc/users/8144b36d4dbf4f9580c1062d8d5a68c8/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:08.257544 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69300ef8-82a9-4c78-b778-804dbb13f923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87940f2183ec4a678e6224e84125cccc, user_id=8144b36d4dbf4f9580c1062d8d5a68c8, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:08.262626 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69300ef8-82a9-4c78-b778-804dbb13f923 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:08.282371 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-7c3a0ac4-d5af-47c2-9e08-da206c6e5881 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '954edac64da64fb5adbb812a8ba5c397'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:08.342421 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 899/1791] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:51:08 2022] PUT /identity/v3/projects/87940f2183ec4a678e6224e84125cccc/users/8144b36d4dbf4f9580c1062d8d5a68c8/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:08.342421 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69300ef8-82a9-4c78-b778-804dbb13f923 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:08.346468 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-69300ef8-82a9-4c78-b778-804dbb13f923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:08.380569 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-7c3a0ac4-d5af-47c2-9e08-da206c6e5881 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '954edac64da64fb5adbb812a8ba5c397'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:08.385625 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-7c3a0ac4-d5af-47c2-9e08-da206c6e5881 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '954edac64da64fb5adbb812a8ba5c397'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:08.385625 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-7c3a0ac4-d5af-47c2-9e08-da206c6e5881 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '954edac64da64fb5adbb812a8ba5c397'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:08.401188 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-7c3a0ac4-d5af-47c2-9e08-da206c6e5881 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '954edac64da64fb5adbb812a8ba5c397'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:08.466035 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 893/1792] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:51:07 2022] DELETE /identity/v3/users/954edac64da64fb5adbb812a8ba5c397 => generated 0 bytes in 879 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:08.467179 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a0ac4-d5af-47c2-9e08-da206c6e5881 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:08.468791 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-7c3a0ac4-d5af-47c2-9e08-da206c6e5881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:08.622978 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:08.624342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69300ef8-82a9-4c78-b778-804dbb13f923 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:08.625677 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a0ac4-d5af-47c2-9e08-da206c6e5881 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:08.625677 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d90989-c6a7-4986-9d0c-d913101b1b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:08.625677 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d90989-c6a7-4986-9d0c-d913101b1b99 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:08.625677 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d90989-c6a7-4986-9d0c-d913101b1b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:08.626218 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b510b98-4966-4945-a20c-fe0d39b11d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:08.626619 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d90989-c6a7-4986-9d0c-d913101b1b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:08.626744 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b510b98-4966-4945-a20c-fe0d39b11d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:08.626744 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b510b98-4966-4945-a20c-fe0d39b11d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:08.626962 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d90989-c6a7-4986-9d0c-d913101b1b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:08.627059 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b510b98-4966-4945-a20c-fe0d39b11d61 admin admin] PATH_INFO: `/v3/projects/f446a2708c1d4d86b9908e4e1c44c609` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:08.627059 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b510b98-4966-4945-a20c-fe0d39b11d61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f446a2708c1d4d86b9908e4e1c44c609)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:08.627342 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d90989-c6a7-4986-9d0c-d913101b1b99 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:08.627430 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b510b98-4966-4945-a20c-fe0d39b11d61 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:08.627518 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 894/1793] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:51:08.637757 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d90989-c6a7-4986-9d0c-d913101b1b99 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:08.655304 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d90989-c6a7-4986-9d0c-d913101b1b99 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:08.672848 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8dbc7f-2bdf-4e7a-a454-f17860b7d444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:08.673565 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8dbc7f-2bdf-4e7a-a454-f17860b7d444 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:08.673843 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8dbc7f-2bdf-4e7a-a454-f17860b7d444 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:08.674313 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8dbc7f-2bdf-4e7a-a454-f17860b7d444 admin admin] PATH_INFO: `/v3/projects/87940f2183ec4a678e6224e84125cccc/users/8144b36d4dbf4f9580c1062d8d5a68c8/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:08.679142 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8dbc7f-2bdf-4e7a-a454-f17860b7d444 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87940f2183ec4a678e6224e84125cccc, user_id=8144b36d4dbf4f9580c1062d8d5a68c8, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:08.686141 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8dbc7f-2bdf-4e7a-a454-f17860b7d444 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:08.716495 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 895/1794] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:51:08 2022] PUT /identity/v3/projects/87940f2183ec4a678e6224e84125cccc/users/8144b36d4dbf4f9580c1062d8d5a68c8/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:08.728161 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414de651-3a94-4285-8387-a97d870d956a None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:08.728550 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414de651-3a94-4285-8387-a97d870d956a None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:08.728719 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414de651-3a94-4285-8387-a97d870d956a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:08.787586 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-414de651-3a94-4285-8387-a97d870d956a None None] MFA Rules not processed for user `8144b36d4dbf4f9580c1062d8d5a68c8`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:08.788884 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-414de651-3a94-4285-8387-a97d870d956a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:08.886128 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-4b510b98-4966-4945-a20c-fe0d39b11d61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f446a2708c1d4d86b9908e4e1c44c609', 'request_id': 'req-4b510b98-4966-4945-a20c-fe0d39b11d61'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:08.896463 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-4b510b98-4966-4945-a20c-fe0d39b11d61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f446a2708c1d4d86b9908e4e1c44c609', 'request_id': 'req-4b510b98-4966-4945-a20c-fe0d39b11d61'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:08.922450 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 896/1795] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:08 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:08.929256 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414de651-3a94-4285-8387-a97d870d956a None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:08.931214 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-414de651-3a94-4285-8387-a97d870d956a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:09.003700 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-4b510b98-4966-4945-a20c-fe0d39b11d61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f446a2708c1d4d86b9908e4e1c44c609', 'request_id': 'req-4b510b98-4966-4945-a20c-fe0d39b11d61'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:09.031813 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-4b510b98-4966-4945-a20c-fe0d39b11d61 admin admin] The token cache is being invalidate because project f446a2708c1d4d86b9908e4e1c44c609 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:51:09.037266 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-4b510b98-4966-4945-a20c-fe0d39b11d61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:09.041214 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-4b510b98-4966-4945-a20c-fe0d39b11d61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:09.049348 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 900/1796] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:51:08 2022] DELETE /identity/v3/projects/f446a2708c1d4d86b9908e4e1c44c609 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:09.049916 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414de651-3a94-4285-8387-a97d870d956a None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:09.056983 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b510b98-4966-4945-a20c-fe0d39b11d61 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:09.070000 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-4b510b98-4966-4945-a20c-fe0d39b11d61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:09.226148 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fae0c2-64a0-4d3b-96e4-056c13ea21e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:09.229274 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fae0c2-64a0-4d3b-96e4-056c13ea21e0 service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:09.230321 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fae0c2-64a0-4d3b-96e4-056c13ea21e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:09.230615 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fae0c2-64a0-4d3b-96e4-056c13ea21e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:09.236270 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-b4fae0c2-64a0-4d3b-96e4-056c13ea21e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:09.269503 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b510b98-4966-4945-a20c-fe0d39b11d61 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:09.290583 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224c312-2313-4580-831a-9fdf920cab5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:09.452315 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224c312-2313-4580-831a-9fdf920cab5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:09.452315 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224c312-2313-4580-831a-9fdf920cab5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:09.452315 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224c312-2313-4580-831a-9fdf920cab5e admin admin] PATH_INFO: `/v3/users/cb42cd97e68147b49d5e8f895e5f8d0a` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:09.452315 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224c312-2313-4580-831a-9fdf920cab5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb42cd97e68147b49d5e8f895e5f8d0a)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:09.452315 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224c312-2313-4580-831a-9fdf920cab5e admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:09.454226 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fae0c2-64a0-4d3b-96e4-056c13ea21e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:09.454226 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fae0c2-64a0-4d3b-96e4-056c13ea21e0 service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:09.454226 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 897/1797] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:08 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:51:09.747057 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fae0c2-64a0-4d3b-96e4-056c13ea21e0 service cinder] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:09.755108 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-b4fae0c2-64a0-4d3b-96e4-056c13ea21e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:09.783833 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e224c312-2313-4580-831a-9fdf920cab5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb42cd97e68147b49d5e8f895e5f8d0a'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:09.841529 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fae0c2-64a0-4d3b-96e4-056c13ea21e0 service cinder] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:09.848108 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e224c312-2313-4580-831a-9fdf920cab5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb42cd97e68147b49d5e8f895e5f8d0a'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:09.849074 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e224c312-2313-4580-831a-9fdf920cab5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb42cd97e68147b49d5e8f895e5f8d0a'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:09.852606 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e224c312-2313-4580-831a-9fdf920cab5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb42cd97e68147b49d5e8f895e5f8d0a'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:09.873678 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6300a8-fc2b-4b24-8cb5-e0c40dc9a6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:09.874367 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6300a8-fc2b-4b24-8cb5-e0c40dc9a6ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:09.875517 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6300a8-fc2b-4b24-8cb5-e0c40dc9a6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:09.875648 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6300a8-fc2b-4b24-8cb5-e0c40dc9a6ff admin admin] PATH_INFO: `/v3/projects/12e7a40c685546ce808695b7102bdc4f` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:09.878139 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e224c312-2313-4580-831a-9fdf920cab5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb42cd97e68147b49d5e8f895e5f8d0a'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:09.881656 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6300a8-fc2b-4b24-8cb5-e0c40dc9a6ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=12e7a40c685546ce808695b7102bdc4f)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:09.888869 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6300a8-fc2b-4b24-8cb5-e0c40dc9a6ff admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:09.936082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 901/1798] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:51:09 2022] DELETE /identity/v3/users/cb42cd97e68147b49d5e8f895e5f8d0a => generated 0 bytes in 880 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:51:09.937164 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224c312-2313-4580-831a-9fdf920cab5e admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:09.939024 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-e224c312-2313-4580-831a-9fdf920cab5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:10.159835 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224c312-2313-4580-831a-9fdf920cab5e admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:10.173644 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1e6300a8-fc2b-4b24-8cb5-e0c40dc9a6ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12e7a40c685546ce808695b7102bdc4f', 'request_id': 'req-1e6300a8-fc2b-4b24-8cb5-e0c40dc9a6ff'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:10.187355 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1e6300a8-fc2b-4b24-8cb5-e0c40dc9a6ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12e7a40c685546ce808695b7102bdc4f', 'request_id': 'req-1e6300a8-fc2b-4b24-8cb5-e0c40dc9a6ff'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:10.290039 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1e6300a8-fc2b-4b24-8cb5-e0c40dc9a6ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12e7a40c685546ce808695b7102bdc4f', 'request_id': 'req-1e6300a8-fc2b-4b24-8cb5-e0c40dc9a6ff'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:10.311714 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1e6300a8-fc2b-4b24-8cb5-e0c40dc9a6ff admin admin] The token cache is being invalidate because project 12e7a40c685546ce808695b7102bdc4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:51:10.312101 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c8771-4b1e-44af-a3fa-66e3fa145214 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:10.312254 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1e6300a8-fc2b-4b24-8cb5-e0c40dc9a6ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:10.312727 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c8771-4b1e-44af-a3fa-66e3fa145214 service cinder] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:10.313013 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c8771-4b1e-44af-a3fa-66e3fa145214 service cinder] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:10.313348 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c8771-4b1e-44af-a3fa-66e3fa145214 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:10.314405 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1e6300a8-fc2b-4b24-8cb5-e0c40dc9a6ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:10.316403 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-bc3c8771-4b1e-44af-a3fa-66e3fa145214 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:10.322849 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 898/1799] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:51:09 2022] DELETE /identity/v3/projects/12e7a40c685546ce808695b7102bdc4f => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:10.324516 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d5ca5-31f9-4d1e-a9a3-0621979e0c40 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:10.324907 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d5ca5-31f9-4d1e-a9a3-0621979e0c40 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:10.325406 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d5ca5-31f9-4d1e-a9a3-0621979e0c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:10.393207 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-811d5ca5-31f9-4d1e-a9a3-0621979e0c40 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:10.395626 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-811d5ca5-31f9-4d1e-a9a3-0621979e0c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:10.537938 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c8771-4b1e-44af-a3fa-66e3fa145214 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:10.540315 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c8771-4b1e-44af-a3fa-66e3fa145214 service cinder] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:10.561519 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:10.566975 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 902/1800] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:09 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:51:10.630182 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 899/1801] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:10.639624 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9096417-83ba-485e-8035-43bfb7fe7e5a None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:10.639944 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9096417-83ba-485e-8035-43bfb7fe7e5a None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:10.640963 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9096417-83ba-485e-8035-43bfb7fe7e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:10.678000 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-c9096417-83ba-485e-8035-43bfb7fe7e5a None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:10.681230 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-c9096417-83ba-485e-8035-43bfb7fe7e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:10.713402 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 903/1802] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:10.718386 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d5ca5-31f9-4d1e-a9a3-0621979e0c40 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:10.736085 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d5ca5-31f9-4d1e-a9a3-0621979e0c40 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:10.752543 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0587e-7c2d-4dc5-b0fa-0cc40e23e297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:10.753262 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0587e-7c2d-4dc5-b0fa-0cc40e23e297 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:10.753508 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0587e-7c2d-4dc5-b0fa-0cc40e23e297 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:10.753679 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0587e-7c2d-4dc5-b0fa-0cc40e23e297 admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:10.754362 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0587e-7c2d-4dc5-b0fa-0cc40e23e297 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:51:10.754868 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0587e-7c2d-4dc5-b0fa-0cc40e23e297 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:10.756234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0587e-7c2d-4dc5-b0fa-0cc40e23e297 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:10.776169 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:10.792441 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 900/1803] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:51:10.793729 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9096417-83ba-485e-8035-43bfb7fe7e5a None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:10.812731 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9096417-83ba-485e-8035-43bfb7fe7e5a None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:10.825786 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b9286-f709-468a-b600-deb32827f6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:10.827173 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b9286-f709-468a-b600-deb32827f6d7 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:10.840039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b9286-f709-468a-b600-deb32827f6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:10.840039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b9286-f709-468a-b600-deb32827f6d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:10.840039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b9286-f709-468a-b600-deb32827f6d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:10.840039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b9286-f709-468a-b600-deb32827f6d7 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:10.989938 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 904/1804] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:51:10 2022] POST /identity/v3/projects => generated 379 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:10.994886 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0587e-7c2d-4dc5-b0fa-0cc40e23e297 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:11.015221 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0587e-7c2d-4dc5-b0fa-0cc40e23e297 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:11.098503 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512a52e-4f0f-4fc8-83ac-b50a1acfe570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:11.100042 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512a52e-4f0f-4fc8-83ac-b50a1acfe570 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:11.100526 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512a52e-4f0f-4fc8-83ac-b50a1acfe570 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:11.101067 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512a52e-4f0f-4fc8-83ac-b50a1acfe570 admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:11.102497 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512a52e-4f0f-4fc8-83ac-b50a1acfe570 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:11.105212 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512a52e-4f0f-4fc8-83ac-b50a1acfe570 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:11.345384 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 901/1805] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:51:10 2022] POST /identity/v3/users => generated 290 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:11.347243 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b9286-f709-468a-b600-deb32827f6d7 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:11.372567 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b9286-f709-468a-b600-deb32827f6d7 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:11.394787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee02f8-4912-4840-93ee-6a8b0416c7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:11.394787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee02f8-4912-4840-93ee-6a8b0416c7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:11.394787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee02f8-4912-4840-93ee-6a8b0416c7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:11.394787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee02f8-4912-4840-93ee-6a8b0416c7f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:11.395375 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee02f8-4912-4840-93ee-6a8b0416c7f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:11.401139 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee02f8-4912-4840-93ee-6a8b0416c7f5 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:11.437639 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 905/1806] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:51:11.441405 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512a52e-4f0f-4fc8-83ac-b50a1acfe570 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:11.457129 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512a52e-4f0f-4fc8-83ac-b50a1acfe570 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:11.466713 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d8dcf-2e24-4f28-bdc2-dd1f6687736c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:11.467692 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d8dcf-2e24-4f28-bdc2-dd1f6687736c admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:11.467982 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d8dcf-2e24-4f28-bdc2-dd1f6687736c admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:11.468314 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d8dcf-2e24-4f28-bdc2-dd1f6687736c admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:11.469008 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d8dcf-2e24-4f28-bdc2-dd1f6687736c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:11.470624 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d8dcf-2e24-4f28-bdc2-dd1f6687736c admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:11.521376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 902/1807] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:51:11.523048 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee02f8-4912-4840-93ee-6a8b0416c7f5 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:11.538017 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee02f8-4912-4840-93ee-6a8b0416c7f5 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:11.551193 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b4857-e95a-4c43-bac8-a9ab0b22583c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:11.551877 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b4857-e95a-4c43-bac8-a9ab0b22583c admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:11.552440 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b4857-e95a-4c43-bac8-a9ab0b22583c admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:11.552817 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b4857-e95a-4c43-bac8-a9ab0b22583c admin admin] PATH_INFO: `/v3/projects/5152d54533c74335ab86f81ac8ef76c0/users/620a285fb6164cc1a2854530a9ee9b2d/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:11.579278 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b4857-e95a-4c43-bac8-a9ab0b22583c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5152d54533c74335ab86f81ac8ef76c0, user_id=620a285fb6164cc1a2854530a9ee9b2d, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:11.579278 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b4857-e95a-4c43-bac8-a9ab0b22583c admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:11.829418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 906/1808] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:51:11 2022] PUT /identity/v3/projects/5152d54533c74335ab86f81ac8ef76c0/users/620a285fb6164cc1a2854530a9ee9b2d/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:11.841418 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d8071-cb9e-4a80-b9cf-add7edd0d50d None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:11.842319 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d8071-cb9e-4a80-b9cf-add7edd0d50d None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:11.842319 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d8071-cb9e-4a80-b9cf-add7edd0d50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:11.885368 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-860d8071-cb9e-4a80-b9cf-add7edd0d50d None None] MFA Rules not processed for user `620a285fb6164cc1a2854530a9ee9b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:11.886892 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-860d8071-cb9e-4a80-b9cf-add7edd0d50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:12.030294 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 903/1809] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:12.034608 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b4857-e95a-4c43-bac8-a9ab0b22583c admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:12.082907 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d8071-cb9e-4a80-b9cf-add7edd0d50d None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:12.084800 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-860d8071-cb9e-4a80-b9cf-add7edd0d50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:12.203468 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d8071-cb9e-4a80-b9cf-add7edd0d50d None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:12.215587 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2f54d-2da2-4a97-9e4c-913c8a7a453b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:12.227711 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2f54d-2da2-4a97-9e4c-913c8a7a453b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:12.227711 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2f54d-2da2-4a97-9e4c-913c8a7a453b admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:12.227711 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2f54d-2da2-4a97-9e4c-913c8a7a453b admin admin] PATH_INFO: `/v3/projects/f56cc84057ad4fdc91c1cec44b31664a` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:12.227711 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2f54d-2da2-4a97-9e4c-913c8a7a453b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f56cc84057ad4fdc91c1cec44b31664a)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:12.228062 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b4857-e95a-4c43-bac8-a9ab0b22583c admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:12.228173 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2f54d-2da2-4a97-9e4c-913c8a7a453b admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:12.228251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22042000-8b94-49a8-b53b-2566b3664e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:12.228251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22042000-8b94-49a8-b53b-2566b3664e92 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:12.228251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22042000-8b94-49a8-b53b-2566b3664e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:12.228251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22042000-8b94-49a8-b53b-2566b3664e92 admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:12.228582 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22042000-8b94-49a8-b53b-2566b3664e92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:12.229719 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22042000-8b94-49a8-b53b-2566b3664e92 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:12.635137 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 907/1810] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:51:12 2022] POST /identity/v3/projects => generated 379 bytes in 601 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:12.639298 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22042000-8b94-49a8-b53b-2566b3664e92 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:12.685954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-e0a2f54d-2da2-4a97-9e4c-913c8a7a453b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f56cc84057ad4fdc91c1cec44b31664a', 'request_id': 'req-e0a2f54d-2da2-4a97-9e4c-913c8a7a453b'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:12.766206 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-e0a2f54d-2da2-4a97-9e4c-913c8a7a453b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f56cc84057ad4fdc91c1cec44b31664a', 'request_id': 'req-e0a2f54d-2da2-4a97-9e4c-913c8a7a453b'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:12.766573 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22042000-8b94-49a8-b53b-2566b3664e92 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:12.769101 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9de36-2b06-4ee1-a0f9-7c14b611c8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:12.769819 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9de36-2b06-4ee1-a0f9-7c14b611c8a2 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:12.770211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9de36-2b06-4ee1-a0f9-7c14b611c8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:12.770381 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9de36-2b06-4ee1-a0f9-7c14b611c8a2 admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:12.771021 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d9de36-2b06-4ee1-a0f9-7c14b611c8a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:12.772947 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d9de36-2b06-4ee1-a0f9-7c14b611c8a2 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:12.905510 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-e0a2f54d-2da2-4a97-9e4c-913c8a7a453b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f56cc84057ad4fdc91c1cec44b31664a', 'request_id': 'req-e0a2f54d-2da2-4a97-9e4c-913c8a7a453b'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:12.916615 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 908/1811] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:51:12 2022] POST /identity/v3/users => generated 296 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:12.918392 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9de36-2b06-4ee1-a0f9-7c14b611c8a2 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:12.921118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-e0a2f54d-2da2-4a97-9e4c-913c8a7a453b admin admin] The token cache is being invalidate because project f56cc84057ad4fdc91c1cec44b31664a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:51:12.921665 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-e0a2f54d-2da2-4a97-9e4c-913c8a7a453b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:12.922739 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-e0a2f54d-2da2-4a97-9e4c-913c8a7a453b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:12.925082 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 904/1812] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:51:12 2022] DELETE /identity/v3/projects/f56cc84057ad4fdc91c1cec44b31664a => generated 0 bytes in 843 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:12.930516 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b01598-6a75-4270-bde8-44fd1561f27f None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:12.931037 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b01598-6a75-4270-bde8-44fd1561f27f None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:12.931582 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b01598-6a75-4270-bde8-44fd1561f27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:12.939470 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9de36-2b06-4ee1-a0f9-7c14b611c8a2 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:12.980769 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:12.987452 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-e6b01598-6a75-4270-bde8-44fd1561f27f None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:12.989235 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-e6b01598-6a75-4270-bde8-44fd1561f27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:12.994949 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7621758-082b-4d39-808a-4b0c1f7b601c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:12.995912 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7621758-082b-4d39-808a-4b0c1f7b601c admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:12.996198 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7621758-082b-4d39-808a-4b0c1f7b601c admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:12.996444 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7621758-082b-4d39-808a-4b0c1f7b601c admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:12.997987 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7621758-082b-4d39-808a-4b0c1f7b601c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:13.000829 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 905/1813] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:13.002870 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7621758-082b-4d39-808a-4b0c1f7b601c admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:13.011215 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7b831-9439-4dfa-8d31-289c03bc24e1 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:13.011512 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7b831-9439-4dfa-8d31-289c03bc24e1 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:13.013184 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7b831-9439-4dfa-8d31-289c03bc24e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:13.033902 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 909/1814] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:51:13.041824 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7621758-082b-4d39-808a-4b0c1f7b601c admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:13.043828 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-c7621758-082b-4d39-808a-4b0c1f7b601c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:13.067777 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7621758-082b-4d39-808a-4b0c1f7b601c admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:13.074192 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3fb1b7-302d-4dbd-9c36-178c3bd985f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:13.075136 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fb1b7-302d-4dbd-9c36-178c3bd985f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:13.075452 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fb1b7-302d-4dbd-9c36-178c3bd985f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:13.075806 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fb1b7-302d-4dbd-9c36-178c3bd985f3 admin admin] PATH_INFO: `/v3/projects/aa19a60c6ead42ababbf01981e6bc575/users/8eac37e99f96450798837243b059e2dd/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:13.084501 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-1ad7b831-9439-4dfa-8d31-289c03bc24e1 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:13.087584 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-1ad7b831-9439-4dfa-8d31-289c03bc24e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:13.107574 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 906/1815] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:13.112151 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7b831-9439-4dfa-8d31-289c03bc24e1 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:13.134551 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7b831-9439-4dfa-8d31-289c03bc24e1 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:13.150154 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea2c74-54d3-49cb-af75-ff8cddd775f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:13.151075 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea2c74-54d3-49cb-af75-ff8cddd775f6 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:13.151361 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea2c74-54d3-49cb-af75-ff8cddd775f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:13.151719 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea2c74-54d3-49cb-af75-ff8cddd775f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:13.152390 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea2c74-54d3-49cb-af75-ff8cddd775f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:51:13.152697 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea2c74-54d3-49cb-af75-ff8cddd775f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:13.154569 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea2c74-54d3-49cb-af75-ff8cddd775f6 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:13.165289 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3fb1b7-302d-4dbd-9c36-178c3bd985f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa19a60c6ead42ababbf01981e6bc575, user_id=8eac37e99f96450798837243b059e2dd, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:13.174766 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 907/1816] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:51:13.174979 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3fb1b7-302d-4dbd-9c36-178c3bd985f3 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:13.175079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea2c74-54d3-49cb-af75-ff8cddd775f6 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:13.193645 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea2c74-54d3-49cb-af75-ff8cddd775f6 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:13.219751 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d553df5-c898-4511-b4a9-496231c6173f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:13.219751 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d553df5-c898-4511-b4a9-496231c6173f admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:13.219751 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d553df5-c898-4511-b4a9-496231c6173f admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:13.219751 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d553df5-c898-4511-b4a9-496231c6173f admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:13.220122 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d553df5-c898-4511-b4a9-496231c6173f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:13.220122 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d553df5-c898-4511-b4a9-496231c6173f admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:13.378625 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 910/1817] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:51:13 2022] PUT /identity/v3/projects/aa19a60c6ead42ababbf01981e6bc575/users/8eac37e99f96450798837243b059e2dd/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:13.380232 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3fb1b7-302d-4dbd-9c36-178c3bd985f3 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:13.431558 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 908/1818] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:51:13 2022] POST /identity/v3/projects => generated 363 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:13.442358 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d553df5-c898-4511-b4a9-496231c6173f admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:13.446692 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-5d553df5-c898-4511-b4a9-496231c6173f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:13.560831 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3fb1b7-302d-4dbd-9c36-178c3bd985f3 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:13.609684 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d553df5-c898-4511-b4a9-496231c6173f admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:13.627864 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5091c-3a84-4ef6-9d29-0b81213c30f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:13.627864 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5091c-3a84-4ef6-9d29-0b81213c30f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:13.627864 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5091c-3a84-4ef6-9d29-0b81213c30f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:13.627864 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5091c-3a84-4ef6-9d29-0b81213c30f4 admin admin] PATH_INFO: `/v3/users/926bf93b7d214bb0a2c2ffdddc2f4323` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:13.630460 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5091c-3a84-4ef6-9d29-0b81213c30f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=926bf93b7d214bb0a2c2ffdddc2f4323)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:13.637569 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5091c-3a84-4ef6-9d29-0b81213c30f4 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:13.715251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb654735-ee46-4b6d-9500-bfe8d5afcb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:13.715806 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb654735-ee46-4b6d-9500-bfe8d5afcb4b admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:13.716065 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb654735-ee46-4b6d-9500-bfe8d5afcb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:13.716348 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb654735-ee46-4b6d-9500-bfe8d5afcb4b admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:13.717350 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb654735-ee46-4b6d-9500-bfe8d5afcb4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:13.719130 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb654735-ee46-4b6d-9500-bfe8d5afcb4b admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:13.731297 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 911/1819] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:51:13.733085 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb654735-ee46-4b6d-9500-bfe8d5afcb4b admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:13.744239 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb654735-ee46-4b6d-9500-bfe8d5afcb4b admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:13.749887 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d18576-0caa-4a43-aed7-ce02fee31766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:13.750548 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d18576-0caa-4a43-aed7-ce02fee31766 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:13.750878 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d18576-0caa-4a43-aed7-ce02fee31766 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:13.751152 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d18576-0caa-4a43-aed7-ce02fee31766 admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:13.751859 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d18576-0caa-4a43-aed7-ce02fee31766 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:13.754085 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d18576-0caa-4a43-aed7-ce02fee31766 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:14.065836 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 912/1820] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:51:13 2022] POST /identity/v3/users => generated 282 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:14.071213 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d18576-0caa-4a43-aed7-ce02fee31766 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:14.077318 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d18576-0caa-4a43-aed7-ce02fee31766 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:14.081931 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f91a62-3f42-46d7-8f7b-6fede8b04ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:14.082615 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f91a62-3f42-46d7-8f7b-6fede8b04ef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:14.082906 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f91a62-3f42-46d7-8f7b-6fede8b04ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:14.083183 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f91a62-3f42-46d7-8f7b-6fede8b04ef6 admin admin] PATH_INFO: `/v3/projects/aa19a60c6ead42ababbf01981e6bc575/users/8eac37e99f96450798837243b059e2dd/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:14.085145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f91a62-3f42-46d7-8f7b-6fede8b04ef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa19a60c6ead42ababbf01981e6bc575, user_id=8eac37e99f96450798837243b059e2dd, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:14.088613 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f91a62-3f42-46d7-8f7b-6fede8b04ef6 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:14.101407 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 913/1821] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:51:14 2022] PUT /identity/v3/projects/aa19a60c6ead42ababbf01981e6bc575/users/8eac37e99f96450798837243b059e2dd/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:14.112553 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f91a62-3f42-46d7-8f7b-6fede8b04ef6 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:14.112705 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a9a5091c-3a84-4ef6-9d29-0b81213c30f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '926bf93b7d214bb0a2c2ffdddc2f4323'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:14.164455 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f91a62-3f42-46d7-8f7b-6fede8b04ef6 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:14.169201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f39b95-87bc-411c-830c-ffb289fd3beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:14.169805 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f39b95-87bc-411c-830c-ffb289fd3beb admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:14.170091 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f39b95-87bc-411c-830c-ffb289fd3beb admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:14.170367 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f39b95-87bc-411c-830c-ffb289fd3beb admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:14.171093 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f39b95-87bc-411c-830c-ffb289fd3beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:14.172691 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f39b95-87bc-411c-830c-ffb289fd3beb admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:14.182600 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 914/1822] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:51:14.184644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555b230-6147-489f-b983-c70290129e49 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:14.184977 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555b230-6147-489f-b983-c70290129e49 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:14.185331 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555b230-6147-489f-b983-c70290129e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:14.202570 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a9a5091c-3a84-4ef6-9d29-0b81213c30f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '926bf93b7d214bb0a2c2ffdddc2f4323'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:14.206090 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a9a5091c-3a84-4ef6-9d29-0b81213c30f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '926bf93b7d214bb0a2c2ffdddc2f4323'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:14.206090 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a9a5091c-3a84-4ef6-9d29-0b81213c30f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '926bf93b7d214bb0a2c2ffdddc2f4323'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:14.212773 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a9a5091c-3a84-4ef6-9d29-0b81213c30f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '926bf93b7d214bb0a2c2ffdddc2f4323'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:14.213573 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-9555b230-6147-489f-b983-c70290129e49 None None] MFA Rules not processed for user `8eac37e99f96450798837243b059e2dd`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:14.214838 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-9555b230-6147-489f-b983-c70290129e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:14.230914 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 909/1823] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:51:13 2022] DELETE /identity/v3/users/926bf93b7d214bb0a2c2ffdddc2f4323 => generated 0 bytes in 791 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:14.237417 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5091c-3a84-4ef6-9d29-0b81213c30f4 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:14.237417 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-a9a5091c-3a84-4ef6-9d29-0b81213c30f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:14.287279 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 915/1824] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:14 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:14.293350 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3069dc1-a2c1-41c9-8276-a0c65e939506 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:14.293635 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3069dc1-a2c1-41c9-8276-a0c65e939506 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:14.294346 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3069dc1-a2c1-41c9-8276-a0c65e939506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:14.298922 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5091c-3a84-4ef6-9d29-0b81213c30f4 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:14.304107 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee717cb6-119c-4f48-a0a2-709b54995408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:14.304454 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee717cb6-119c-4f48-a0a2-709b54995408 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:14.305869 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee717cb6-119c-4f48-a0a2-709b54995408 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:14.306402 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee717cb6-119c-4f48-a0a2-709b54995408 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:14.308209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:14.309181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee717cb6-119c-4f48-a0a2-709b54995408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:14.312488 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee717cb6-119c-4f48-a0a2-709b54995408 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:14.315785 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-e3069dc1-a2c1-41c9-8276-a0c65e939506 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:14.316970 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-e3069dc1-a2c1-41c9-8276-a0c65e939506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:14.323757 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 910/1825] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:51:14.324709 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee717cb6-119c-4f48-a0a2-709b54995408 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:14.328994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 916/1826] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:14.329755 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-ee717cb6-119c-4f48-a0a2-709b54995408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:14.330344 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3069dc1-a2c1-41c9-8276-a0c65e939506 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:14.337989 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3069dc1-a2c1-41c9-8276-a0c65e939506 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:14.344188 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c705a-1128-4eb5-99e9-2ae789be5ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:14.347093 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c705a-1128-4eb5-99e9-2ae789be5ae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:14.347093 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c705a-1128-4eb5-99e9-2ae789be5ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:14.347093 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c705a-1128-4eb5-99e9-2ae789be5ae3 admin admin] PATH_INFO: `/v3/projects/5ee043250fd245e79a2371dbd2536740/users/f2f4d8895b564af4afd8e4d3e4783c9f/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:14.362609 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c705a-1128-4eb5-99e9-2ae789be5ae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ee043250fd245e79a2371dbd2536740, user_id=f2f4d8895b564af4afd8e4d3e4783c9f, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:14.367161 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c705a-1128-4eb5-99e9-2ae789be5ae3 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:14.393608 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee717cb6-119c-4f48-a0a2-709b54995408 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:14.397680 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63748ba4-f5cc-4256-8d05-c9c97d5610d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:14.398282 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63748ba4-f5cc-4256-8d05-c9c97d5610d9 service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:14.398650 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63748ba4-f5cc-4256-8d05-c9c97d5610d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:14.399331 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63748ba4-f5cc-4256-8d05-c9c97d5610d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:14.432225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 917/1827] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:51:14 2022] PUT /identity/v3/projects/5ee043250fd245e79a2371dbd2536740/users/f2f4d8895b564af4afd8e4d3e4783c9f/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:14.432225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c705a-1128-4eb5-99e9-2ae789be5ae3 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:14.438659 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-058c705a-1128-4eb5-99e9-2ae789be5ae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:14.483359 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63748ba4-f5cc-4256-8d05-c9c97d5610d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:14.485053 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63748ba4-f5cc-4256-8d05-c9c97d5610d9 service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:14.499367 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 911/1828] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:14 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:51:14.500949 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805f408-4f0e-4738-898f-723ac50dbff6 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:14.501424 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805f408-4f0e-4738-898f-723ac50dbff6 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:14.502025 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805f408-4f0e-4738-898f-723ac50dbff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:14.546278 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-4805f408-4f0e-4738-898f-723ac50dbff6 None None] MFA Rules not processed for user `f2f4d8895b564af4afd8e4d3e4783c9f`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:14.547508 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c705a-1128-4eb5-99e9-2ae789be5ae3 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:14.547632 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-4805f408-4f0e-4738-898f-723ac50dbff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:14.552398 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f2636-22a7-4a45-aac5-a9a51aa7c245 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:14.552967 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f2636-22a7-4a45-aac5-a9a51aa7c245 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:14.553919 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f2636-22a7-4a45-aac5-a9a51aa7c245 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:14.553919 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f2636-22a7-4a45-aac5-a9a51aa7c245 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:14.627866 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f2636-22a7-4a45-aac5-a9a51aa7c245 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:14.629400 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f2636-22a7-4a45-aac5-a9a51aa7c245 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:14.639140 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 912/1829] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:14.641209 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 918/1830] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:51:14.643563 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805f408-4f0e-4738-898f-723ac50dbff6 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:14.666201 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805f408-4f0e-4738-898f-723ac50dbff6 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:14.666201 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1f8aa-1929-4c7c-bb5d-466aa20f3b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:14.666386 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1f8aa-1929-4c7c-bb5d-466aa20f3b71 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:14.666688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1f8aa-1929-4c7c-bb5d-466aa20f3b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:14.666843 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1f8aa-1929-4c7c-bb5d-466aa20f3b71 admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:14.667498 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1f8aa-1929-4c7c-bb5d-466aa20f3b71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:14.669628 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1f8aa-1929-4c7c-bb5d-466aa20f3b71 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:14.802549 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 913/1831] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:51:14 2022] POST /identity/v3/projects => generated 365 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:14.804321 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f2636-22a7-4a45-aac5-a9a51aa7c245 service neutron] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:14.815431 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f2636-22a7-4a45-aac5-a9a51aa7c245 service neutron] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:14.937858 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200b050-16cd-453c-aac7-c8fda9914128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:14.938492 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200b050-16cd-453c-aac7-c8fda9914128 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:14.940459 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200b050-16cd-453c-aac7-c8fda9914128 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:14.940800 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200b050-16cd-453c-aac7-c8fda9914128 admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:14.941482 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c200b050-16cd-453c-aac7-c8fda9914128 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:14.943666 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c200b050-16cd-453c-aac7-c8fda9914128 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:15.062639 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1f8aa-1929-4c7c-bb5d-466aa20f3b71 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:15.069233 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 919/1832] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:51:14 2022] POST /identity/v3/users => generated 289 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:15.080314 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1f8aa-1929-4c7c-bb5d-466aa20f3b71 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:15.081401 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb509e-d648-410c-b7e7-66b6c7dc0174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:15.082132 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb509e-d648-410c-b7e7-66b6c7dc0174 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:15.082479 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb509e-d648-410c-b7e7-66b6c7dc0174 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:15.082943 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb509e-d648-410c-b7e7-66b6c7dc0174 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:15.083556 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb509e-d648-410c-b7e7-66b6c7dc0174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:15.085321 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb509e-d648-410c-b7e7-66b6c7dc0174 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:15.097089 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 914/1833] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:51:15.102928 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200b050-16cd-453c-aac7-c8fda9914128 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:15.114116 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200b050-16cd-453c-aac7-c8fda9914128 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:15.119906 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b4abe-2610-4ed2-a242-39f517b5373a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:15.120576 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b4abe-2610-4ed2-a242-39f517b5373a admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:15.120925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b4abe-2610-4ed2-a242-39f517b5373a admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:15.121235 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b4abe-2610-4ed2-a242-39f517b5373a admin admin] PATH_INFO: `/v3/projects/af8e8c0d38f34693915bedbab9bfb8b1/users/ce93114a547e4aa09ef60af8f5f7caa5/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:15.136824 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b4abe-2610-4ed2-a242-39f517b5373a admin admin] RBAC: Authorizing `identity:create_grant(project_id=af8e8c0d38f34693915bedbab9bfb8b1, user_id=ce93114a547e4aa09ef60af8f5f7caa5, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:15.139521 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b4abe-2610-4ed2-a242-39f517b5373a admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:15.154619 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb509e-d648-410c-b7e7-66b6c7dc0174 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:15.154619 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-62cb509e-d648-410c-b7e7-66b6c7dc0174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:15.165381 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb509e-d648-410c-b7e7-66b6c7dc0174 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:15.170373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ca2d5-78a9-4e80-a31f-7ffbd735bffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:15.171071 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ca2d5-78a9-4e80-a31f-7ffbd735bffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:15.171347 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ca2d5-78a9-4e80-a31f-7ffbd735bffe admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:15.171689 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ca2d5-78a9-4e80-a31f-7ffbd735bffe admin admin] PATH_INFO: `/v3/projects/ea2a5ddad821434bbebe157f142f80ba` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:15.173169 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ca2d5-78a9-4e80-a31f-7ffbd735bffe admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea2a5ddad821434bbebe157f142f80ba)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:15.175110 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ca2d5-78a9-4e80-a31f-7ffbd735bffe admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:15.237846 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 920/1834] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:51:15 2022] PUT /identity/v3/projects/af8e8c0d38f34693915bedbab9bfb8b1/users/ce93114a547e4aa09ef60af8f5f7caa5/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:15.238699 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b4abe-2610-4ed2-a242-39f517b5373a admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:15.241385 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-ef1b4abe-2610-4ed2-a242-39f517b5373a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:15.306831 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-df6ca2d5-78a9-4e80-a31f-7ffbd735bffe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea2a5ddad821434bbebe157f142f80ba', 'request_id': 'req-df6ca2d5-78a9-4e80-a31f-7ffbd735bffe'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:15.310676 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b4abe-2610-4ed2-a242-39f517b5373a admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:15.312234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-df6ca2d5-78a9-4e80-a31f-7ffbd735bffe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea2a5ddad821434bbebe157f142f80ba', 'request_id': 'req-df6ca2d5-78a9-4e80-a31f-7ffbd735bffe'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:15.367846 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a691d-1f0e-49c1-8a59-624c9633015d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:15.368661 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a691d-1f0e-49c1-8a59-624c9633015d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:15.368945 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a691d-1f0e-49c1-8a59-624c9633015d admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:15.369271 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a691d-1f0e-49c1-8a59-624c9633015d admin admin] PATH_INFO: `/v3/users/620a285fb6164cc1a2854530a9ee9b2d` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:15.370419 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a691d-1f0e-49c1-8a59-624c9633015d admin admin] RBAC: Authorizing `identity:delete_user(user_id=620a285fb6164cc1a2854530a9ee9b2d)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:15.372381 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a691d-1f0e-49c1-8a59-624c9633015d admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:15.402906 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-df6ca2d5-78a9-4e80-a31f-7ffbd735bffe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea2a5ddad821434bbebe157f142f80ba', 'request_id': 'req-df6ca2d5-78a9-4e80-a31f-7ffbd735bffe'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:15.415877 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-df6ca2d5-78a9-4e80-a31f-7ffbd735bffe admin admin] The token cache is being invalidate because project ea2a5ddad821434bbebe157f142f80ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:51:15.416161 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-df6ca2d5-78a9-4e80-a31f-7ffbd735bffe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:15.416818 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-df6ca2d5-78a9-4e80-a31f-7ffbd735bffe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:15.418341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 915/1835] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:51:15 2022] DELETE /identity/v3/projects/ea2a5ddad821434bbebe157f142f80ba => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:51:15.421393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ca2d5-78a9-4e80-a31f-7ffbd735bffe admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:15.421393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-df6ca2d5-78a9-4e80-a31f-7ffbd735bffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:15.432814 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ca2d5-78a9-4e80-a31f-7ffbd735bffe admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:15.437675 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b0f39-0e46-4d95-97ab-03dc2c1a785b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:15.438266 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b0f39-0e46-4d95-97ab-03dc2c1a785b admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:15.438546 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b0f39-0e46-4d95-97ab-03dc2c1a785b admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:15.438868 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b0f39-0e46-4d95-97ab-03dc2c1a785b admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:15.439461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b0f39-0e46-4d95-97ab-03dc2c1a785b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:15.441122 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b0f39-0e46-4d95-97ab-03dc2c1a785b admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:15.450882 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 916/1836] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:51:15.451797 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b0f39-0e46-4d95-97ab-03dc2c1a785b admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:15.453494 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-1c3b0f39-0e46-4d95-97ab-03dc2c1a785b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:15.467587 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b0f39-0e46-4d95-97ab-03dc2c1a785b admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:15.472243 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d701b-a017-464f-bd4c-5975d1428ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:15.472832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d701b-a017-464f-bd4c-5975d1428ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:15.473160 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d701b-a017-464f-bd4c-5975d1428ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:15.473436 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d701b-a017-464f-bd4c-5975d1428ca8 admin admin] PATH_INFO: `/v3/users/88612baa62de4680bb33ac8781b2f0d9` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:15.474551 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684d701b-a017-464f-bd4c-5975d1428ca8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88612baa62de4680bb33ac8781b2f0d9)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:15.476470 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684d701b-a017-464f-bd4c-5975d1428ca8 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:15.582707 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-175a691d-1f0e-49c1-8a59-624c9633015d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '620a285fb6164cc1a2854530a9ee9b2d'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:15.638100 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:15.638942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-175a691d-1f0e-49c1-8a59-624c9633015d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '620a285fb6164cc1a2854530a9ee9b2d'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:15.639711 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-175a691d-1f0e-49c1-8a59-624c9633015d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '620a285fb6164cc1a2854530a9ee9b2d'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:15.640450 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-175a691d-1f0e-49c1-8a59-624c9633015d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '620a285fb6164cc1a2854530a9ee9b2d'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:15.648046 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-175a691d-1f0e-49c1-8a59-624c9633015d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '620a285fb6164cc1a2854530a9ee9b2d'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:15.651082 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-684d701b-a017-464f-bd4c-5975d1428ca8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88612baa62de4680bb33ac8781b2f0d9'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:15.666157 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 921/1837] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:51:15 2022] DELETE /identity/v3/users/620a285fb6164cc1a2854530a9ee9b2d => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:15.667306 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a691d-1f0e-49c1-8a59-624c9633015d admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:15.668658 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-175a691d-1f0e-49c1-8a59-624c9633015d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:15.728502 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-684d701b-a017-464f-bd4c-5975d1428ca8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88612baa62de4680bb33ac8781b2f0d9'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:15.729541 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-684d701b-a017-464f-bd4c-5975d1428ca8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88612baa62de4680bb33ac8781b2f0d9'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:15.730186 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-684d701b-a017-464f-bd4c-5975d1428ca8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88612baa62de4680bb33ac8781b2f0d9'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:15.736767 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a691d-1f0e-49c1-8a59-624c9633015d admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:15.741682 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-684d701b-a017-464f-bd4c-5975d1428ca8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88612baa62de4680bb33ac8781b2f0d9'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:15.743137 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d9ddf-7f35-4ccf-b8df-ee27b5b91a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:15.743817 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d9ddf-7f35-4ccf-b8df-ee27b5b91a5f admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:15.744428 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d9ddf-7f35-4ccf-b8df-ee27b5b91a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:15.744533 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d9ddf-7f35-4ccf-b8df-ee27b5b91a5f admin admin] PATH_INFO: `/v3/projects/af8e8c0d38f34693915bedbab9bfb8b1/users/ce93114a547e4aa09ef60af8f5f7caa5/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:15.747025 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d9ddf-7f35-4ccf-b8df-ee27b5b91a5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=af8e8c0d38f34693915bedbab9bfb8b1, user_id=ce93114a547e4aa09ef60af8f5f7caa5, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:15.749795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d9ddf-7f35-4ccf-b8df-ee27b5b91a5f admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:15.771017 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 922/1839] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:51:15 2022] PUT /identity/v3/projects/af8e8c0d38f34693915bedbab9bfb8b1/users/ce93114a547e4aa09ef60af8f5f7caa5/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:15.771498 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 917/1839] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:51:15 2022] DELETE /identity/v3/users/88612baa62de4680bb33ac8781b2f0d9 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:15.771586 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b0dae-30b3-4d4b-9e05-1c3acf3037ad None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:15.771586 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b0dae-30b3-4d4b-9e05-1c3acf3037ad None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:15.771586 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b0dae-30b3-4d4b-9e05-1c3acf3037ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:15.772647 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d59af3-5cb7-4ef1-b0fa-08dd2d67ede8 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:15.772930 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d59af3-5cb7-4ef1-b0fa-08dd2d67ede8 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:15.773372 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d59af3-5cb7-4ef1-b0fa-08dd2d67ede8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:15.804003 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-7b9b0dae-30b3-4d4b-9e05-1c3acf3037ad None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:15.806974 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-7b9b0dae-30b3-4d4b-9e05-1c3acf3037ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:15.812667 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-83d59af3-5cb7-4ef1-b0fa-08dd2d67ede8 None None] MFA Rules not processed for user `ce93114a547e4aa09ef60af8f5f7caa5`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:15.814366 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-83d59af3-5cb7-4ef1-b0fa-08dd2d67ede8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:15.907629 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 918/1840] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:15 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:15.923678 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 923/1841] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:15.934475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d59af3-5cb7-4ef1-b0fa-08dd2d67ede8 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:15.936609 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-83d59af3-5cb7-4ef1-b0fa-08dd2d67ede8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:15.941807 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b0dae-30b3-4d4b-9e05-1c3acf3037ad None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:15.946674 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-7b9b0dae-30b3-4d4b-9e05-1c3acf3037ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:16.001914 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:16.021996 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b0dae-30b3-4d4b-9e05-1c3acf3037ad None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:16.031779 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0e054-cdb7-4267-97ed-284b9db13cc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:16.032409 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0e054-cdb7-4267-97ed-284b9db13cc1 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:16.032689 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0e054-cdb7-4267-97ed-284b9db13cc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:16.033079 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0e054-cdb7-4267-97ed-284b9db13cc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:16.044571 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0e054-cdb7-4267-97ed-284b9db13cc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:16.046133 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0e054-cdb7-4267-97ed-284b9db13cc1 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:16.056418 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d59af3-5cb7-4ef1-b0fa-08dd2d67ede8 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:16.062315 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de80a55-0131-4541-803c-febf6f2dc9fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:16.063004 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de80a55-0131-4541-803c-febf6f2dc9fe service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:16.063304 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de80a55-0131-4541-803c-febf6f2dc9fe service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:16.063585 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de80a55-0131-4541-803c-febf6f2dc9fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:16.065764 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 924/1842] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:51:16.075487 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de80a55-0131-4541-803c-febf6f2dc9fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:16.077433 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de80a55-0131-4541-803c-febf6f2dc9fe service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:16.089587 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 919/1843] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:15 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:51:16.344718 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0e054-cdb7-4267-97ed-284b9db13cc1 service neutron] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:16.346343 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-b0f0e054-cdb7-4267-97ed-284b9db13cc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:16.376419 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0e054-cdb7-4267-97ed-284b9db13cc1 service neutron] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:16.403970 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a21535-0548-4fed-9f6c-f29247803ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:16.405101 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a21535-0548-4fed-9f6c-f29247803ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:16.405658 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a21535-0548-4fed-9f6c-f29247803ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:16.406243 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a21535-0548-4fed-9f6c-f29247803ccc admin admin] PATH_INFO: `/v3/projects/9c8e6aeb120342198f05a3b3737e5d43` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:16.408826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a21535-0548-4fed-9f6c-f29247803ccc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c8e6aeb120342198f05a3b3737e5d43)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:16.411514 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a21535-0548-4fed-9f6c-f29247803ccc admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:16.489567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de80a55-0131-4541-803c-febf6f2dc9fe service cinder] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:16.489567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de80a55-0131-4541-803c-febf6f2dc9fe service cinder] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:16.489567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41e5d8-a0ed-444d-9507-9b37c6f6b8ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:16.489567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41e5d8-a0ed-444d-9507-9b37c6f6b8ed service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:16.490301 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41e5d8-a0ed-444d-9507-9b37c6f6b8ed service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:16.490301 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41e5d8-a0ed-444d-9507-9b37c6f6b8ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:16.490301 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-fa41e5d8-a0ed-444d-9507-9b37c6f6b8ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:16.534577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41e5d8-a0ed-444d-9507-9b37c6f6b8ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:16.536272 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41e5d8-a0ed-444d-9507-9b37c6f6b8ed service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:16.537557 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-84a21535-0548-4fed-9f6c-f29247803ccc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c8e6aeb120342198f05a3b3737e5d43', 'request_id': 'req-84a21535-0548-4fed-9f6c-f29247803ccc'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:16.547152 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-84a21535-0548-4fed-9f6c-f29247803ccc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c8e6aeb120342198f05a3b3737e5d43', 'request_id': 'req-84a21535-0548-4fed-9f6c-f29247803ccc'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:16.561520 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 920/1844] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:51:16.625902 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-84a21535-0548-4fed-9f6c-f29247803ccc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c8e6aeb120342198f05a3b3737e5d43', 'request_id': 'req-84a21535-0548-4fed-9f6c-f29247803ccc'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:16.637999 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-84a21535-0548-4fed-9f6c-f29247803ccc admin admin] The token cache is being invalidate because project 9c8e6aeb120342198f05a3b3737e5d43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:51:16.638301 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-84a21535-0548-4fed-9f6c-f29247803ccc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:16.638961 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-84a21535-0548-4fed-9f6c-f29247803ccc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:16.640471 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 925/1845] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:51:16 2022] DELETE /identity/v3/projects/9c8e6aeb120342198f05a3b3737e5d43 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:16.645361 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa1221-6a18-4daa-8f17-787bf4f6b9c5 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:16.645645 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa1221-6a18-4daa-8f17-787bf4f6b9c5 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:16.645939 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa1221-6a18-4daa-8f17-787bf4f6b9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:16.667625 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-defa1221-6a18-4daa-8f17-787bf4f6b9c5 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:16.668872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-defa1221-6a18-4daa-8f17-787bf4f6b9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:16.736124 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 921/1846] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:51:16.744042 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3075b-14a7-4002-b0aa-6837b8b81a11 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:16.744382 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3075b-14a7-4002-b0aa-6837b8b81a11 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:16.744667 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3075b-14a7-4002-b0aa-6837b8b81a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:16.764420 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-f6c3075b-14a7-4002-b0aa-6837b8b81a11 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:16.765667 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-f6c3075b-14a7-4002-b0aa-6837b8b81a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:16.773670 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 926/1847] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:51:16.778917 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa1221-6a18-4daa-8f17-787bf4f6b9c5 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:16.788306 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa1221-6a18-4daa-8f17-787bf4f6b9c5 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:16.794040 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d86661-5b6d-4ca6-9ef1-d180fe6c76ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:16.794634 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d86661-5b6d-4ca6-9ef1-d180fe6c76ea admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:16.794910 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d86661-5b6d-4ca6-9ef1-d180fe6c76ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:16.795181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d86661-5b6d-4ca6-9ef1-d180fe6c76ea admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:16.795896 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d86661-5b6d-4ca6-9ef1-d180fe6c76ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:51:16.796185 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d86661-5b6d-4ca6-9ef1-d180fe6c76ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:16.797898 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d86661-5b6d-4ca6-9ef1-d180fe6c76ea admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:16.810185 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3075b-14a7-4002-b0aa-6837b8b81a11 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:16.811623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-f6c3075b-14a7-4002-b0aa-6837b8b81a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:16.812786 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 922/1848] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:51:16.817095 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d86661-5b6d-4ca6-9ef1-d180fe6c76ea admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:16.825369 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3075b-14a7-4002-b0aa-6837b8b81a11 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:16.828163 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d86661-5b6d-4ca6-9ef1-d180fe6c76ea admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:16.830489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373abb5-9d9c-450e-af7f-456f1ed87f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:16.831310 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373abb5-9d9c-450e-af7f-456f1ed87f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:16.831751 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373abb5-9d9c-450e-af7f-456f1ed87f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:16.832029 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373abb5-9d9c-450e-af7f-456f1ed87f2a admin admin] PATH_INFO: `/v3/projects/5152d54533c74335ab86f81ac8ef76c0` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:16.833190 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5373abb5-9d9c-450e-af7f-456f1ed87f2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5152d54533c74335ab86f81ac8ef76c0)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:16.834619 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a2e84-d0a0-48a9-86e5-94a5670f8632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:16.835259 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a2e84-d0a0-48a9-86e5-94a5670f8632 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:16.835561 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a2e84-d0a0-48a9-86e5-94a5670f8632 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:16.835842 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a2e84-d0a0-48a9-86e5-94a5670f8632 admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:16.836227 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5373abb5-9d9c-450e-af7f-456f1ed87f2a admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:16.836496 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a2e84-d0a0-48a9-86e5-94a5670f8632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:16.838939 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a2e84-d0a0-48a9-86e5-94a5670f8632 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:16.947416 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 923/1849] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:51:16 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:51:16.951214 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a2e84-d0a0-48a9-86e5-94a5670f8632 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:16.993257 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-5373abb5-9d9c-450e-af7f-456f1ed87f2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5152d54533c74335ab86f81ac8ef76c0', 'request_id': 'req-5373abb5-9d9c-450e-af7f-456f1ed87f2a'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:16.999334 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-5373abb5-9d9c-450e-af7f-456f1ed87f2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5152d54533c74335ab86f81ac8ef76c0', 'request_id': 'req-5373abb5-9d9c-450e-af7f-456f1ed87f2a'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:17.016250 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a2e84-d0a0-48a9-86e5-94a5670f8632 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:17.075940 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-5373abb5-9d9c-450e-af7f-456f1ed87f2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5152d54533c74335ab86f81ac8ef76c0', 'request_id': 'req-5373abb5-9d9c-450e-af7f-456f1ed87f2a'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:17.083156 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7fcb3-0453-44f3-bfa4-cbadf758d834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:17.083778 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7fcb3-0453-44f3-bfa4-cbadf758d834 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:17.084169 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7fcb3-0453-44f3-bfa4-cbadf758d834 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:17.084475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7fcb3-0453-44f3-bfa4-cbadf758d834 admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:17.085145 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7fcb3-0453-44f3-bfa4-cbadf758d834 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:17.085682 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-5373abb5-9d9c-450e-af7f-456f1ed87f2a admin admin] The token cache is being invalidate because project 5152d54533c74335ab86f81ac8ef76c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:51:17.085979 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-5373abb5-9d9c-450e-af7f-456f1ed87f2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:17.086908 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-5373abb5-9d9c-450e-af7f-456f1ed87f2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:17.087107 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7fcb3-0453-44f3-bfa4-cbadf758d834 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:17.090023 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 927/1850] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:51:16 2022] DELETE /identity/v3/projects/5152d54533c74335ab86f81ac8ef76c0 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:51:17.094244 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373abb5-9d9c-450e-af7f-456f1ed87f2a admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:17.095650 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-5373abb5-9d9c-450e-af7f-456f1ed87f2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:17.109182 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373abb5-9d9c-450e-af7f-456f1ed87f2a admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:17.115231 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fec9ed-fb4f-4cb7-8c0d-dbdcfadd9e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:17.115880 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fec9ed-fb4f-4cb7-8c0d-dbdcfadd9e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:17.116143 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fec9ed-fb4f-4cb7-8c0d-dbdcfadd9e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:17.116446 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fec9ed-fb4f-4cb7-8c0d-dbdcfadd9e54 admin admin] PATH_INFO: `/v3/users/8eac37e99f96450798837243b059e2dd` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:17.117616 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fec9ed-fb4f-4cb7-8c0d-dbdcfadd9e54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eac37e99f96450798837243b059e2dd)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:17.119569 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fec9ed-fb4f-4cb7-8c0d-dbdcfadd9e54 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:17.186571 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 924/1851] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:51:16 2022] POST /identity/v3/users => generated 290 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:51:17.190764 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7fcb3-0453-44f3-bfa4-cbadf758d834 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:17.192408 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-5ef7fcb3-0453-44f3-bfa4-cbadf758d834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:17.205482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7fcb3-0453-44f3-bfa4-cbadf758d834 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:17.210350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934bb664-f63a-46f7-8ec5-b9bec9f876d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:17.210978 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bb664-f63a-46f7-8ec5-b9bec9f876d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:17.211263 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bb664-f63a-46f7-8ec5-b9bec9f876d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:17.211547 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bb664-f63a-46f7-8ec5-b9bec9f876d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:17.212191 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934bb664-f63a-46f7-8ec5-b9bec9f876d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:17.214794 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934bb664-f63a-46f7-8ec5-b9bec9f876d1 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:17.225160 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 925/1852] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:51:17.229698 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934bb664-f63a-46f7-8ec5-b9bec9f876d1 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:17.239317 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934bb664-f63a-46f7-8ec5-b9bec9f876d1 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:17.243932 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54133abc-037c-414b-8d1a-5e8e11e4c880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:17.244737 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54133abc-037c-414b-8d1a-5e8e11e4c880 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:17.245234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54133abc-037c-414b-8d1a-5e8e11e4c880 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:17.245515 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54133abc-037c-414b-8d1a-5e8e11e4c880 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:17.246148 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54133abc-037c-414b-8d1a-5e8e11e4c880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:17.247737 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54133abc-037c-414b-8d1a-5e8e11e4c880 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:17.260583 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 926/1853] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:51:17.263798 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54133abc-037c-414b-8d1a-5e8e11e4c880 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:17.273574 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54133abc-037c-414b-8d1a-5e8e11e4c880 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:17.279004 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113daa02-81ca-4df1-aad5-c767f750e107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:17.279648 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113daa02-81ca-4df1-aad5-c767f750e107 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:17.279925 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113daa02-81ca-4df1-aad5-c767f750e107 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:17.280196 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113daa02-81ca-4df1-aad5-c767f750e107 admin admin] PATH_INFO: `/v3/projects/69990ad3e8584b29b09163f3532eb393/users/f00d6f64b71e43e8be8be422378dd785/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:17.295254 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113daa02-81ca-4df1-aad5-c767f750e107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69990ad3e8584b29b09163f3532eb393, user_id=f00d6f64b71e43e8be8be422378dd785, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:17.298106 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113daa02-81ca-4df1-aad5-c767f750e107 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:17.326344 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-98fec9ed-fb4f-4cb7-8c0d-dbdcfadd9e54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eac37e99f96450798837243b059e2dd'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:17.392632 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 927/1854] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:51:17 2022] PUT /identity/v3/projects/69990ad3e8584b29b09163f3532eb393/users/f00d6f64b71e43e8be8be422378dd785/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:51:17.397636 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-98fec9ed-fb4f-4cb7-8c0d-dbdcfadd9e54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eac37e99f96450798837243b059e2dd'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:17.398719 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-98fec9ed-fb4f-4cb7-8c0d-dbdcfadd9e54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eac37e99f96450798837243b059e2dd'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:17.399428 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-98fec9ed-fb4f-4cb7-8c0d-dbdcfadd9e54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eac37e99f96450798837243b059e2dd'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:17.403531 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a30e2-609c-4c44-aad6-603bbef76568 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:17.404334 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a30e2-609c-4c44-aad6-603bbef76568 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:17.404334 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a30e2-609c-4c44-aad6-603bbef76568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:17.413330 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-98fec9ed-fb4f-4cb7-8c0d-dbdcfadd9e54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eac37e99f96450798837243b059e2dd'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:17.433388 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-f02a30e2-609c-4c44-aad6-603bbef76568 None None] MFA Rules not processed for user `f00d6f64b71e43e8be8be422378dd785`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:17.434749 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-f02a30e2-609c-4c44-aad6-603bbef76568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:17.435440 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 928/1855] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:51:17 2022] DELETE /identity/v3/users/8eac37e99f96450798837243b059e2dd => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:51:17.545376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 928/1856] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:17.550013 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fec9ed-fb4f-4cb7-8c0d-dbdcfadd9e54 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:17.551477 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-98fec9ed-fb4f-4cb7-8c0d-dbdcfadd9e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:17.639360 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fec9ed-fb4f-4cb7-8c0d-dbdcfadd9e54 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:17.652884 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2f04b-80a1-4172-ae0c-ec15442d0cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:17.652884 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2f04b-80a1-4172-ae0c-ec15442d0cce admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:17.652884 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2f04b-80a1-4172-ae0c-ec15442d0cce admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:17.652884 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2f04b-80a1-4172-ae0c-ec15442d0cce admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:17.653393 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2f04b-80a1-4172-ae0c-ec15442d0cce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:17.655236 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2f04b-80a1-4172-ae0c-ec15442d0cce admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:17.762487 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 929/1857] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:51:17 2022] POST /identity/v3/projects => generated 379 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:17.766400 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a30e2-609c-4c44-aad6-603bbef76568 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:17.786460 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a30e2-609c-4c44-aad6-603bbef76568 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:17.871920 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bb87e-4867-4136-a0cf-812b3da8a4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:17.873443 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bb87e-4867-4136-a0cf-812b3da8a4f5 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:17.873933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bb87e-4867-4136-a0cf-812b3da8a4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:17.874955 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bb87e-4867-4136-a0cf-812b3da8a4f5 admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:17.876038 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275bb87e-4867-4136-a0cf-812b3da8a4f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:17.879359 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275bb87e-4867-4136-a0cf-812b3da8a4f5 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:18.047738 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 929/1858] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:51:17 2022] POST /identity/v3/users => generated 290 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:18.048099 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2f04b-80a1-4172-ae0c-ec15442d0cce admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:18.061099 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2f04b-80a1-4172-ae0c-ec15442d0cce admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:18.069699 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d45ea8-07cf-43b4-854a-8adcb88a1f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:18.076682 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d45ea8-07cf-43b4-854a-8adcb88a1f13 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:18.076682 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d45ea8-07cf-43b4-854a-8adcb88a1f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:18.076682 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d45ea8-07cf-43b4-854a-8adcb88a1f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:18.076682 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d45ea8-07cf-43b4-854a-8adcb88a1f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:18.076682 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d45ea8-07cf-43b4-854a-8adcb88a1f13 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:18.079715 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bb87e-4867-4136-a0cf-812b3da8a4f5 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:18.083508 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-275bb87e-4867-4136-a0cf-812b3da8a4f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:18.090038 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 930/1859] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:51:18.094108 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d45ea8-07cf-43b4-854a-8adcb88a1f13 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:18.099325 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bb87e-4867-4136-a0cf-812b3da8a4f5 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:18.105687 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef2add-343b-4287-b24e-3f1453543213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:18.106337 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef2add-343b-4287-b24e-3f1453543213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:18.106617 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef2add-343b-4287-b24e-3f1453543213 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:18.106893 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef2add-343b-4287-b24e-3f1453543213 admin admin] PATH_INFO: `/v3/projects/aa19a60c6ead42ababbf01981e6bc575` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:18.108064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef2add-343b-4287-b24e-3f1453543213 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa19a60c6ead42ababbf01981e6bc575)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:18.110704 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef2add-343b-4287-b24e-3f1453543213 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:18.118795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d45ea8-07cf-43b4-854a-8adcb88a1f13 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:18.136182 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226a123-bdb9-44fa-9179-784db5d4e77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:18.136825 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226a123-bdb9-44fa-9179-784db5d4e77b admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:18.137172 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226a123-bdb9-44fa-9179-784db5d4e77b admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:18.137489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226a123-bdb9-44fa-9179-784db5d4e77b admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:18.138182 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226a123-bdb9-44fa-9179-784db5d4e77b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:18.139817 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226a123-bdb9-44fa-9179-784db5d4e77b admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:18.151733 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 931/1860] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:51:18.156119 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226a123-bdb9-44fa-9179-784db5d4e77b admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:18.171841 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226a123-bdb9-44fa-9179-784db5d4e77b admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:18.176968 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d9cd9-d5fa-4634-8f47-2d7d92b46ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:18.177635 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d9cd9-d5fa-4634-8f47-2d7d92b46ee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:18.178140 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d9cd9-d5fa-4634-8f47-2d7d92b46ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:18.178408 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d9cd9-d5fa-4634-8f47-2d7d92b46ee7 admin admin] PATH_INFO: `/v3/projects/294af6f6d6d747eda8c11fe84a2476f3/users/ce5a2bcf9579459aa6f2ea351968224e/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:18.194872 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d9cd9-d5fa-4634-8f47-2d7d92b46ee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=294af6f6d6d747eda8c11fe84a2476f3, user_id=ce5a2bcf9579459aa6f2ea351968224e, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:18.197804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d9cd9-d5fa-4634-8f47-2d7d92b46ee7 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:18.280656 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 932/1861] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:51:18 2022] PUT /identity/v3/projects/294af6f6d6d747eda8c11fe84a2476f3/users/ce5a2bcf9579459aa6f2ea351968224e/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:51:18.285485 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-bcef2add-343b-4287-b24e-3f1453543213 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa19a60c6ead42ababbf01981e6bc575', 'request_id': 'req-bcef2add-343b-4287-b24e-3f1453543213'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:18.293832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-bcef2add-343b-4287-b24e-3f1453543213 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa19a60c6ead42ababbf01981e6bc575', 'request_id': 'req-bcef2add-343b-4287-b24e-3f1453543213'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:18.295934 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93636c-8d1e-44be-b6fa-b85bdea6b1a8 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:18.296699 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93636c-8d1e-44be-b6fa-b85bdea6b1a8 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:18.297194 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93636c-8d1e-44be-b6fa-b85bdea6b1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:18.330000 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-ac93636c-8d1e-44be-b6fa-b85bdea6b1a8 None None] MFA Rules not processed for user `ce5a2bcf9579459aa6f2ea351968224e`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:18.331613 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-ac93636c-8d1e-44be-b6fa-b85bdea6b1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:18.363937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-bcef2add-343b-4287-b24e-3f1453543213 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa19a60c6ead42ababbf01981e6bc575', 'request_id': 'req-bcef2add-343b-4287-b24e-3f1453543213'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:18.386750 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:18.405361 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-bcef2add-343b-4287-b24e-3f1453543213 admin admin] The token cache is being invalidate because project aa19a60c6ead42ababbf01981e6bc575 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:51:18.405651 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-bcef2add-343b-4287-b24e-3f1453543213 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:18.406312 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-bcef2add-343b-4287-b24e-3f1453543213 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:18.408178 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 930/1862] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:51:18 2022] DELETE /identity/v3/projects/aa19a60c6ead42ababbf01981e6bc575 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:51:18.412941 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d5755-69f7-4d2e-93d1-ef06100bc22f None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:18.413298 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d5755-69f7-4d2e-93d1-ef06100bc22f None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:18.413577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d5755-69f7-4d2e-93d1-ef06100bc22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:18.433082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 933/1863] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:18.434092 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93636c-8d1e-44be-b6fa-b85bdea6b1a8 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:18.448151 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-cd4d5755-69f7-4d2e-93d1-ef06100bc22f None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:18.449482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-cd4d5755-69f7-4d2e-93d1-ef06100bc22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:18.514358 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93636c-8d1e-44be-b6fa-b85bdea6b1a8 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:18.521339 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3eae3-6200-4c95-b5a5-5db2176f3dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:18.522406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3eae3-6200-4c95-b5a5-5db2176f3dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:18.522691 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3eae3-6200-4c95-b5a5-5db2176f3dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:18.523076 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3eae3-6200-4c95-b5a5-5db2176f3dd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:18.524292 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3eae3-6200-4c95-b5a5-5db2176f3dd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:18.526343 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3eae3-6200-4c95-b5a5-5db2176f3dd3 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:18.554011 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 931/1864] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:51:18.561867 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2637e-42a0-4e14-8932-3b1830e4451a None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:18.562332 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2637e-42a0-4e14-8932-3b1830e4451a None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:18.562745 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2637e-42a0-4e14-8932-3b1830e4451a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:18.584851 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-bfe2637e-42a0-4e14-8932-3b1830e4451a None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:18.586171 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-bfe2637e-42a0-4e14-8932-3b1830e4451a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:18.595824 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 932/1865] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:51:18.599810 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2637e-42a0-4e14-8932-3b1830e4451a None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:18.609504 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2637e-42a0-4e14-8932-3b1830e4451a None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:18.614175 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d3d95-d165-41bc-a5d0-7dd2750be977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:18.614764 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d3d95-d165-41bc-a5d0-7dd2750be977 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:18.615041 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d3d95-d165-41bc-a5d0-7dd2750be977 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:18.615311 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d3d95-d165-41bc-a5d0-7dd2750be977 admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:18.615957 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d3d95-d165-41bc-a5d0-7dd2750be977 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:51:18.616259 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d3d95-d165-41bc-a5d0-7dd2750be977 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:18.617882 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d3d95-d165-41bc-a5d0-7dd2750be977 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:18.630682 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 933/1866] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:51:18.637293 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d3d95-d165-41bc-a5d0-7dd2750be977 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:18.643292 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 934/1867] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:51:18 2022] POST /identity/v3/projects => generated 379 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:18.647288 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3eae3-6200-4c95-b5a5-5db2176f3dd3 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:18.649241 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-d1c3eae3-6200-4c95-b5a5-5db2176f3dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:18.650224 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d3d95-d165-41bc-a5d0-7dd2750be977 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:18.725249 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004e1b7-9cde-485a-8b78-2777c55ea716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:18.725920 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004e1b7-9cde-485a-8b78-2777c55ea716 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:18.726210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004e1b7-9cde-485a-8b78-2777c55ea716 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:18.726491 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004e1b7-9cde-485a-8b78-2777c55ea716 admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:18.727202 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004e1b7-9cde-485a-8b78-2777c55ea716 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:18.729840 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004e1b7-9cde-485a-8b78-2777c55ea716 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:18.763736 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:18.789178 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3eae3-6200-4c95-b5a5-5db2176f3dd3 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:18.797993 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cf260-dc54-4313-aad1-bf4cdcec0bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:18.799492 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cf260-dc54-4313-aad1-bf4cdcec0bdd admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:18.799967 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cf260-dc54-4313-aad1-bf4cdcec0bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:18.800405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cf260-dc54-4313-aad1-bf4cdcec0bdd admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:18.801786 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cf260-dc54-4313-aad1-bf4cdcec0bdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:18.805237 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cf260-dc54-4313-aad1-bf4cdcec0bdd admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:18.867759 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 934/1868] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:51:18 2022] POST /identity/v3/projects => generated 359 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:18.870618 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004e1b7-9cde-485a-8b78-2777c55ea716 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:18.893293 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 935/1869] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:51:18 2022] POST /identity/v3/users => generated 296 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:51:18.900240 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cf260-dc54-4313-aad1-bf4cdcec0bdd admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:18.911756 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cf260-dc54-4313-aad1-bf4cdcec0bdd admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:18.976707 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004e1b7-9cde-485a-8b78-2777c55ea716 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:18.983475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284a030-ac14-4afb-94e7-195383e39e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:18.984259 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284a030-ac14-4afb-94e7-195383e39e1f admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:18.984698 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284a030-ac14-4afb-94e7-195383e39e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:18.984889 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284a030-ac14-4afb-94e7-195383e39e1f admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:18.989581 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c284a030-ac14-4afb-94e7-195383e39e1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:18.990335 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c6993-c0e9-4428-bb08-ec98c49e3b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:18.990335 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c6993-c0e9-4428-bb08-ec98c49e3b15 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:18.990529 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c284a030-ac14-4afb-94e7-195383e39e1f admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:18.990622 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c6993-c0e9-4428-bb08-ec98c49e3b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:18.990622 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c6993-c0e9-4428-bb08-ec98c49e3b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:18.990622 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c6993-c0e9-4428-bb08-ec98c49e3b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:18.991862 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c6993-c0e9-4428-bb08-ec98c49e3b15 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:19.005141 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 936/1870] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:51:19.009150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c6993-c0e9-4428-bb08-ec98c49e3b15 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:19.022128 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c6993-c0e9-4428-bb08-ec98c49e3b15 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:19.027486 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749fb88-6839-4320-bf0e-429f09f545e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:19.028433 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749fb88-6839-4320-bf0e-429f09f545e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:19.028873 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749fb88-6839-4320-bf0e-429f09f545e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:19.029348 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749fb88-6839-4320-bf0e-429f09f545e3 admin admin] PATH_INFO: `/v3/projects/104d5c5033a14e7b94f26bc854a4448a/users/3b14366b5092467a8d79e95cecd60c47/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:19.050181 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749fb88-6839-4320-bf0e-429f09f545e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=104d5c5033a14e7b94f26bc854a4448a, user_id=3b14366b5092467a8d79e95cecd60c47, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:19.053500 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749fb88-6839-4320-bf0e-429f09f545e3 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:19.215748 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 935/1871] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:51:18 2022] POST /identity/v3/users => generated 280 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:19.216758 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284a030-ac14-4afb-94e7-195383e39e1f admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:19.227474 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 937/1872] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:51:19 2022] PUT /identity/v3/projects/104d5c5033a14e7b94f26bc854a4448a/users/3b14366b5092467a8d79e95cecd60c47/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:51:19.227748 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284a030-ac14-4afb-94e7-195383e39e1f admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:19.232014 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749fb88-6839-4320-bf0e-429f09f545e3 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:19.315218 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17504b0-3ee9-4298-ada2-e0655b75645c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:19.316081 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17504b0-3ee9-4298-ada2-e0655b75645c admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:19.316531 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17504b0-3ee9-4298-ada2-e0655b75645c admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:19.316949 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17504b0-3ee9-4298-ada2-e0655b75645c admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:19.317863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17504b0-3ee9-4298-ada2-e0655b75645c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:19.319876 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17504b0-3ee9-4298-ada2-e0655b75645c admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:19.325217 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749fb88-6839-4320-bf0e-429f09f545e3 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:19.335286 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 936/1873] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:51:19.348208 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17504b0-3ee9-4298-ada2-e0655b75645c admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:19.348476 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03946ef6-73f5-4c75-b9c6-3be54ab1679e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:19.349262 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03946ef6-73f5-4c75-b9c6-3be54ab1679e admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:19.350117 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03946ef6-73f5-4c75-b9c6-3be54ab1679e admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:19.350117 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03946ef6-73f5-4c75-b9c6-3be54ab1679e admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:19.350575 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03946ef6-73f5-4c75-b9c6-3be54ab1679e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:19.352513 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03946ef6-73f5-4c75-b9c6-3be54ab1679e admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:19.365007 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 938/1874] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:51:19.368155 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17504b0-3ee9-4298-ada2-e0655b75645c admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:19.370815 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03946ef6-73f5-4c75-b9c6-3be54ab1679e admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:19.379866 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de23c1-feae-4b56-9532-ff2c0a3d692c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:19.380804 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de23c1-feae-4b56-9532-ff2c0a3d692c admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:19.381551 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de23c1-feae-4b56-9532-ff2c0a3d692c admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:19.382213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de23c1-feae-4b56-9532-ff2c0a3d692c admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:19.382852 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03946ef6-73f5-4c75-b9c6-3be54ab1679e admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:19.383284 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de23c1-feae-4b56-9532-ff2c0a3d692c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:19.387736 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de23c1-feae-4b56-9532-ff2c0a3d692c admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:19.390132 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547c1b5-74d0-47c6-9899-bd44b44b5318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:19.390132 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547c1b5-74d0-47c6-9899-bd44b44b5318 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:19.390132 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547c1b5-74d0-47c6-9899-bd44b44b5318 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:19.390132 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547c1b5-74d0-47c6-9899-bd44b44b5318 admin admin] PATH_INFO: `/v3/projects/104d5c5033a14e7b94f26bc854a4448a/users/3b14366b5092467a8d79e95cecd60c47/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:19.396056 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547c1b5-74d0-47c6-9899-bd44b44b5318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=104d5c5033a14e7b94f26bc854a4448a, user_id=3b14366b5092467a8d79e95cecd60c47, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:19.399500 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547c1b5-74d0-47c6-9899-bd44b44b5318 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:19.405108 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 937/1875] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:51:19.406232 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de23c1-feae-4b56-9532-ff2c0a3d692c admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:19.426064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de23c1-feae-4b56-9532-ff2c0a3d692c admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:19.429258 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 939/1876] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:51:19 2022] PUT /identity/v3/projects/104d5c5033a14e7b94f26bc854a4448a/users/3b14366b5092467a8d79e95cecd60c47/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:19.436120 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45691be-86cb-4be5-b1f3-6f640240e05d None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:19.436705 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45691be-86cb-4be5-b1f3-6f640240e05d None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:19.437133 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45691be-86cb-4be5-b1f3-6f640240e05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:19.465579 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-c45691be-86cb-4be5-b1f3-6f640240e05d None None] MFA Rules not processed for user `3b14366b5092467a8d79e95cecd60c47`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:19.466904 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-c45691be-86cb-4be5-b1f3-6f640240e05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:19.487403 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ba5ef-e4c4-4a0a-8b14-ffc1345d9ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:19.488064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ba5ef-e4c4-4a0a-8b14-ffc1345d9ac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:19.488345 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ba5ef-e4c4-4a0a-8b14-ffc1345d9ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:19.488618 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ba5ef-e4c4-4a0a-8b14-ffc1345d9ac1 admin admin] PATH_INFO: `/v3/projects/5d53f956033c4f8483a18d1a67f5a9f4/users/cce36044e3c14ec698c38a8f96c2d307/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:19.503584 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ba5ef-e4c4-4a0a-8b14-ffc1345d9ac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d53f956033c4f8483a18d1a67f5a9f4, user_id=cce36044e3c14ec698c38a8f96c2d307, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:19.506381 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ba5ef-e4c4-4a0a-8b14-ffc1345d9ac1 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:19.536952 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 940/1877] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:51:19.549552 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45691be-86cb-4be5-b1f3-6f640240e05d None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:19.550948 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-c45691be-86cb-4be5-b1f3-6f640240e05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:19.613799 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45691be-86cb-4be5-b1f3-6f640240e05d None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:19.617642 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9473e-71f5-444d-b482-68db15a53ff2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:19.618304 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9473e-71f5-444d-b482-68db15a53ff2 service cinder] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:19.618646 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9473e-71f5-444d-b482-68db15a53ff2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:19.618962 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9473e-71f5-444d-b482-68db15a53ff2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:19.628559 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9473e-71f5-444d-b482-68db15a53ff2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:19.630065 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9473e-71f5-444d-b482-68db15a53ff2 service cinder] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:19.639657 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 941/1878] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:19 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:51:19.655506 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 938/1879] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:51:19 2022] PUT /identity/v3/projects/5d53f956033c4f8483a18d1a67f5a9f4/users/cce36044e3c14ec698c38a8f96c2d307/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:19.668252 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026ee27-a84b-466b-9d4f-a3f310c034d2 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:19.668541 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026ee27-a84b-466b-9d4f-a3f310c034d2 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:19.668819 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026ee27-a84b-466b-9d4f-a3f310c034d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:19.698995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-b026ee27-a84b-466b-9d4f-a3f310c034d2 None None] MFA Rules not processed for user `cce36044e3c14ec698c38a8f96c2d307`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:19.700156 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-b026ee27-a84b-466b-9d4f-a3f310c034d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:19.762881 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ba5ef-e4c4-4a0a-8b14-ffc1345d9ac1 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:19.781062 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 942/1880] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:19 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:19.812607 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026ee27-a84b-466b-9d4f-a3f310c034d2 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:19.814265 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-b026ee27-a84b-466b-9d4f-a3f310c034d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:19.828577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ba5ef-e4c4-4a0a-8b14-ffc1345d9ac1 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:19.834328 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139d267-ef2a-43d2-a051-d3afd145fdbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:19.834942 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139d267-ef2a-43d2-a051-d3afd145fdbf service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:19.835225 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139d267-ef2a-43d2-a051-d3afd145fdbf service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:19.835502 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139d267-ef2a-43d2-a051-d3afd145fdbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:19.838740 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-d139d267-ef2a-43d2-a051-d3afd145fdbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:19.881447 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026ee27-a84b-466b-9d4f-a3f310c034d2 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:19.886457 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106069cb-32b4-4bbb-8176-22f528df80a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:19.887127 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106069cb-32b4-4bbb-8176-22f528df80a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:19.887412 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106069cb-32b4-4bbb-8176-22f528df80a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:19.887689 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106069cb-32b4-4bbb-8176-22f528df80a6 admin admin] PATH_INFO: `/v3/users/4320d8ff3ec4484d88a3db0bd2fa08b4` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:19.888860 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106069cb-32b4-4bbb-8176-22f528df80a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4320d8ff3ec4484d88a3db0bd2fa08b4)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:19.890814 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106069cb-32b4-4bbb-8176-22f528df80a6 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:19.897839 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139d267-ef2a-43d2-a051-d3afd145fdbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:19.899402 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139d267-ef2a-43d2-a051-d3afd145fdbf service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:19.909694 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 939/1881] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:51:19.910515 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139d267-ef2a-43d2-a051-d3afd145fdbf service cinder] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:19.911903 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-d139d267-ef2a-43d2-a051-d3afd145fdbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:19.923273 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139d267-ef2a-43d2-a051-d3afd145fdbf service cinder] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:19.927077 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4e3e2-3b67-4d70-8583-97d7e83cecda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:19.927676 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4e3e2-3b67-4d70-8583-97d7e83cecda service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:19.927955 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4e3e2-3b67-4d70-8583-97d7e83cecda service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:19.928226 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4e3e2-3b67-4d70-8583-97d7e83cecda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:19.937241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4e3e2-3b67-4d70-8583-97d7e83cecda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:19.938921 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4e3e2-3b67-4d70-8583-97d7e83cecda service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:19.948685 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 940/1882] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:19 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:51:19.968423 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4e3e2-3b67-4d70-8583-97d7e83cecda service cinder] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:19.979686 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4e3e2-3b67-4d70-8583-97d7e83cecda service cinder] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:19.985581 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536afeb6-0e7b-493e-88a8-e7383f7b0e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:19.990073 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536afeb6-0e7b-493e-88a8-e7383f7b0e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:19.990073 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536afeb6-0e7b-493e-88a8-e7383f7b0e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:19.990073 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536afeb6-0e7b-493e-88a8-e7383f7b0e5e admin admin] PATH_INFO: `/v3/users/cce36044e3c14ec698c38a8f96c2d307` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:19.990073 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536afeb6-0e7b-493e-88a8-e7383f7b0e5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cce36044e3c14ec698c38a8f96c2d307)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:19.990073 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536afeb6-0e7b-493e-88a8-e7383f7b0e5e admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:20.170405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-106069cb-32b4-4bbb-8176-22f528df80a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4320d8ff3ec4484d88a3db0bd2fa08b4'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:20.267892 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-536afeb6-0e7b-493e-88a8-e7383f7b0e5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cce36044e3c14ec698c38a8f96c2d307'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:20.284821 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-106069cb-32b4-4bbb-8176-22f528df80a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4320d8ff3ec4484d88a3db0bd2fa08b4'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:20.285747 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-106069cb-32b4-4bbb-8176-22f528df80a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4320d8ff3ec4484d88a3db0bd2fa08b4'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:20.286509 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-106069cb-32b4-4bbb-8176-22f528df80a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4320d8ff3ec4484d88a3db0bd2fa08b4'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:20.298492 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-106069cb-32b4-4bbb-8176-22f528df80a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4320d8ff3ec4484d88a3db0bd2fa08b4'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:20.330688 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 943/1883] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:51:19 2022] DELETE /identity/v3/users/4320d8ff3ec4484d88a3db0bd2fa08b4 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:51:20.335237 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedd1e9-a1f5-4280-83e9-c90e6862bbf9 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:20.335601 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedd1e9-a1f5-4280-83e9-c90e6862bbf9 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:20.335953 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedd1e9-a1f5-4280-83e9-c90e6862bbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:20.357744 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-abedd1e9-a1f5-4280-83e9-c90e6862bbf9 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:20.359657 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-abedd1e9-a1f5-4280-83e9-c90e6862bbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:20.415892 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-536afeb6-0e7b-493e-88a8-e7383f7b0e5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cce36044e3c14ec698c38a8f96c2d307'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:20.418031 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-536afeb6-0e7b-493e-88a8-e7383f7b0e5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cce36044e3c14ec698c38a8f96c2d307'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:20.418966 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-536afeb6-0e7b-493e-88a8-e7383f7b0e5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cce36044e3c14ec698c38a8f96c2d307'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:20.427144 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-536afeb6-0e7b-493e-88a8-e7383f7b0e5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cce36044e3c14ec698c38a8f96c2d307'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:20.465694 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 941/1884] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:51:19 2022] DELETE /identity/v3/users/cce36044e3c14ec698c38a8f96c2d307 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:51:20.468542 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008e2c2-aac8-4f07-abd6-8db2dff37c16 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:20.469117 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008e2c2-aac8-4f07-abd6-8db2dff37c16 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:20.469522 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008e2c2-aac8-4f07-abd6-8db2dff37c16 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:20.471908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 942/1885] 10.222.0.70 () {54 vars in 921 bytes} [Mon Aug 8 17:51:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:51:20.473577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc51b98-6f43-435c-bc56-0a0c6193b7e1 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:20.474047 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc51b98-6f43-435c-bc56-0a0c6193b7e1 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:20.474793 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc51b98-6f43-435c-bc56-0a0c6193b7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:20.503090 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-9bc51b98-6f43-435c-bc56-0a0c6193b7e1 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:20.504772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 944/1886] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:20.505488 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-9bc51b98-6f43-435c-bc56-0a0c6193b7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:20.511885 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abedd1e9-a1f5-4280-83e9-c90e6862bbf9 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:20.515279 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-abedd1e9-a1f5-4280-83e9-c90e6862bbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:20.576639 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 943/1887] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:20.581889 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92e059-b6a0-4b39-b111-07b1835a4f39 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:20.582265 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92e059-b6a0-4b39-b111-07b1835a4f39 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:20.582638 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92e059-b6a0-4b39-b111-07b1835a4f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:20.589166 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abedd1e9-a1f5-4280-83e9-c90e6862bbf9 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:20.605401 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-7a92e059-b6a0-4b39-b111-07b1835a4f39 None None] MFA Rules not processed for user `3973b8fbfbb9475896e4e110ca8aa615`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:20.606835 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-7a92e059-b6a0-4b39-b111-07b1835a4f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:20.649372 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a240743-68e2-45bf-9e91-4fb092a0f1e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:20.649907 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a240743-68e2-45bf-9e91-4fb092a0f1e6 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:20.650191 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a240743-68e2-45bf-9e91-4fb092a0f1e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:20.650467 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a240743-68e2-45bf-9e91-4fb092a0f1e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:20.660699 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a240743-68e2-45bf-9e91-4fb092a0f1e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:20.662385 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a240743-68e2-45bf-9e91-4fb092a0f1e6 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:20.673502 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 945/1888] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:51:20.674347 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a240743-68e2-45bf-9e91-4fb092a0f1e6 service neutron] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:20.684867 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a240743-68e2-45bf-9e91-4fb092a0f1e6 service neutron] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:20.693493 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73db4ea-9795-4caf-bc8b-68bfac2d7c07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:20.694405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73db4ea-9795-4caf-bc8b-68bfac2d7c07 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:20.694787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73db4ea-9795-4caf-bc8b-68bfac2d7c07 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:20.695160 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73db4ea-9795-4caf-bc8b-68bfac2d7c07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:20.716310 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73db4ea-9795-4caf-bc8b-68bfac2d7c07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:20.718390 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73db4ea-9795-4caf-bc8b-68bfac2d7c07 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:20.722004 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 944/1889] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Aug 8 17:51:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:20.730986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 946/1890] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:51:20.750600 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92e059-b6a0-4b39-b111-07b1835a4f39 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:20.752600 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-7a92e059-b6a0-4b39-b111-07b1835a4f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:20.771632 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92e059-b6a0-4b39-b111-07b1835a4f39 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:20.784488 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e83f47-6867-404c-a847-3755c2f8336e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:20.785622 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e83f47-6867-404c-a847-3755c2f8336e service nova] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:20.786013 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e83f47-6867-404c-a847-3755c2f8336e service nova] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:20.789750 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e83f47-6867-404c-a847-3755c2f8336e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:20.809417 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e83f47-6867-404c-a847-3755c2f8336e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:20.816870 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e83f47-6867-404c-a847-3755c2f8336e service nova] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:20.853528 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 945/1891] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:51:21.078985 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:21.381771 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73db4ea-9795-4caf-bc8b-68bfac2d7c07 service neutron] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:21.391378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-b73db4ea-9795-4caf-bc8b-68bfac2d7c07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:21.426547 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73db4ea-9795-4caf-bc8b-68bfac2d7c07 service neutron] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:21.431684 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb33eaf-50db-4a2e-bfb0-bc85a004ce0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:21.432914 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb33eaf-50db-4a2e-bfb0-bc85a004ce0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:21.433236 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb33eaf-50db-4a2e-bfb0-bc85a004ce0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:21.433570 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb33eaf-50db-4a2e-bfb0-bc85a004ce0c admin admin] PATH_INFO: `/v3/projects/bbf67ea058fe46baaf5b978778498987` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:21.435164 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb33eaf-50db-4a2e-bfb0-bc85a004ce0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbf67ea058fe46baaf5b978778498987)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:21.438529 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb33eaf-50db-4a2e-bfb0-bc85a004ce0c admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:21.509288 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e83f47-6867-404c-a847-3755c2f8336e service nova] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:21.511475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-f0e83f47-6867-404c-a847-3755c2f8336e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:21.554395 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e83f47-6867-404c-a847-3755c2f8336e service nova] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:21.581333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc3c64-4e96-4804-96f6-3bbe9c1fee82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:21.582140 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc3c64-4e96-4804-96f6-3bbe9c1fee82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:21.582663 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc3c64-4e96-4804-96f6-3bbe9c1fee82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:21.583152 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc3c64-4e96-4804-96f6-3bbe9c1fee82 admin admin] PATH_INFO: `/v3/projects/5d53f956033c4f8483a18d1a67f5a9f4` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:21.584958 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc3c64-4e96-4804-96f6-3bbe9c1fee82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d53f956033c4f8483a18d1a67f5a9f4)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:21.587156 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc3c64-4e96-4804-96f6-3bbe9c1fee82 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:21.603651 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-6cb33eaf-50db-4a2e-bfb0-bc85a004ce0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbf67ea058fe46baaf5b978778498987', 'request_id': 'req-6cb33eaf-50db-4a2e-bfb0-bc85a004ce0c'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:21.614137 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-6cb33eaf-50db-4a2e-bfb0-bc85a004ce0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbf67ea058fe46baaf5b978778498987', 'request_id': 'req-6cb33eaf-50db-4a2e-bfb0-bc85a004ce0c'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:21.686303 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-6cb33eaf-50db-4a2e-bfb0-bc85a004ce0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbf67ea058fe46baaf5b978778498987', 'request_id': 'req-6cb33eaf-50db-4a2e-bfb0-bc85a004ce0c'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:21.706834 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a9cc3c64-4e96-4804-96f6-3bbe9c1fee82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d53f956033c4f8483a18d1a67f5a9f4', 'request_id': 'req-a9cc3c64-4e96-4804-96f6-3bbe9c1fee82'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:21.712019 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-6cb33eaf-50db-4a2e-bfb0-bc85a004ce0c admin admin] The token cache is being invalidate because project bbf67ea058fe46baaf5b978778498987 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:51:21.712795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-6cb33eaf-50db-4a2e-bfb0-bc85a004ce0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:21.714356 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a9cc3c64-4e96-4804-96f6-3bbe9c1fee82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d53f956033c4f8483a18d1a67f5a9f4', 'request_id': 'req-a9cc3c64-4e96-4804-96f6-3bbe9c1fee82'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:21.714714 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-6cb33eaf-50db-4a2e-bfb0-bc85a004ce0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:21.716784 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 947/1892] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:51:21 2022] DELETE /identity/v3/projects/bbf67ea058fe46baaf5b978778498987 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:21.721737 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb33eaf-50db-4a2e-bfb0-bc85a004ce0c admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:21.723292 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-6cb33eaf-50db-4a2e-bfb0-bc85a004ce0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:21.797381 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb33eaf-50db-4a2e-bfb0-bc85a004ce0c admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:21.803259 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a9cc3c64-4e96-4804-96f6-3bbe9c1fee82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d53f956033c4f8483a18d1a67f5a9f4', 'request_id': 'req-a9cc3c64-4e96-4804-96f6-3bbe9c1fee82'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:21.817532 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a9cc3c64-4e96-4804-96f6-3bbe9c1fee82 admin admin] The token cache is being invalidate because project 5d53f956033c4f8483a18d1a67f5a9f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:51:21.817820 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a9cc3c64-4e96-4804-96f6-3bbe9c1fee82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:21.818858 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a9cc3c64-4e96-4804-96f6-3bbe9c1fee82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:21.820815 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 946/1893] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:51:21 2022] DELETE /identity/v3/projects/5d53f956033c4f8483a18d1a67f5a9f4 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:21.826244 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5332928-a883-4dc9-9283-961c3342c0ac None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:21.826708 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5332928-a883-4dc9-9283-961c3342c0ac None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:21.827091 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5332928-a883-4dc9-9283-961c3342c0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:21.851269 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-b5332928-a883-4dc9-9283-961c3342c0ac None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:21.852923 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-b5332928-a883-4dc9-9283-961c3342c0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:21.873510 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:21.875265 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a5fdd-b636-4c34-861d-8db76c8b9b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:21.877770 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a5fdd-b636-4c34-861d-8db76c8b9b0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:21.879460 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a5fdd-b636-4c34-861d-8db76c8b9b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:21.879460 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a5fdd-b636-4c34-861d-8db76c8b9b0e admin admin] PATH_INFO: `/v3/users/8144b36d4dbf4f9580c1062d8d5a68c8` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:21.879797 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498a5fdd-b636-4c34-861d-8db76c8b9b0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8144b36d4dbf4f9580c1062d8d5a68c8)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:21.881773 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498a5fdd-b636-4c34-861d-8db76c8b9b0e admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:21.919599 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 947/1894] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:21.927603 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d654ff-eff2-424e-93f9-629a3fbbb336 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:21.928609 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d654ff-eff2-424e-93f9-629a3fbbb336 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:21.928609 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d654ff-eff2-424e-93f9-629a3fbbb336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:21.950689 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-17d654ff-eff2-424e-93f9-629a3fbbb336 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:21.952081 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-17d654ff-eff2-424e-93f9-629a3fbbb336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:21.960254 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 948/1895] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:51:21.964643 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d654ff-eff2-424e-93f9-629a3fbbb336 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:21.974374 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d654ff-eff2-424e-93f9-629a3fbbb336 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:21.979685 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e5c3f-b66f-409c-8395-ced92acac1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:21.980299 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e5c3f-b66f-409c-8395-ced92acac1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:21.980582 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e5c3f-b66f-409c-8395-ced92acac1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:21.981001 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e5c3f-b66f-409c-8395-ced92acac1f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:21.981544 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e5c3f-b66f-409c-8395-ced92acac1f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:51:21.981843 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e5c3f-b66f-409c-8395-ced92acac1f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:21.983453 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e5c3f-b66f-409c-8395-ced92acac1f0 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:21.995827 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 949/1896] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:51:22.000088 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e5c3f-b66f-409c-8395-ced92acac1f0 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:22.009394 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e5c3f-b66f-409c-8395-ced92acac1f0 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:22.014687 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e66cf6-e578-4f5d-aea5-b8673afdf73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:22.015255 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e66cf6-e578-4f5d-aea5-b8673afdf73c admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:22.015535 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e66cf6-e578-4f5d-aea5-b8673afdf73c admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:22.015808 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e66cf6-e578-4f5d-aea5-b8673afdf73c admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:22.016414 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e66cf6-e578-4f5d-aea5-b8673afdf73c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:22.018318 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e66cf6-e578-4f5d-aea5-b8673afdf73c admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:22.093094 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-498a5fdd-b636-4c34-861d-8db76c8b9b0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8144b36d4dbf4f9580c1062d8d5a68c8'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:22.168394 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 950/1897] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:51:21 2022] POST /identity/v3/projects => generated 373 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:51:22.169753 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e66cf6-e578-4f5d-aea5-b8673afdf73c admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:22.227899 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-498a5fdd-b636-4c34-861d-8db76c8b9b0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8144b36d4dbf4f9580c1062d8d5a68c8'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:22.228750 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-498a5fdd-b636-4c34-861d-8db76c8b9b0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8144b36d4dbf4f9580c1062d8d5a68c8'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:22.230699 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-498a5fdd-b636-4c34-861d-8db76c8b9b0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8144b36d4dbf4f9580c1062d8d5a68c8'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:22.236173 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e66cf6-e578-4f5d-aea5-b8673afdf73c admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:22.238866 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-498a5fdd-b636-4c34-861d-8db76c8b9b0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8144b36d4dbf4f9580c1062d8d5a68c8'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:22.245686 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f1b69-2439-4300-9e4f-bdb316c271ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:22.246304 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f1b69-2439-4300-9e4f-bdb316c271ce admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:22.246578 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f1b69-2439-4300-9e4f-bdb316c271ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:22.246851 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f1b69-2439-4300-9e4f-bdb316c271ce admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:22.247525 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f1b69-2439-4300-9e4f-bdb316c271ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:22.254367 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f1b69-2439-4300-9e4f-bdb316c271ce admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:22.258353 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 948/1898] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:51:21 2022] DELETE /identity/v3/users/8144b36d4dbf4f9580c1062d8d5a68c8 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:51:22.385359 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 951/1899] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:51:22 2022] POST /identity/v3/users => generated 287 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:51:22.389511 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a5fdd-b636-4c34-861d-8db76c8b9b0e admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:22.391185 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-498a5fdd-b636-4c34-861d-8db76c8b9b0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:22.460006 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a5fdd-b636-4c34-861d-8db76c8b9b0e admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:22.464916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0b786-041d-417b-a676-6791e031efd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:22.465567 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0b786-041d-417b-a676-6791e031efd9 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:22.465855 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0b786-041d-417b-a676-6791e031efd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:22.466134 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0b786-041d-417b-a676-6791e031efd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:22.466778 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b0b786-041d-417b-a676-6791e031efd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:22.468679 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b0b786-041d-417b-a676-6791e031efd9 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:22.480467 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 949/1900] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:51:22.485933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f1b69-2439-4300-9e4f-bdb316c271ce admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:22.500848 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f1b69-2439-4300-9e4f-bdb316c271ce admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:22.506199 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdb364-98b3-47a8-95eb-ea021cbbd027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:22.507118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdb364-98b3-47a8-95eb-ea021cbbd027 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:22.507500 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdb364-98b3-47a8-95eb-ea021cbbd027 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:22.507875 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdb364-98b3-47a8-95eb-ea021cbbd027 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:22.508648 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cdb364-98b3-47a8-95eb-ea021cbbd027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:22.511042 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cdb364-98b3-47a8-95eb-ea021cbbd027 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:22.522248 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 952/1901] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:51:22.529274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0b786-041d-417b-a676-6791e031efd9 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:22.539942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0b786-041d-417b-a676-6791e031efd9 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:22.545681 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3aaf9-b948-4182-88c4-d0dee13827f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:22.546348 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3aaf9-b948-4182-88c4-d0dee13827f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:22.546631 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3aaf9-b948-4182-88c4-d0dee13827f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:22.546908 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3aaf9-b948-4182-88c4-d0dee13827f3 admin admin] PATH_INFO: `/v3/projects/a123df7da57b403c8e9410cced19050b/users/d5ecd18a5bec40daa34a1c1c3414cf2c/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:22.566714 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd3aaf9-b948-4182-88c4-d0dee13827f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a123df7da57b403c8e9410cced19050b, user_id=d5ecd18a5bec40daa34a1c1c3414cf2c, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:22.567235 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd3aaf9-b948-4182-88c4-d0dee13827f3 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:22.698572 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 950/1902] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:51:22 2022] PUT /identity/v3/projects/a123df7da57b403c8e9410cced19050b/users/d5ecd18a5bec40daa34a1c1c3414cf2c/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:22.705976 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335db83-ae8b-4220-b569-f326251d5e1a None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:22.706271 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335db83-ae8b-4220-b569-f326251d5e1a None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:22.706554 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335db83-ae8b-4220-b569-f326251d5e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:22.742213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-e335db83-ae8b-4220-b569-f326251d5e1a None None] MFA Rules not processed for user `d5ecd18a5bec40daa34a1c1c3414cf2c`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:22.743510 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-e335db83-ae8b-4220-b569-f326251d5e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:22.799441 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3aaf9-b948-4182-88c4-d0dee13827f3 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:22.801361 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-9bd3aaf9-b948-4182-88c4-d0dee13827f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:22.811183 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:22.867412 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 953/1903] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:22.879158 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335db83-ae8b-4220-b569-f326251d5e1a None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:22.880584 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-e335db83-ae8b-4220-b569-f326251d5e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:22.913820 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3aaf9-b948-4182-88c4-d0dee13827f3 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:22.919376 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81766a-db4e-4cc8-a070-1a5359ccb612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:22.920046 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81766a-db4e-4cc8-a070-1a5359ccb612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:22.920327 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81766a-db4e-4cc8-a070-1a5359ccb612 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:22.920598 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81766a-db4e-4cc8-a070-1a5359ccb612 admin admin] PATH_INFO: `/v3/projects/87940f2183ec4a678e6224e84125cccc` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:22.921815 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81766a-db4e-4cc8-a070-1a5359ccb612 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87940f2183ec4a678e6224e84125cccc)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:22.923789 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81766a-db4e-4cc8-a070-1a5359ccb612 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:22.956260 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335db83-ae8b-4220-b569-f326251d5e1a None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:22.961319 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08b7b6-447d-4eb4-b9b0-a4449fb118f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:22.968986 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08b7b6-447d-4eb4-b9b0-a4449fb118f5 service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:22.968986 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08b7b6-447d-4eb4-b9b0-a4449fb118f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:22.968986 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08b7b6-447d-4eb4-b9b0-a4449fb118f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:22.973172 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08b7b6-447d-4eb4-b9b0-a4449fb118f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:22.974833 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08b7b6-447d-4eb4-b9b0-a4449fb118f5 service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:22.985435 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 954/1904] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:51:23.063395 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-bf81766a-db4e-4cc8-a070-1a5359ccb612 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87940f2183ec4a678e6224e84125cccc', 'request_id': 'req-bf81766a-db4e-4cc8-a070-1a5359ccb612'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:23.070071 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-bf81766a-db4e-4cc8-a070-1a5359ccb612 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87940f2183ec4a678e6224e84125cccc', 'request_id': 'req-bf81766a-db4e-4cc8-a070-1a5359ccb612'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:23.141076 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-bf81766a-db4e-4cc8-a070-1a5359ccb612 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87940f2183ec4a678e6224e84125cccc', 'request_id': 'req-bf81766a-db4e-4cc8-a070-1a5359ccb612'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:23.155570 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-bf81766a-db4e-4cc8-a070-1a5359ccb612 admin admin] The token cache is being invalidate because project 87940f2183ec4a678e6224e84125cccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:51:23.155955 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-bf81766a-db4e-4cc8-a070-1a5359ccb612 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:23.156748 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-bf81766a-db4e-4cc8-a070-1a5359ccb612 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:23.158291 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 951/1905] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:51:22 2022] DELETE /identity/v3/projects/87940f2183ec4a678e6224e84125cccc => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:23.164039 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c671f9-576a-47cb-8f8b-3c80f2dc6396 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:23.164326 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c671f9-576a-47cb-8f8b-3c80f2dc6396 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:23.164626 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c671f9-576a-47cb-8f8b-3c80f2dc6396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:23.185967 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-85c671f9-576a-47cb-8f8b-3c80f2dc6396 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:23.187118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-85c671f9-576a-47cb-8f8b-3c80f2dc6396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:23.247013 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 955/1906] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:23.254730 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca4288-e3c4-4949-9d7a-e6f79cc0fbaa None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:23.255018 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca4288-e3c4-4949-9d7a-e6f79cc0fbaa None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:23.255292 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca4288-e3c4-4949-9d7a-e6f79cc0fbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:23.285806 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-63ca4288-e3c4-4949-9d7a-e6f79cc0fbaa None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:23.287022 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-63ca4288-e3c4-4949-9d7a-e6f79cc0fbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:23.303611 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 952/1907] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:23.308305 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c671f9-576a-47cb-8f8b-3c80f2dc6396 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:23.324552 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c671f9-576a-47cb-8f8b-3c80f2dc6396 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:23.336633 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937fb607-cbf1-4c10-84d0-a9b7cce88973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:23.339611 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fb607-cbf1-4c10-84d0-a9b7cce88973 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:23.339898 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fb607-cbf1-4c10-84d0-a9b7cce88973 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:23.341414 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fb607-cbf1-4c10-84d0-a9b7cce88973 admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:23.343163 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937fb607-cbf1-4c10-84d0-a9b7cce88973 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:51:23.343471 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937fb607-cbf1-4c10-84d0-a9b7cce88973 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:23.348068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937fb607-cbf1-4c10-84d0-a9b7cce88973 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:23.364416 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 956/1908] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:51:23.370892 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca4288-e3c4-4949-9d7a-e6f79cc0fbaa None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:23.381785 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca4288-e3c4-4949-9d7a-e6f79cc0fbaa None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:23.387893 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41fd79-9d6a-434a-9551-97fb240b34b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:23.388713 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41fd79-9d6a-434a-9551-97fb240b34b4 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:23.389252 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41fd79-9d6a-434a-9551-97fb240b34b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:23.389626 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41fd79-9d6a-434a-9551-97fb240b34b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:23.390697 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41fd79-9d6a-434a-9551-97fb240b34b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:23.394057 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41fd79-9d6a-434a-9551-97fb240b34b4 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:23.514863 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 953/1909] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:51:23 2022] POST /identity/v3/projects => generated 375 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:23.518589 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937fb607-cbf1-4c10-84d0-a9b7cce88973 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:23.530611 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937fb607-cbf1-4c10-84d0-a9b7cce88973 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:23.589908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d943aa-abee-4793-afc0-9b69245e2371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:23.590518 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d943aa-abee-4793-afc0-9b69245e2371 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:23.590795 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d943aa-abee-4793-afc0-9b69245e2371 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:23.591067 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d943aa-abee-4793-afc0-9b69245e2371 admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:23.591696 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d943aa-abee-4793-afc0-9b69245e2371 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:23.593900 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d943aa-abee-4793-afc0-9b69245e2371 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:23.724577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 957/1910] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:51:23 2022] POST /identity/v3/users => generated 288 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:23.725292 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41fd79-9d6a-434a-9551-97fb240b34b4 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:23.738619 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41fd79-9d6a-434a-9551-97fb240b34b4 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:23.745464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71da21c-54ef-4ba5-bbda-f4e032c1e131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:23.746498 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71da21c-54ef-4ba5-bbda-f4e032c1e131 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:23.747011 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71da21c-54ef-4ba5-bbda-f4e032c1e131 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:23.747467 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71da21c-54ef-4ba5-bbda-f4e032c1e131 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:23.748432 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71da21c-54ef-4ba5-bbda-f4e032c1e131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:23.750479 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71da21c-54ef-4ba5-bbda-f4e032c1e131 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:23.765648 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 954/1911] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:51:23.766355 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d943aa-abee-4793-afc0-9b69245e2371 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:23.778044 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d943aa-abee-4793-afc0-9b69245e2371 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:23.782807 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7fd84-a864-47d0-84de-f440ffb50b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:23.783421 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7fd84-a864-47d0-84de-f440ffb50b6d admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:23.783708 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7fd84-a864-47d0-84de-f440ffb50b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:23.784135 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7fd84-a864-47d0-84de-f440ffb50b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:23.784783 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7fd84-a864-47d0-84de-f440ffb50b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:23.786448 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7fd84-a864-47d0-84de-f440ffb50b6d admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:23.798997 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 958/1912] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:51:23.803951 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71da21c-54ef-4ba5-bbda-f4e032c1e131 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:23.819327 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71da21c-54ef-4ba5-bbda-f4e032c1e131 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:23.826077 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0db5d-1b40-490d-8131-e05ce9ae104f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:23.827268 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0db5d-1b40-490d-8131-e05ce9ae104f admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:23.837524 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0db5d-1b40-490d-8131-e05ce9ae104f admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:23.837524 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0db5d-1b40-490d-8131-e05ce9ae104f admin admin] PATH_INFO: `/v3/projects/3eabfda9ac4a45629cb2497763b00dc8/users/e3568db866254622b62a4f3e06ff737e/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:23.849067 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0db5d-1b40-490d-8131-e05ce9ae104f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eabfda9ac4a45629cb2497763b00dc8, user_id=e3568db866254622b62a4f3e06ff737e, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:23.852000 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0db5d-1b40-490d-8131-e05ce9ae104f admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:23.942510 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 955/1913] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:51:23 2022] PUT /identity/v3/projects/3eabfda9ac4a45629cb2497763b00dc8/users/e3568db866254622b62a4f3e06ff737e/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:23.969617 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0f28f-a0f4-45ef-8b59-a7f36a5f524b None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:23.969617 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0f28f-a0f4-45ef-8b59-a7f36a5f524b None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:23.969617 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0f28f-a0f4-45ef-8b59-a7f36a5f524b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:24.039858 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-e9a0f28f-a0f4-45ef-8b59-a7f36a5f524b None None] MFA Rules not processed for user `e3568db866254622b62a4f3e06ff737e`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:24.041142 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-e9a0f28f-a0f4-45ef-8b59-a7f36a5f524b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:24.175621 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 959/1914] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:24.186175 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0db5d-1b40-490d-8131-e05ce9ae104f admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:24.188627 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-aef0db5d-1b40-490d-8131-e05ce9ae104f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:24.286759 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0db5d-1b40-490d-8131-e05ce9ae104f admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:24.290527 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0ab4f-bdf9-4fea-960f-399dd0daaeb9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab95367403451b921099425345b3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:24.291134 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0ab4f-bdf9-4fea-960f-399dd0daaeb9 service glance] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:24.291441 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0ab4f-bdf9-4fea-960f-399dd0daaeb9 service glance] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:24.291733 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0ab4f-bdf9-4fea-960f-399dd0daaeb9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:24.300801 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a0ab4f-bdf9-4fea-960f-399dd0daaeb9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:24.301851 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:24.302299 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a0ab4f-bdf9-4fea-960f-399dd0daaeb9 service glance] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:24.313553 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 956/1915] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:51:25.572658 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0f28f-a0f4-45ef-8b59-a7f36a5f524b None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:25.574216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-e9a0f28f-a0f4-45ef-8b59-a7f36a5f524b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:25.656667 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0f28f-a0f4-45ef-8b59-a7f36a5f524b None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:25.661353 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7a98e-a1c1-462c-a602-0560975998ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:25.662005 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7a98e-a1c1-462c-a602-0560975998ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:25.662291 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7a98e-a1c1-462c-a602-0560975998ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:25.662565 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7a98e-a1c1-462c-a602-0560975998ab admin admin] PATH_INFO: `/v3/users/f00d6f64b71e43e8be8be422378dd785` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:25.663734 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7a98e-a1c1-462c-a602-0560975998ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=f00d6f64b71e43e8be8be422378dd785)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:25.665640 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7a98e-a1c1-462c-a602-0560975998ab admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:25.821073 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:25.899696 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-eaa7a98e-a1c1-462c-a602-0560975998ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f00d6f64b71e43e8be8be422378dd785'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:26.014377 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-eaa7a98e-a1c1-462c-a602-0560975998ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f00d6f64b71e43e8be8be422378dd785'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:26.015066 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-eaa7a98e-a1c1-462c-a602-0560975998ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f00d6f64b71e43e8be8be422378dd785'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:26.015973 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-eaa7a98e-a1c1-462c-a602-0560975998ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f00d6f64b71e43e8be8be422378dd785'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:26.024407 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-eaa7a98e-a1c1-462c-a602-0560975998ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f00d6f64b71e43e8be8be422378dd785'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:26.063508 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 960/1916] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:51:25 2022] DELETE /identity/v3/users/f00d6f64b71e43e8be8be422378dd785 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:51:26.068094 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a40e7-d855-4468-8714-8972ea7d8bb0 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:26.092560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a40e7-d855-4468-8714-8972ea7d8bb0 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:26.092560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a40e7-d855-4468-8714-8972ea7d8bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:26.094495 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-b10a40e7-d855-4468-8714-8972ea7d8bb0 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:26.095575 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-b10a40e7-d855-4468-8714-8972ea7d8bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:26.160577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 957/1917] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:26.184376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7a98e-a1c1-462c-a602-0560975998ab admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:26.184376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-eaa7a98e-a1c1-462c-a602-0560975998ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:26.244712 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7a98e-a1c1-462c-a602-0560975998ab admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:26.261837 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2dae0-67e2-47e4-bb24-a02c29e965c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:26.262811 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2dae0-67e2-47e4-bb24-a02c29e965c6 service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:26.263313 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2dae0-67e2-47e4-bb24-a02c29e965c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:26.263696 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2dae0-67e2-47e4-bb24-a02c29e965c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:26.274276 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a2dae0-67e2-47e4-bb24-a02c29e965c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:26.275884 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a2dae0-67e2-47e4-bb24-a02c29e965c6 service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:26.288337 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 961/1918] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:51:26.330421 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:26.918083 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a40e7-d855-4468-8714-8972ea7d8bb0 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:26.919676 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-b10a40e7-d855-4468-8714-8972ea7d8bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:26.931707 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a40e7-d855-4468-8714-8972ea7d8bb0 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:26.937415 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4275e-3987-4fe3-9acf-277f6de2da0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:26.946356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4275e-3987-4fe3-9acf-277f6de2da0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:26.946356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4275e-3987-4fe3-9acf-277f6de2da0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:26.946356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4275e-3987-4fe3-9acf-277f6de2da0f admin admin] PATH_INFO: `/v3/projects/69990ad3e8584b29b09163f3532eb393` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:26.946356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e4275e-3987-4fe3-9acf-277f6de2da0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=69990ad3e8584b29b09163f3532eb393)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:26.946356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e4275e-3987-4fe3-9acf-277f6de2da0f admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:27.072920 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-c0e4275e-3987-4fe3-9acf-277f6de2da0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69990ad3e8584b29b09163f3532eb393', 'request_id': 'req-c0e4275e-3987-4fe3-9acf-277f6de2da0f'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:27.078836 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-c0e4275e-3987-4fe3-9acf-277f6de2da0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69990ad3e8584b29b09163f3532eb393', 'request_id': 'req-c0e4275e-3987-4fe3-9acf-277f6de2da0f'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:27.175490 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-c0e4275e-3987-4fe3-9acf-277f6de2da0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69990ad3e8584b29b09163f3532eb393', 'request_id': 'req-c0e4275e-3987-4fe3-9acf-277f6de2da0f'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:27.188096 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-c0e4275e-3987-4fe3-9acf-277f6de2da0f admin admin] The token cache is being invalidate because project 69990ad3e8584b29b09163f3532eb393 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:51:27.188506 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-c0e4275e-3987-4fe3-9acf-277f6de2da0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:27.189244 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-c0e4275e-3987-4fe3-9acf-277f6de2da0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:27.190848 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 958/1919] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:51:26 2022] DELETE /identity/v3/projects/69990ad3e8584b29b09163f3532eb393 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:27.195114 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2dae0-67e2-47e4-bb24-a02c29e965c6 service neutron] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:27.206363 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2dae0-67e2-47e4-bb24-a02c29e965c6 service neutron] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:27.270282 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5b0d4-d3d9-40ea-953d-28c88aa73d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:27.271154 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5b0d4-d3d9-40ea-953d-28c88aa73d04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:27.271707 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5b0d4-d3d9-40ea-953d-28c88aa73d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:27.272212 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5b0d4-d3d9-40ea-953d-28c88aa73d04 admin admin] PATH_INFO: `/v3/users/ce5a2bcf9579459aa6f2ea351968224e` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:27.273446 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5b0d4-d3d9-40ea-953d-28c88aa73d04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce5a2bcf9579459aa6f2ea351968224e)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:27.275467 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5b0d4-d3d9-40ea-953d-28c88aa73d04 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:27.574959 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-44f5b0d4-d3d9-40ea-953d-28c88aa73d04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce5a2bcf9579459aa6f2ea351968224e'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:27.672972 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-44f5b0d4-d3d9-40ea-953d-28c88aa73d04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce5a2bcf9579459aa6f2ea351968224e'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:27.673888 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-44f5b0d4-d3d9-40ea-953d-28c88aa73d04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce5a2bcf9579459aa6f2ea351968224e'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:27.674602 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-44f5b0d4-d3d9-40ea-953d-28c88aa73d04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce5a2bcf9579459aa6f2ea351968224e'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:27.693794 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-44f5b0d4-d3d9-40ea-953d-28c88aa73d04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce5a2bcf9579459aa6f2ea351968224e'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:27.748688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 962/1920] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:51:27 2022] DELETE /identity/v3/users/ce5a2bcf9579459aa6f2ea351968224e => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:51:28.101246 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:28.198182 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4275e-3987-4fe3-9acf-277f6de2da0f admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:28.200125 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-c0e4275e-3987-4fe3-9acf-277f6de2da0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:28.226108 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4275e-3987-4fe3-9acf-277f6de2da0f admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:28.328925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f285a-a14f-4777-981b-e7a301e9717a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:28.330047 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f285a-a14f-4777-981b-e7a301e9717a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:28.330527 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f285a-a14f-4777-981b-e7a301e9717a admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:28.331089 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f285a-a14f-4777-981b-e7a301e9717a admin admin] PATH_INFO: `/v3/users/d5ecd18a5bec40daa34a1c1c3414cf2c` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:28.333249 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16f285a-a14f-4777-981b-e7a301e9717a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5ecd18a5bec40daa34a1c1c3414cf2c)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:28.337866 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16f285a-a14f-4777-981b-e7a301e9717a admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:28.521712 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-a16f285a-a14f-4777-981b-e7a301e9717a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5ecd18a5bec40daa34a1c1c3414cf2c'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:28.602936 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-a16f285a-a14f-4777-981b-e7a301e9717a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5ecd18a5bec40daa34a1c1c3414cf2c'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:28.603561 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-a16f285a-a14f-4777-981b-e7a301e9717a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5ecd18a5bec40daa34a1c1c3414cf2c'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:28.604213 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-a16f285a-a14f-4777-981b-e7a301e9717a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5ecd18a5bec40daa34a1c1c3414cf2c'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:28.613831 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-a16f285a-a14f-4777-981b-e7a301e9717a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5ecd18a5bec40daa34a1c1c3414cf2c'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:28.639168 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 959/1921] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:51:28 2022] DELETE /identity/v3/users/d5ecd18a5bec40daa34a1c1c3414cf2c => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:28.643794 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717484d-2ca8-49ca-9d27-df40ea613785 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:28.644346 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717484d-2ca8-49ca-9d27-df40ea613785 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:28.644448 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717484d-2ca8-49ca-9d27-df40ea613785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:28.664725 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-4717484d-2ca8-49ca-9d27-df40ea613785 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:28.666339 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-4717484d-2ca8-49ca-9d27-df40ea613785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:28.689927 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f285a-a14f-4777-981b-e7a301e9717a admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:28.691973 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-a16f285a-a14f-4777-981b-e7a301e9717a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:28.768005 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 963/1922] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:28.786900 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717484d-2ca8-49ca-9d27-df40ea613785 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:28.789326 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-4717484d-2ca8-49ca-9d27-df40ea613785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:28.825184 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f285a-a14f-4777-981b-e7a301e9717a admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:28.835461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350aa022-18be-4698-a8ef-2f654e7ab067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:28.835461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350aa022-18be-4698-a8ef-2f654e7ab067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:28.835461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350aa022-18be-4698-a8ef-2f654e7ab067 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:28.835461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350aa022-18be-4698-a8ef-2f654e7ab067 admin admin] PATH_INFO: `/v3/projects/294af6f6d6d747eda8c11fe84a2476f3` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:28.836654 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350aa022-18be-4698-a8ef-2f654e7ab067 admin admin] RBAC: Authorizing `identity:delete_project(project_id=294af6f6d6d747eda8c11fe84a2476f3)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:28.837635 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350aa022-18be-4698-a8ef-2f654e7ab067 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:28.872051 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717484d-2ca8-49ca-9d27-df40ea613785 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:28.878215 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5d914-dee3-4358-a55c-b482bdb2e8a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:28.879115 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5d914-dee3-4358-a55c-b482bdb2e8a8 service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:28.879674 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5d914-dee3-4358-a55c-b482bdb2e8a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:28.880158 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5d914-dee3-4358-a55c-b482bdb2e8a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:28.892882 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5d914-dee3-4358-a55c-b482bdb2e8a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:28.895396 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5d914-dee3-4358-a55c-b482bdb2e8a8 service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:28.911597 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 964/1923] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:51:28.914914 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5d914-dee3-4358-a55c-b482bdb2e8a8 service neutron] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:28.918217 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-c4a5d914-dee3-4358-a55c-b482bdb2e8a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:28.940064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5d914-dee3-4358-a55c-b482bdb2e8a8 service neutron] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:28.945743 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8bed0-50a5-483e-a166-62cf8b69d99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:28.946305 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8bed0-50a5-483e-a166-62cf8b69d99e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:28.946819 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8bed0-50a5-483e-a166-62cf8b69d99e admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:28.947467 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8bed0-50a5-483e-a166-62cf8b69d99e admin admin] PATH_INFO: `/v3/users/f2f4d8895b564af4afd8e4d3e4783c9f` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:28.992373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8bed0-50a5-483e-a166-62cf8b69d99e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2f4d8895b564af4afd8e4d3e4783c9f)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:28.992373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8bed0-50a5-483e-a166-62cf8b69d99e admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:29.052858 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-350aa022-18be-4698-a8ef-2f654e7ab067 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '294af6f6d6d747eda8c11fe84a2476f3', 'request_id': 'req-350aa022-18be-4698-a8ef-2f654e7ab067'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:29.065298 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-350aa022-18be-4698-a8ef-2f654e7ab067 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '294af6f6d6d747eda8c11fe84a2476f3', 'request_id': 'req-350aa022-18be-4698-a8ef-2f654e7ab067'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:29.152590 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-350aa022-18be-4698-a8ef-2f654e7ab067 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '294af6f6d6d747eda8c11fe84a2476f3', 'request_id': 'req-350aa022-18be-4698-a8ef-2f654e7ab067'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:29.168951 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-350aa022-18be-4698-a8ef-2f654e7ab067 admin admin] The token cache is being invalidate because project 294af6f6d6d747eda8c11fe84a2476f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:51:29.173884 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-350aa022-18be-4698-a8ef-2f654e7ab067 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:29.173884 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-350aa022-18be-4698-a8ef-2f654e7ab067 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:29.174106 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 960/1924] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:51:28 2022] DELETE /identity/v3/projects/294af6f6d6d747eda8c11fe84a2476f3 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:51:29.177503 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350aa022-18be-4698-a8ef-2f654e7ab067 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:29.179785 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-350aa022-18be-4698-a8ef-2f654e7ab067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:29.217275 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:29.235314 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-b2f8bed0-50a5-483e-a166-62cf8b69d99e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2f4d8895b564af4afd8e4d3e4783c9f'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:29.347498 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-b2f8bed0-50a5-483e-a166-62cf8b69d99e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2f4d8895b564af4afd8e4d3e4783c9f'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:29.347751 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-b2f8bed0-50a5-483e-a166-62cf8b69d99e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2f4d8895b564af4afd8e4d3e4783c9f'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:29.348280 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-b2f8bed0-50a5-483e-a166-62cf8b69d99e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2f4d8895b564af4afd8e4d3e4783c9f'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:29.361618 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350aa022-18be-4698-a8ef-2f654e7ab067 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:29.365307 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-b2f8bed0-50a5-483e-a166-62cf8b69d99e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2f4d8895b564af4afd8e4d3e4783c9f'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:29.370743 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496a230-ed5f-41e7-9672-7f45c01149a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:29.372837 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496a230-ed5f-41e7-9672-7f45c01149a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:29.373699 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496a230-ed5f-41e7-9672-7f45c01149a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:29.380022 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496a230-ed5f-41e7-9672-7f45c01149a0 admin admin] PATH_INFO: `/v3/users/3b14366b5092467a8d79e95cecd60c47` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:29.380022 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496a230-ed5f-41e7-9672-7f45c01149a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b14366b5092467a8d79e95cecd60c47)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:29.384136 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496a230-ed5f-41e7-9672-7f45c01149a0 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:29.410339 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 965/1925] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:51:28 2022] DELETE /identity/v3/users/f2f4d8895b564af4afd8e4d3e4783c9f => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:29.415067 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa5022-c95d-494d-8717-770cb248f1b5 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:29.420144 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa5022-c95d-494d-8717-770cb248f1b5 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:29.420144 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa5022-c95d-494d-8717-770cb248f1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:29.457924 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-36aa5022-c95d-494d-8717-770cb248f1b5 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:29.459162 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-36aa5022-c95d-494d-8717-770cb248f1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:29.559594 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 966/1926] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:29.571171 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa5022-c95d-494d-8717-770cb248f1b5 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:29.572841 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-36aa5022-c95d-494d-8717-770cb248f1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:29.685340 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e496a230-ed5f-41e7-9672-7f45c01149a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b14366b5092467a8d79e95cecd60c47'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:29.687023 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa5022-c95d-494d-8717-770cb248f1b5 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:29.692031 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337b427-f1a8-4db6-96be-f4ecfd58f3fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:29.693240 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337b427-f1a8-4db6-96be-f4ecfd58f3fc service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:29.693747 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337b427-f1a8-4db6-96be-f4ecfd58f3fc service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:29.694226 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337b427-f1a8-4db6-96be-f4ecfd58f3fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:29.707279 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2337b427-f1a8-4db6-96be-f4ecfd58f3fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:29.709359 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2337b427-f1a8-4db6-96be-f4ecfd58f3fc service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:29.722573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 967/1927] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:51:29.724063 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337b427-f1a8-4db6-96be-f4ecfd58f3fc service neutron] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:29.726302 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-2337b427-f1a8-4db6-96be-f4ecfd58f3fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:29.743604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337b427-f1a8-4db6-96be-f4ecfd58f3fc service neutron] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:29.749518 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cab24c-ed8f-457b-b595-fc1942fcda56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:29.750380 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cab24c-ed8f-457b-b595-fc1942fcda56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:29.750906 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cab24c-ed8f-457b-b595-fc1942fcda56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:29.751286 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cab24c-ed8f-457b-b595-fc1942fcda56 admin admin] PATH_INFO: `/v3/projects/a123df7da57b403c8e9410cced19050b` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:29.752750 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cab24c-ed8f-457b-b595-fc1942fcda56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a123df7da57b403c8e9410cced19050b)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:29.754986 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cab24c-ed8f-457b-b595-fc1942fcda56 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:29.766770 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e496a230-ed5f-41e7-9672-7f45c01149a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b14366b5092467a8d79e95cecd60c47'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:29.767870 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e496a230-ed5f-41e7-9672-7f45c01149a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b14366b5092467a8d79e95cecd60c47'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:29.768789 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e496a230-ed5f-41e7-9672-7f45c01149a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b14366b5092467a8d79e95cecd60c47'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:29.780460 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e496a230-ed5f-41e7-9672-7f45c01149a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b14366b5092467a8d79e95cecd60c47'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:29.833404 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 961/1928] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:51:29 2022] DELETE /identity/v3/users/3b14366b5092467a8d79e95cecd60c47 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:51:29.944044 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-19cab24c-ed8f-457b-b595-fc1942fcda56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a123df7da57b403c8e9410cced19050b', 'request_id': 'req-19cab24c-ed8f-457b-b595-fc1942fcda56'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:29.963710 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-19cab24c-ed8f-457b-b595-fc1942fcda56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a123df7da57b403c8e9410cced19050b', 'request_id': 'req-19cab24c-ed8f-457b-b595-fc1942fcda56'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:30.028428 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-19cab24c-ed8f-457b-b595-fc1942fcda56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a123df7da57b403c8e9410cced19050b', 'request_id': 'req-19cab24c-ed8f-457b-b595-fc1942fcda56'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:30.048366 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-19cab24c-ed8f-457b-b595-fc1942fcda56 admin admin] The token cache is being invalidate because project a123df7da57b403c8e9410cced19050b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:51:30.048701 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-19cab24c-ed8f-457b-b595-fc1942fcda56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:30.052604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-19cab24c-ed8f-457b-b595-fc1942fcda56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:30.058074 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 968/1929] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:51:29 2022] DELETE /identity/v3/projects/a123df7da57b403c8e9410cced19050b => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:30.060323 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214360f5-96cd-4315-97a1-b96757667a6b None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:30.060624 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214360f5-96cd-4315-97a1-b96757667a6b None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:30.060899 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214360f5-96cd-4315-97a1-b96757667a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:30.107774 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-214360f5-96cd-4315-97a1-b96757667a6b None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:30.113018 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-214360f5-96cd-4315-97a1-b96757667a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:30.197685 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 962/1930] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:30.206409 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266a6fa-92a9-402e-99d1-b958c937adbf None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:30.207283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266a6fa-92a9-402e-99d1-b958c937adbf None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:30.207865 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266a6fa-92a9-402e-99d1-b958c937adbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:30.254053 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-0266a6fa-92a9-402e-99d1-b958c937adbf None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:30.258128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-0266a6fa-92a9-402e-99d1-b958c937adbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:30.284255 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 969/1931] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:30.291908 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214360f5-96cd-4315-97a1-b96757667a6b None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:30.310021 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214360f5-96cd-4315-97a1-b96757667a6b None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:30.317142 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e8e9a-7717-4960-a3cd-d4fdb936b67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:30.318158 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e8e9a-7717-4960-a3cd-d4fdb936b67d admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:30.318928 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e8e9a-7717-4960-a3cd-d4fdb936b67d admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:30.319821 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e8e9a-7717-4960-a3cd-d4fdb936b67d admin admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:30.320712 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e8e9a-7717-4960-a3cd-d4fdb936b67d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:51:30.321414 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e8e9a-7717-4960-a3cd-d4fdb936b67d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:30.324417 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e8e9a-7717-4960-a3cd-d4fdb936b67d admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:30.358169 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 963/1932] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:51:30.362903 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266a6fa-92a9-402e-99d1-b958c937adbf None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:30.371287 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:30.374964 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266a6fa-92a9-402e-99d1-b958c937adbf None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:30.392931 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2197d-c556-4f69-bab1-ea9a80b2b1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:30.397051 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2197d-c556-4f69-bab1-ea9a80b2b1f6 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:30.397051 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2197d-c556-4f69-bab1-ea9a80b2b1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:30.397051 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2197d-c556-4f69-bab1-ea9a80b2b1f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:30.397051 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a2197d-c556-4f69-bab1-ea9a80b2b1f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:30.397051 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a2197d-c556-4f69-bab1-ea9a80b2b1f6 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:30.520515 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 970/1933] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:51:30 2022] POST /identity/v3/projects => generated 367 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:30.525024 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e8e9a-7717-4960-a3cd-d4fdb936b67d admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:30.535852 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e8e9a-7717-4960-a3cd-d4fdb936b67d admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:30.558863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2197d-c556-4f69-bab1-ea9a80b2b1f6 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:30.560990 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-e6a2197d-c556-4f69-bab1-ea9a80b2b1f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:30.606863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:30.707868 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2197d-c556-4f69-bab1-ea9a80b2b1f6 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:30.723177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd5d43-f59f-47cb-abd4-9d539d8c97c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:30.724239 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd5d43-f59f-47cb-abd4-9d539d8c97c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:30.724697 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd5d43-f59f-47cb-abd4-9d539d8c97c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:30.725834 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd5d43-f59f-47cb-abd4-9d539d8c97c4 admin admin] PATH_INFO: `/v3/projects/104d5c5033a14e7b94f26bc854a4448a` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:30.728413 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270fb6c3-b392-4a69-ac05-8e7b588a5919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:30.729064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fb6c3-b392-4a69-ac05-8e7b588a5919 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:30.729892 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fb6c3-b392-4a69-ac05-8e7b588a5919 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:30.730205 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fb6c3-b392-4a69-ac05-8e7b588a5919 admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:30.730339 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd5d43-f59f-47cb-abd4-9d539d8c97c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=104d5c5033a14e7b94f26bc854a4448a)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:30.730896 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270fb6c3-b392-4a69-ac05-8e7b588a5919 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:30.732847 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd5d43-f59f-47cb-abd4-9d539d8c97c4 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:30.733049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270fb6c3-b392-4a69-ac05-8e7b588a5919 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:30.834514 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 964/1934] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:51:30 2022] POST /identity/v3/users => generated 284 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:30.840439 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270fb6c3-b392-4a69-ac05-8e7b588a5919 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:30.855199 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270fb6c3-b392-4a69-ac05-8e7b588a5919 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:30.868754 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641582ea-6354-4ffd-8492-969c086026c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:30.872209 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641582ea-6354-4ffd-8492-969c086026c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:30.872209 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641582ea-6354-4ffd-8492-969c086026c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:30.872209 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641582ea-6354-4ffd-8492-969c086026c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:30.872209 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641582ea-6354-4ffd-8492-969c086026c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:30.873721 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641582ea-6354-4ffd-8492-969c086026c7 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:30.891938 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-8ddd5d43-f59f-47cb-abd4-9d539d8c97c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '104d5c5033a14e7b94f26bc854a4448a', 'request_id': 'req-8ddd5d43-f59f-47cb-abd4-9d539d8c97c4'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:30.898576 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-8ddd5d43-f59f-47cb-abd4-9d539d8c97c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '104d5c5033a14e7b94f26bc854a4448a', 'request_id': 'req-8ddd5d43-f59f-47cb-abd4-9d539d8c97c4'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:30.914414 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 965/1935] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:51:30.915746 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641582ea-6354-4ffd-8492-969c086026c7 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:30.934094 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641582ea-6354-4ffd-8492-969c086026c7 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:30.975869 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-8ddd5d43-f59f-47cb-abd4-9d539d8c97c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '104d5c5033a14e7b94f26bc854a4448a', 'request_id': 'req-8ddd5d43-f59f-47cb-abd4-9d539d8c97c4'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:30.994558 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-8ddd5d43-f59f-47cb-abd4-9d539d8c97c4 admin admin] The token cache is being invalidate because project 104d5c5033a14e7b94f26bc854a4448a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:51:30.995290 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-8ddd5d43-f59f-47cb-abd4-9d539d8c97c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:30.996289 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-8ddd5d43-f59f-47cb-abd4-9d539d8c97c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:31.001673 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 971/1936] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:51:30 2022] DELETE /identity/v3/projects/104d5c5033a14e7b94f26bc854a4448a => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:31.004486 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd5d43-f59f-47cb-abd4-9d539d8c97c4 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:31.017281 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-8ddd5d43-f59f-47cb-abd4-9d539d8c97c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:31.071979 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15658677-e579-4a1e-a613-885d18402ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:31.071979 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15658677-e579-4a1e-a613-885d18402ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:31.071979 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15658677-e579-4a1e-a613-885d18402ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:31.071979 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15658677-e579-4a1e-a613-885d18402ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:31.072418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15658677-e579-4a1e-a613-885d18402ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:31.074046 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15658677-e579-4a1e-a613-885d18402ce9 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:31.098755 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 966/1937] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:51:31.104834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e523352-79df-4efd-ba31-da2f61512196 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:31.106444 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e523352-79df-4efd-ba31-da2f61512196 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:31.106444 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e523352-79df-4efd-ba31-da2f61512196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:31.138869 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-6e523352-79df-4efd-ba31-da2f61512196 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:31.141142 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-6e523352-79df-4efd-ba31-da2f61512196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:31.153111 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd5d43-f59f-47cb-abd4-9d539d8c97c4 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:31.160618 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 967/1938] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:31.161435 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e523352-79df-4efd-ba31-da2f61512196 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:31.169096 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-6e523352-79df-4efd-ba31-da2f61512196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:31.170780 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f40b4-20ce-47b9-8e52-83a12473ec89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:31.171692 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f40b4-20ce-47b9-8e52-83a12473ec89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:31.177688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f40b4-20ce-47b9-8e52-83a12473ec89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:31.178010 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f40b4-20ce-47b9-8e52-83a12473ec89 admin admin] PATH_INFO: `/v3/projects/5ee043250fd245e79a2371dbd2536740` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:31.183336 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f40b4-20ce-47b9-8e52-83a12473ec89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ee043250fd245e79a2371dbd2536740)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:31.185615 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e523352-79df-4efd-ba31-da2f61512196 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:31.188020 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f40b4-20ce-47b9-8e52-83a12473ec89 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:31.190867 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a5a8d-48d8-425c-945c-8878228cd7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:31.191591 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a5a8d-48d8-425c-945c-8878228cd7a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:31.191878 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a5a8d-48d8-425c-945c-8878228cd7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:31.192156 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a5a8d-48d8-425c-945c-8878228cd7a0 admin admin] PATH_INFO: `/v3/projects/3c59602891de4881861c8ad5baa6f5d0/users/ccf986d2496c4749bc66aea08881fe6b/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:31.216052 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a5a8d-48d8-425c-945c-8878228cd7a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c59602891de4881861c8ad5baa6f5d0, user_id=ccf986d2496c4749bc66aea08881fe6b, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:31.224531 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a5a8d-48d8-425c-945c-8878228cd7a0 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:31.326989 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 968/1939] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:51:31 2022] PUT /identity/v3/projects/3c59602891de4881861c8ad5baa6f5d0/users/ccf986d2496c4749bc66aea08881fe6b/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:31.328486 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fecea-1e99-48db-b0c0-1b35dc13cc2e None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:31.329409 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fecea-1e99-48db-b0c0-1b35dc13cc2e None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:31.330625 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fecea-1e99-48db-b0c0-1b35dc13cc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:31.356029 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a65f40b4-20ce-47b9-8e52-83a12473ec89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ee043250fd245e79a2371dbd2536740', 'request_id': 'req-a65f40b4-20ce-47b9-8e52-83a12473ec89'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:31.360634 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-3e4fecea-1e99-48db-b0c0-1b35dc13cc2e None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:31.360999 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-3e4fecea-1e99-48db-b0c0-1b35dc13cc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:31.366995 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a65f40b4-20ce-47b9-8e52-83a12473ec89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ee043250fd245e79a2371dbd2536740', 'request_id': 'req-a65f40b4-20ce-47b9-8e52-83a12473ec89'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:31.438361 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a65f40b4-20ce-47b9-8e52-83a12473ec89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ee043250fd245e79a2371dbd2536740', 'request_id': 'req-a65f40b4-20ce-47b9-8e52-83a12473ec89'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:31.463549 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a65f40b4-20ce-47b9-8e52-83a12473ec89 admin admin] The token cache is being invalidate because project 5ee043250fd245e79a2371dbd2536740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:51:31.464904 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a65f40b4-20ce-47b9-8e52-83a12473ec89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:31.466144 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a65f40b4-20ce-47b9-8e52-83a12473ec89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:31.471006 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 972/1940] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:51:31 2022] DELETE /identity/v3/projects/5ee043250fd245e79a2371dbd2536740 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:31.471006 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a79a7-ebe0-4889-8c22-f66c43619f69 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:31.471006 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a79a7-ebe0-4889-8c22-f66c43619f69 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:31.471332 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a79a7-ebe0-4889-8c22-f66c43619f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:31.487310 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 969/1941] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:31.488592 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fecea-1e99-48db-b0c0-1b35dc13cc2e None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:31.492395 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-3e4fecea-1e99-48db-b0c0-1b35dc13cc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:31.517074 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fecea-1e99-48db-b0c0-1b35dc13cc2e None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:31.530251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532e2bc-d5f5-4bf1-81ad-453293c9f829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:31.530999 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-195a79a7-ebe0-4889-8c22-f66c43619f69 None None] MFA Rules not processed for user `ccf986d2496c4749bc66aea08881fe6b`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:31.531627 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532e2bc-d5f5-4bf1-81ad-453293c9f829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:31.532164 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532e2bc-d5f5-4bf1-81ad-453293c9f829 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:31.532278 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-195a79a7-ebe0-4889-8c22-f66c43619f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:31.532962 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532e2bc-d5f5-4bf1-81ad-453293c9f829 admin admin] PATH_INFO: `/v3/users/ce93114a547e4aa09ef60af8f5f7caa5` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:31.534803 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4532e2bc-d5f5-4bf1-81ad-453293c9f829 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce93114a547e4aa09ef60af8f5f7caa5)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:31.538940 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4532e2bc-d5f5-4bf1-81ad-453293c9f829 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:31.637541 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 973/1942] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:31.640620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a79a7-ebe0-4889-8c22-f66c43619f69 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:31.660657 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a79a7-ebe0-4889-8c22-f66c43619f69 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:31.667556 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5363fc3-1858-4d33-ae53-8fcdaae9c816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:31.668412 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5363fc3-1858-4d33-ae53-8fcdaae9c816 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:31.669130 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5363fc3-1858-4d33-ae53-8fcdaae9c816 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:31.669549 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5363fc3-1858-4d33-ae53-8fcdaae9c816 admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:31.670635 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5363fc3-1858-4d33-ae53-8fcdaae9c816 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:51:31.671109 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5363fc3-1858-4d33-ae53-8fcdaae9c816 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:31.673558 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5363fc3-1858-4d33-ae53-8fcdaae9c816 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:31.699182 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 974/1943] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:51:31.700518 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5363fc3-1858-4d33-ae53-8fcdaae9c816 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:31.707422 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-a5363fc3-1858-4d33-ae53-8fcdaae9c816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:31.758242 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-4532e2bc-d5f5-4bf1-81ad-453293c9f829 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce93114a547e4aa09ef60af8f5f7caa5'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:31.789465 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5363fc3-1858-4d33-ae53-8fcdaae9c816 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:31.795304 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32389f0d-2b4f-4b1e-bcae-27bb6fe6fd2a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab95367403451b921099425345b3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:31.796225 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32389f0d-2b4f-4b1e-bcae-27bb6fe6fd2a service glance] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:31.796645 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32389f0d-2b4f-4b1e-bcae-27bb6fe6fd2a service glance] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:31.797418 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32389f0d-2b4f-4b1e-bcae-27bb6fe6fd2a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:31.815611 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32389f0d-2b4f-4b1e-bcae-27bb6fe6fd2a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:31.822469 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32389f0d-2b4f-4b1e-bcae-27bb6fe6fd2a service glance] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:31.827199 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-4532e2bc-d5f5-4bf1-81ad-453293c9f829 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce93114a547e4aa09ef60af8f5f7caa5'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:31.828075 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-4532e2bc-d5f5-4bf1-81ad-453293c9f829 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce93114a547e4aa09ef60af8f5f7caa5'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:31.828660 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-4532e2bc-d5f5-4bf1-81ad-453293c9f829 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce93114a547e4aa09ef60af8f5f7caa5'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:31.838155 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-4532e2bc-d5f5-4bf1-81ad-453293c9f829 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce93114a547e4aa09ef60af8f5f7caa5'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:31.842150 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 975/1944] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:51:31.843481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32389f0d-2b4f-4b1e-bcae-27bb6fe6fd2a service glance] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:31.864849 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32389f0d-2b4f-4b1e-bcae-27bb6fe6fd2a service glance] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:31.889120 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 970/1945] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:51:31 2022] DELETE /identity/v3/users/ce93114a547e4aa09ef60af8f5f7caa5 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:31.903492 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252cdd2-434c-4bd4-86fc-ff68d4ba127e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:31.904366 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252cdd2-434c-4bd4-86fc-ff68d4ba127e admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:31.904770 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252cdd2-434c-4bd4-86fc-ff68d4ba127e admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:31.905190 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252cdd2-434c-4bd4-86fc-ff68d4ba127e admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:31.905987 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252cdd2-434c-4bd4-86fc-ff68d4ba127e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:31.910490 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252cdd2-434c-4bd4-86fc-ff68d4ba127e admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:32.025213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 976/1946] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:51:31 2022] POST /identity/v3/projects => generated 371 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:32.030361 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532e2bc-d5f5-4bf1-81ad-453293c9f829 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:32.032513 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-4532e2bc-d5f5-4bf1-81ad-453293c9f829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:32.034232 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:32.216724 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532e2bc-d5f5-4bf1-81ad-453293c9f829 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:32.313359 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1041d5-a3b5-4e7c-9ac9-88e9f6a7eadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:32.314277 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1041d5-a3b5-4e7c-9ac9-88e9f6a7eadf admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:32.314497 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1041d5-a3b5-4e7c-9ac9-88e9f6a7eadf admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:32.314851 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1041d5-a3b5-4e7c-9ac9-88e9f6a7eadf admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:32.315510 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1041d5-a3b5-4e7c-9ac9-88e9f6a7eadf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:32.317777 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1041d5-a3b5-4e7c-9ac9-88e9f6a7eadf admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:32.409571 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 971/1947] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:51:32 2022] POST /identity/v3/users => generated 286 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:32.413856 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252cdd2-434c-4bd4-86fc-ff68d4ba127e admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:32.429301 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:32.435294 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252cdd2-434c-4bd4-86fc-ff68d4ba127e admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:32.441788 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7828f6e7-9071-45a4-8126-d89df8f0e2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:32.442424 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828f6e7-9071-45a4-8126-d89df8f0e2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:32.442788 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828f6e7-9071-45a4-8126-d89df8f0e2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:32.443092 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828f6e7-9071-45a4-8126-d89df8f0e2b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:32.443747 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7828f6e7-9071-45a4-8126-d89df8f0e2b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:32.446307 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7828f6e7-9071-45a4-8126-d89df8f0e2b9 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:32.464618 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 977/1948] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:51:32.469003 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1041d5-a3b5-4e7c-9ac9-88e9f6a7eadf admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:32.482095 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1041d5-a3b5-4e7c-9ac9-88e9f6a7eadf admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:32.500861 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf289ad8-2d67-4b78-af1e-06e4e701f661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:32.501621 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf289ad8-2d67-4b78-af1e-06e4e701f661 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:32.501805 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf289ad8-2d67-4b78-af1e-06e4e701f661 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:32.503063 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf289ad8-2d67-4b78-af1e-06e4e701f661 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:32.503734 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf289ad8-2d67-4b78-af1e-06e4e701f661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:32.511807 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf289ad8-2d67-4b78-af1e-06e4e701f661 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:32.528660 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 972/1949] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:51:32.532724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7828f6e7-9071-45a4-8126-d89df8f0e2b9 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:32.549440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7828f6e7-9071-45a4-8126-d89df8f0e2b9 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:32.563311 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b5c77-a2f6-445e-ab9f-4fe56b779b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:32.564002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b5c77-a2f6-445e-ab9f-4fe56b779b5b admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:32.564289 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b5c77-a2f6-445e-ab9f-4fe56b779b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:32.564567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b5c77-a2f6-445e-ab9f-4fe56b779b5b admin admin] PATH_INFO: `/v3/projects/3bc5f453020443b990b47de0602e4f06/users/a138d8cbdae44328bdbcbff139f05ebf/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:32.585017 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b5c77-a2f6-445e-ab9f-4fe56b779b5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bc5f453020443b990b47de0602e4f06, user_id=a138d8cbdae44328bdbcbff139f05ebf, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:32.587817 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b5c77-a2f6-445e-ab9f-4fe56b779b5b admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:32.646308 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf289ad8-2d67-4b78-af1e-06e4e701f661 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:32.649127 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-bf289ad8-2d67-4b78-af1e-06e4e701f661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:32.674153 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 978/1950] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:51:32 2022] PUT /identity/v3/projects/3bc5f453020443b990b47de0602e4f06/users/a138d8cbdae44328bdbcbff139f05ebf/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:32.675901 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818a761-030b-4c60-9166-e985eb7fa3d8 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:32.676359 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818a761-030b-4c60-9166-e985eb7fa3d8 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:32.676808 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818a761-030b-4c60-9166-e985eb7fa3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:32.692845 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf289ad8-2d67-4b78-af1e-06e4e701f661 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:32.742939 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-b818a761-030b-4c60-9166-e985eb7fa3d8 None None] MFA Rules not processed for user `a138d8cbdae44328bdbcbff139f05ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:32.744413 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-b818a761-030b-4c60-9166-e985eb7fa3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:32.830809 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 979/1951] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:32.843187 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818a761-030b-4c60-9166-e985eb7fa3d8 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:32.845379 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-b818a761-030b-4c60-9166-e985eb7fa3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:32.857362 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe5537-df53-4a9c-b130-6f0cf1bf2fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:32.859025 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe5537-df53-4a9c-b130-6f0cf1bf2fc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:32.859025 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe5537-df53-4a9c-b130-6f0cf1bf2fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:32.859025 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe5537-df53-4a9c-b130-6f0cf1bf2fc2 admin admin] PATH_INFO: `/v3/projects/af8e8c0d38f34693915bedbab9bfb8b1` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:32.864905 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe5537-df53-4a9c-b130-6f0cf1bf2fc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af8e8c0d38f34693915bedbab9bfb8b1)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:32.869531 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe5537-df53-4a9c-b130-6f0cf1bf2fc2 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:32.915737 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818a761-030b-4c60-9166-e985eb7fa3d8 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:32.921368 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30debae4-63c5-4410-9e8c-bb935ef5a1a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:32.922269 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30debae4-63c5-4410-9e8c-bb935ef5a1a1 service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:32.922621 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30debae4-63c5-4410-9e8c-bb935ef5a1a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:32.923078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30debae4-63c5-4410-9e8c-bb935ef5a1a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:32.933721 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30debae4-63c5-4410-9e8c-bb935ef5a1a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:32.935550 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30debae4-63c5-4410-9e8c-bb935ef5a1a1 service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:32.965422 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 980/1952] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:51:32.990362 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30debae4-63c5-4410-9e8c-bb935ef5a1a1 service cinder] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:33.011551 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30debae4-63c5-4410-9e8c-bb935ef5a1a1 service cinder] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:33.014647 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69fe1f6-adb8-490b-960d-32c03d13238a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:33.015486 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fe1f6-adb8-490b-960d-32c03d13238a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:33.015913 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fe1f6-adb8-490b-960d-32c03d13238a admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:33.016195 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fe1f6-adb8-490b-960d-32c03d13238a admin admin] PATH_INFO: `/v3/users/a138d8cbdae44328bdbcbff139f05ebf` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:33.017475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69fe1f6-adb8-490b-960d-32c03d13238a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a138d8cbdae44328bdbcbff139f05ebf)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:33.019462 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69fe1f6-adb8-490b-960d-32c03d13238a admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:33.058655 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-bcbe5537-df53-4a9c-b130-6f0cf1bf2fc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af8e8c0d38f34693915bedbab9bfb8b1', 'request_id': 'req-bcbe5537-df53-4a9c-b130-6f0cf1bf2fc2'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:33.066721 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-bcbe5537-df53-4a9c-b130-6f0cf1bf2fc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af8e8c0d38f34693915bedbab9bfb8b1', 'request_id': 'req-bcbe5537-df53-4a9c-b130-6f0cf1bf2fc2'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:33.146530 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-bcbe5537-df53-4a9c-b130-6f0cf1bf2fc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af8e8c0d38f34693915bedbab9bfb8b1', 'request_id': 'req-bcbe5537-df53-4a9c-b130-6f0cf1bf2fc2'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:33.163564 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-bcbe5537-df53-4a9c-b130-6f0cf1bf2fc2 admin admin] The token cache is being invalidate because project af8e8c0d38f34693915bedbab9bfb8b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:51:33.163857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-bcbe5537-df53-4a9c-b130-6f0cf1bf2fc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:33.164830 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-bcbe5537-df53-4a9c-b130-6f0cf1bf2fc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:33.166775 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 973/1953] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:51:32 2022] DELETE /identity/v3/projects/af8e8c0d38f34693915bedbab9bfb8b1 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:51:33.171267 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb5b9d-d3ee-4368-bd6f-eaecf48606ca None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:33.171585 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb5b9d-d3ee-4368-bd6f-eaecf48606ca None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:33.171857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb5b9d-d3ee-4368-bd6f-eaecf48606ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:33.194567 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-edbb5b9d-d3ee-4368-bd6f-eaecf48606ca None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:33.195939 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-edbb5b9d-d3ee-4368-bd6f-eaecf48606ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:33.210965 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:33.263421 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a69fe1f6-adb8-490b-960d-32c03d13238a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a138d8cbdae44328bdbcbff139f05ebf'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:33.274144 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 974/1954] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:51:33.282274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec4a51-6ed8-4a3d-adda-69a895094fe0 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:33.282566 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec4a51-6ed8-4a3d-adda-69a895094fe0 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:33.283046 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec4a51-6ed8-4a3d-adda-69a895094fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:33.303037 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-10ec4a51-6ed8-4a3d-adda-69a895094fe0 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:33.304261 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-10ec4a51-6ed8-4a3d-adda-69a895094fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:33.312845 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 975/1955] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:51:33.317701 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec4a51-6ed8-4a3d-adda-69a895094fe0 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:33.328176 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec4a51-6ed8-4a3d-adda-69a895094fe0 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:33.333355 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dda613-977d-462a-a762-59072a64d96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:33.333967 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dda613-977d-462a-a762-59072a64d96a admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:33.334296 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dda613-977d-462a-a762-59072a64d96a admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:33.335040 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dda613-977d-462a-a762-59072a64d96a admin admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:33.335699 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dda613-977d-462a-a762-59072a64d96a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:51:33.336000 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dda613-977d-462a-a762-59072a64d96a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:33.337607 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dda613-977d-462a-a762-59072a64d96a admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:33.349659 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 976/1956] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:51:33.353825 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dda613-977d-462a-a762-59072a64d96a admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:33.359424 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a69fe1f6-adb8-490b-960d-32c03d13238a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a138d8cbdae44328bdbcbff139f05ebf'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:33.363289 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a69fe1f6-adb8-490b-960d-32c03d13238a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a138d8cbdae44328bdbcbff139f05ebf'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:33.363289 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a69fe1f6-adb8-490b-960d-32c03d13238a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a138d8cbdae44328bdbcbff139f05ebf'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:33.363854 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dda613-977d-462a-a762-59072a64d96a admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:33.369075 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a69fe1f6-adb8-490b-960d-32c03d13238a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a138d8cbdae44328bdbcbff139f05ebf'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:33.370033 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ccea40-5268-4674-adf2-fe1c3a84b3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:33.371901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccea40-5268-4674-adf2-fe1c3a84b3a9 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:33.372022 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccea40-5268-4674-adf2-fe1c3a84b3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:33.372257 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccea40-5268-4674-adf2-fe1c3a84b3a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:33.373200 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ccea40-5268-4674-adf2-fe1c3a84b3a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:33.375198 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ccea40-5268-4674-adf2-fe1c3a84b3a9 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:33.392233 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 981/1957] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:51:32 2022] DELETE /identity/v3/users/a138d8cbdae44328bdbcbff139f05ebf => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:51:33.394342 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbe5ff-6d28-49f3-bacb-f1937fd7fbe1 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:33.394631 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbe5ff-6d28-49f3-bacb-f1937fd7fbe1 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:33.394908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbe5ff-6d28-49f3-bacb-f1937fd7fbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:33.415152 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-61cbe5ff-6d28-49f3-bacb-f1937fd7fbe1 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:33.416185 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-61cbe5ff-6d28-49f3-bacb-f1937fd7fbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:33.474787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 977/1958] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:51:33 2022] POST /identity/v3/projects => generated 387 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:51:33.476271 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ccea40-5268-4674-adf2-fe1c3a84b3a9 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:33.478293 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-f0ccea40-5268-4674-adf2-fe1c3a84b3a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:33.490496 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 982/1959] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:33.501839 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbe5ff-6d28-49f3-bacb-f1937fd7fbe1 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:33.506741 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-61cbe5ff-6d28-49f3-bacb-f1937fd7fbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:33.560983 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ccea40-5268-4674-adf2-fe1c3a84b3a9 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:33.566071 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3539a7-3632-4309-b989-b354729713e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:33.566807 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3539a7-3632-4309-b989-b354729713e4 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:33.567161 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3539a7-3632-4309-b989-b354729713e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:33.567490 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3539a7-3632-4309-b989-b354729713e4 admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:33.568412 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3539a7-3632-4309-b989-b354729713e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:33.570422 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3539a7-3632-4309-b989-b354729713e4 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:33.579040 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbe5ff-6d28-49f3-bacb-f1937fd7fbe1 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:33.647021 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ce62d-a370-4fe8-b33f-ed01250eaf35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:33.647793 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ce62d-a370-4fe8-b33f-ed01250eaf35 service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:33.648463 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ce62d-a370-4fe8-b33f-ed01250eaf35 service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:33.649017 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ce62d-a370-4fe8-b33f-ed01250eaf35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:33.666046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ce62d-a370-4fe8-b33f-ed01250eaf35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:33.668421 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ce62d-a370-4fe8-b33f-ed01250eaf35 service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:33.685980 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 983/1960] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:51:33.730854 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 978/1961] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:51:33 2022] POST /identity/v3/users => generated 294 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:33.731270 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ce62d-a370-4fe8-b33f-ed01250eaf35 service neutron] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:33.742620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ce62d-a370-4fe8-b33f-ed01250eaf35 service neutron] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:33.749794 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b33eec-19b4-432b-8a4d-86405e15b92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:33.750410 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b33eec-19b4-432b-8a4d-86405e15b92c admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:33.750780 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b33eec-19b4-432b-8a4d-86405e15b92c admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:33.750944 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b33eec-19b4-432b-8a4d-86405e15b92c admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:33.752077 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b33eec-19b4-432b-8a4d-86405e15b92c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:33.753799 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b33eec-19b4-432b-8a4d-86405e15b92c admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:33.776734 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 984/1962] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:51:33.776944 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3539a7-3632-4309-b989-b354729713e4 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:33.788214 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3539a7-3632-4309-b989-b354729713e4 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:33.797324 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706149f-dc37-4979-860d-dd55d37b494d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:33.797959 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706149f-dc37-4979-860d-dd55d37b494d admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:33.798240 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706149f-dc37-4979-860d-dd55d37b494d admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:33.798516 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706149f-dc37-4979-860d-dd55d37b494d admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:33.799166 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706149f-dc37-4979-860d-dd55d37b494d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:33.800815 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706149f-dc37-4979-860d-dd55d37b494d admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:33.812810 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 979/1963] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:51:33.817151 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b33eec-19b4-432b-8a4d-86405e15b92c admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:33.830095 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b33eec-19b4-432b-8a4d-86405e15b92c admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:33.835657 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ba400-8c83-484f-bdcb-14b2e29b1518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:33.836446 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ba400-8c83-484f-bdcb-14b2e29b1518 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:33.836851 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ba400-8c83-484f-bdcb-14b2e29b1518 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:33.837845 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ba400-8c83-484f-bdcb-14b2e29b1518 admin admin] PATH_INFO: `/v3/projects/cd8284c864984530869171fb79ac399d/users/d53ba8ef95184b4b8e2939353c63f6c9/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:33.856385 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ba400-8c83-484f-bdcb-14b2e29b1518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd8284c864984530869171fb79ac399d, user_id=d53ba8ef95184b4b8e2939353c63f6c9, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:33.859187 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ba400-8c83-484f-bdcb-14b2e29b1518 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:33.924718 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 985/1964] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:51:33 2022] PUT /identity/v3/projects/cd8284c864984530869171fb79ac399d/users/d53ba8ef95184b4b8e2939353c63f6c9/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:33.939433 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39aaaf8-5ccb-4fd3-a0b5-0aab1ab6a318 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:33.943340 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39aaaf8-5ccb-4fd3-a0b5-0aab1ab6a318 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:33.943340 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39aaaf8-5ccb-4fd3-a0b5-0aab1ab6a318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:33.975472 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-b39aaaf8-5ccb-4fd3-a0b5-0aab1ab6a318 None None] MFA Rules not processed for user `d53ba8ef95184b4b8e2939353c63f6c9`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:33.976947 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-b39aaaf8-5ccb-4fd3-a0b5-0aab1ab6a318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:34.102596 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 980/1965] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:34.108255 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ba400-8c83-484f-bdcb-14b2e29b1518 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:34.178037 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:34.179871 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39aaaf8-5ccb-4fd3-a0b5-0aab1ab6a318 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:34.181754 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-b39aaaf8-5ccb-4fd3-a0b5-0aab1ab6a318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:34.224646 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ba400-8c83-484f-bdcb-14b2e29b1518 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:34.242750 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5a834-cbcf-4262-a360-a9f0e727e9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:34.242750 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5a834-cbcf-4262-a360-a9f0e727e9bf admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:34.242750 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5a834-cbcf-4262-a360-a9f0e727e9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:34.242750 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5a834-cbcf-4262-a360-a9f0e727e9bf admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:34.243206 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5a834-cbcf-4262-a360-a9f0e727e9bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:34.243206 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5a834-cbcf-4262-a360-a9f0e727e9bf admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:34.262019 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:34.323198 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39aaaf8-5ccb-4fd3-a0b5-0aab1ab6a318 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:34.329187 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1bdc8-67be-44f0-95e5-0228ec4ddf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:34.329913 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1bdc8-67be-44f0-95e5-0228ec4ddf68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:34.330191 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1bdc8-67be-44f0-95e5-0228ec4ddf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:34.330472 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1bdc8-67be-44f0-95e5-0228ec4ddf68 admin admin] PATH_INFO: `/v3/projects/3bc5f453020443b990b47de0602e4f06` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:34.331783 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1bdc8-67be-44f0-95e5-0228ec4ddf68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bc5f453020443b990b47de0602e4f06)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:34.333812 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1bdc8-67be-44f0-95e5-0228ec4ddf68 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:34.365084 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 986/1966] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:51:34 2022] POST /identity/v3/projects => generated 385 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:34.368992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5a834-cbcf-4262-a360-a9f0e727e9bf admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:34.435501 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-2ef1bdc8-67be-44f0-95e5-0228ec4ddf68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bc5f453020443b990b47de0602e4f06', 'request_id': 'req-2ef1bdc8-67be-44f0-95e5-0228ec4ddf68'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:34.441840 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-2ef1bdc8-67be-44f0-95e5-0228ec4ddf68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bc5f453020443b990b47de0602e4f06', 'request_id': 'req-2ef1bdc8-67be-44f0-95e5-0228ec4ddf68'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:34.447750 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5a834-cbcf-4262-a360-a9f0e727e9bf admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:34.501919 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-2ef1bdc8-67be-44f0-95e5-0228ec4ddf68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bc5f453020443b990b47de0602e4f06', 'request_id': 'req-2ef1bdc8-67be-44f0-95e5-0228ec4ddf68'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:34.517586 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-2ef1bdc8-67be-44f0-95e5-0228ec4ddf68 admin admin] The token cache is being invalidate because project 3bc5f453020443b990b47de0602e4f06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:51:34.520112 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-2ef1bdc8-67be-44f0-95e5-0228ec4ddf68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:34.520112 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-2ef1bdc8-67be-44f0-95e5-0228ec4ddf68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:34.520573 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 981/1967] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:51:34 2022] DELETE /identity/v3/projects/3bc5f453020443b990b47de0602e4f06 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:51:34.521780 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e9a35-b4c4-4a69-ac1f-360b16201802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:34.522641 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e9a35-b4c4-4a69-ac1f-360b16201802 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:34.522922 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e9a35-b4c4-4a69-ac1f-360b16201802 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:34.523294 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e9a35-b4c4-4a69-ac1f-360b16201802 admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:34.524150 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e9a35-b4c4-4a69-ac1f-360b16201802 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:34.526291 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e9a35-b4c4-4a69-ac1f-360b16201802 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:34.527981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7dc93-f57a-477f-926e-c6ccdccf6587 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:34.528313 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7dc93-f57a-477f-926e-c6ccdccf6587 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:34.529676 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7dc93-f57a-477f-926e-c6ccdccf6587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:34.563042 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-02b7dc93-f57a-477f-926e-c6ccdccf6587 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:34.569285 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-02b7dc93-f57a-477f-926e-c6ccdccf6587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:34.579279 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 982/1968] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:34.587883 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a9eb4-a22b-4020-aa79-e55e06fd55ed None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:34.588166 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a9eb4-a22b-4020-aa79-e55e06fd55ed None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:34.588469 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a9eb4-a22b-4020-aa79-e55e06fd55ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:34.605434 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 987/1969] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:51:34 2022] POST /identity/v3/users => generated 299 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:34.606840 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e9a35-b4c4-4a69-ac1f-360b16201802 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:34.608827 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-d90e9a35-b4c4-4a69-ac1f-360b16201802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:34.614980 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-367a9eb4-a22b-4020-aa79-e55e06fd55ed None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:34.616124 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-367a9eb4-a22b-4020-aa79-e55e06fd55ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:34.625986 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e9a35-b4c4-4a69-ac1f-360b16201802 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:34.632242 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 983/1970] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:34.633433 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a9eb4-a22b-4020-aa79-e55e06fd55ed None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:34.640672 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60291ed-ab3c-4c11-9dc8-b669657a2140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:34.641429 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60291ed-ab3c-4c11-9dc8-b669657a2140 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:34.641787 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60291ed-ab3c-4c11-9dc8-b669657a2140 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:34.642123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60291ed-ab3c-4c11-9dc8-b669657a2140 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:34.642896 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60291ed-ab3c-4c11-9dc8-b669657a2140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:34.644683 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60291ed-ab3c-4c11-9dc8-b669657a2140 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:34.645020 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a9eb4-a22b-4020-aa79-e55e06fd55ed None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:34.651141 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70de330-d750-4082-85ad-fff29edb490a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:34.653183 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70de330-d750-4082-85ad-fff29edb490a admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:34.653620 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70de330-d750-4082-85ad-fff29edb490a admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:34.654046 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70de330-d750-4082-85ad-fff29edb490a admin admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:34.655196 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70de330-d750-4082-85ad-fff29edb490a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:51:34.655511 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70de330-d750-4082-85ad-fff29edb490a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:34.657195 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70de330-d750-4082-85ad-fff29edb490a admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:34.663360 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 988/1971] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:51:34.665555 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60291ed-ab3c-4c11-9dc8-b669657a2140 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:34.674661 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 984/1972] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:51:34.675722 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70de330-d750-4082-85ad-fff29edb490a admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:34.687764 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70de330-d750-4082-85ad-fff29edb490a admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:34.693617 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60291ed-ab3c-4c11-9dc8-b669657a2140 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:34.696882 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d41704-cc3b-4907-a62a-36b06e7ba3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:34.698418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d41704-cc3b-4907-a62a-36b06e7ba3a6 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:34.698742 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d41704-cc3b-4907-a62a-36b06e7ba3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:34.699025 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d41704-cc3b-4907-a62a-36b06e7ba3a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:34.699706 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d41704-cc3b-4907-a62a-36b06e7ba3a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:34.701714 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d41704-cc3b-4907-a62a-36b06e7ba3a6 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:34.709992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34ed81-78ad-406f-8ccb-edc7d0aadac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:34.713188 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34ed81-78ad-406f-8ccb-edc7d0aadac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:34.713188 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34ed81-78ad-406f-8ccb-edc7d0aadac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:34.713188 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34ed81-78ad-406f-8ccb-edc7d0aadac7 admin admin] PATH_INFO: `/v3/projects/db30669c86a545dd82e15dbb970df131/users/512115a7c7af4551ab91693fafd8c471/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:34.732711 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34ed81-78ad-406f-8ccb-edc7d0aadac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db30669c86a545dd82e15dbb970df131, user_id=512115a7c7af4551ab91693fafd8c471, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:34.736166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34ed81-78ad-406f-8ccb-edc7d0aadac7 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:34.810047 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 985/1973] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:51:34 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:51:34.813613 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d41704-cc3b-4907-a62a-36b06e7ba3a6 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:34.824468 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 989/1974] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:51:34 2022] PUT /identity/v3/projects/db30669c86a545dd82e15dbb970df131/users/512115a7c7af4551ab91693fafd8c471/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:34.834173 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34ed81-78ad-406f-8ccb-edc7d0aadac7 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:34.907653 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d41704-cc3b-4907-a62a-36b06e7ba3a6 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:34.924665 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34ed81-78ad-406f-8ccb-edc7d0aadac7 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:34.927613 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:34.929631 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f9b5c-513f-48ec-b838-be9defd8b626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:34.939954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f9b5c-513f-48ec-b838-be9defd8b626 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:34.939954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f9b5c-513f-48ec-b838-be9defd8b626 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:34.939954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f9b5c-513f-48ec-b838-be9defd8b626 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:34.939954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f9b5c-513f-48ec-b838-be9defd8b626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:34.939954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f9b5c-513f-48ec-b838-be9defd8b626 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:34.947046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 990/1975] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:51:34.952163 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f9b5c-513f-48ec-b838-be9defd8b626 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:34.967080 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f9b5c-513f-48ec-b838-be9defd8b626 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:34.974278 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3b39a-69f5-44a5-8567-275ea77bc5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:34.975240 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3b39a-69f5-44a5-8567-275ea77bc5c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:34.975737 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3b39a-69f5-44a5-8567-275ea77bc5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:34.976370 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3b39a-69f5-44a5-8567-275ea77bc5c3 admin admin] PATH_INFO: `/v3/projects/db30669c86a545dd82e15dbb970df131/users/512115a7c7af4551ab91693fafd8c471/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:34.979294 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3b39a-69f5-44a5-8567-275ea77bc5c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db30669c86a545dd82e15dbb970df131, user_id=512115a7c7af4551ab91693fafd8c471, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:34.983185 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3b39a-69f5-44a5-8567-275ea77bc5c3 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:34.994711 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d624e-6db6-4490-ac3c-2d29b62ba131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:34.996808 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d624e-6db6-4490-ac3c-2d29b62ba131 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:34.996808 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d624e-6db6-4490-ac3c-2d29b62ba131 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:35.006838 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d624e-6db6-4490-ac3c-2d29b62ba131 admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:35.007025 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 991/1976] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:51:34 2022] PUT /identity/v3/projects/db30669c86a545dd82e15dbb970df131/users/512115a7c7af4551ab91693fafd8c471/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:35.007134 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d624e-6db6-4490-ac3c-2d29b62ba131 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:35.007134 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d624e-6db6-4490-ac3c-2d29b62ba131 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:35.010458 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde24e88-3927-4033-b046-6c25d92ea2bc None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:35.011230 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde24e88-3927-4033-b046-6c25d92ea2bc None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:35.011739 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde24e88-3927-4033-b046-6c25d92ea2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:35.044181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-dde24e88-3927-4033-b046-6c25d92ea2bc None None] MFA Rules not processed for user `512115a7c7af4551ab91693fafd8c471`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:35.045488 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-dde24e88-3927-4033-b046-6c25d92ea2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:35.109890 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 986/1977] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:51:34 2022] POST /identity/v3/users => generated 293 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:35.113707 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d624e-6db6-4490-ac3c-2d29b62ba131 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:35.114233 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:35.124732 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d624e-6db6-4490-ac3c-2d29b62ba131 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:35.125717 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 992/1978] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:35 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:35.142857 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde24e88-3927-4033-b046-6c25d92ea2bc None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:35.146395 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-dde24e88-3927-4033-b046-6c25d92ea2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:35.204418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fca99-ea8b-417a-ab90-37dadec10c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:35.205782 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fca99-ea8b-417a-ab90-37dadec10c46 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:35.205782 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fca99-ea8b-417a-ab90-37dadec10c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:35.206228 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fca99-ea8b-417a-ab90-37dadec10c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:35.206890 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367fca99-ea8b-417a-ab90-37dadec10c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:35.208557 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367fca99-ea8b-417a-ab90-37dadec10c46 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:35.218812 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 987/1979] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:51:35.223864 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fca99-ea8b-417a-ab90-37dadec10c46 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:35.233567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde24e88-3927-4033-b046-6c25d92ea2bc None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:35.241893 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6f9a0-6e87-4799-a015-77fb90a746ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:35.242539 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6f9a0-6e87-4799-a015-77fb90a746ed service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:35.242823 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6f9a0-6e87-4799-a015-77fb90a746ed service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:35.243100 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6f9a0-6e87-4799-a015-77fb90a746ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:35.246130 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fca99-ea8b-417a-ab90-37dadec10c46 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:35.252370 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f087d-965c-401b-93e0-4547191b575f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:35.252501 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f087d-965c-401b-93e0-4547191b575f admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:35.252910 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f087d-965c-401b-93e0-4547191b575f admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:35.253215 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f087d-965c-401b-93e0-4547191b575f admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:35.253881 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f087d-965c-401b-93e0-4547191b575f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:35.265947 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f087d-965c-401b-93e0-4547191b575f admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:35.266149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c6f9a0-6e87-4799-a015-77fb90a746ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:35.266149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c6f9a0-6e87-4799-a015-77fb90a746ed service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:35.269787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 988/1980] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:51:35.274164 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f087d-965c-401b-93e0-4547191b575f admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:35.275066 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 993/1981] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:35 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:51:35.290277 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f087d-965c-401b-93e0-4547191b575f admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:35.297290 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e94e66-e09d-4e17-ac55-40f75243b08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:35.298301 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e94e66-e09d-4e17-ac55-40f75243b08a admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:35.299030 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e94e66-e09d-4e17-ac55-40f75243b08a admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:35.299519 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e94e66-e09d-4e17-ac55-40f75243b08a admin admin] PATH_INFO: `/v3/projects/751da548652745fcb545ebe626346141/users/d69d0a4ead38423b84ca5a28372e7017/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:35.312656 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6f9a0-6e87-4799-a015-77fb90a746ed service cinder] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:35.334677 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e94e66-e09d-4e17-ac55-40f75243b08a admin admin] RBAC: Authorizing `identity:create_grant(project_id=751da548652745fcb545ebe626346141, user_id=d69d0a4ead38423b84ca5a28372e7017, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:35.339766 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6f9a0-6e87-4799-a015-77fb90a746ed service cinder] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:35.341071 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e94e66-e09d-4e17-ac55-40f75243b08a admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:35.355647 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c534faa-6ce1-485e-b41e-3e04a5401694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:35.362147 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c534faa-6ce1-485e-b41e-3e04a5401694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:35.362147 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c534faa-6ce1-485e-b41e-3e04a5401694 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:35.362147 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c534faa-6ce1-485e-b41e-3e04a5401694 admin admin] PATH_INFO: `/v3/users/d53ba8ef95184b4b8e2939353c63f6c9` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:35.362147 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c534faa-6ce1-485e-b41e-3e04a5401694 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d53ba8ef95184b4b8e2939353c63f6c9)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:35.362525 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c534faa-6ce1-485e-b41e-3e04a5401694 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:35.434408 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 989/1982] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:51:35 2022] PUT /identity/v3/projects/751da548652745fcb545ebe626346141/users/d69d0a4ead38423b84ca5a28372e7017/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:35.438240 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa24d45-f02d-4fa7-a0d9-4ec95dedfaa9 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:35.438655 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa24d45-f02d-4fa7-a0d9-4ec95dedfaa9 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:35.438995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa24d45-f02d-4fa7-a0d9-4ec95dedfaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:35.470133 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-6aa24d45-f02d-4fa7-a0d9-4ec95dedfaa9 None None] MFA Rules not processed for user `d69d0a4ead38423b84ca5a28372e7017`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:35.471380 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-6aa24d45-f02d-4fa7-a0d9-4ec95dedfaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:35.543356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 990/1983] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:51:35.555504 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa24d45-f02d-4fa7-a0d9-4ec95dedfaa9 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:35.610880 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-6c534faa-6ce1-485e-b41e-3e04a5401694 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd53ba8ef95184b4b8e2939353c63f6c9'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:35.651690 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa24d45-f02d-4fa7-a0d9-4ec95dedfaa9 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:35.656594 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b8d87-5ef9-45cf-9b6c-01a4fc392cd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:35.657245 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b8d87-5ef9-45cf-9b6c-01a4fc392cd4 service cinder] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:35.657523 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b8d87-5ef9-45cf-9b6c-01a4fc392cd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:35.657795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b8d87-5ef9-45cf-9b6c-01a4fc392cd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:35.671246 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b8d87-5ef9-45cf-9b6c-01a4fc392cd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:35.681983 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b8d87-5ef9-45cf-9b6c-01a4fc392cd4 service cinder] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:35.692679 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 991/1984] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:51:35.702196 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-6c534faa-6ce1-485e-b41e-3e04a5401694 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd53ba8ef95184b4b8e2939353c63f6c9'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:35.705193 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-6c534faa-6ce1-485e-b41e-3e04a5401694 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd53ba8ef95184b4b8e2939353c63f6c9'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:35.705193 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-6c534faa-6ce1-485e-b41e-3e04a5401694 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd53ba8ef95184b4b8e2939353c63f6c9'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:35.712855 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-6c534faa-6ce1-485e-b41e-3e04a5401694 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd53ba8ef95184b4b8e2939353c63f6c9'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:35.740405 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 994/1985] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:51:35 2022] DELETE /identity/v3/users/d53ba8ef95184b4b8e2939353c63f6c9 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:35.742128 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b72b8-7ed3-444a-a137-4698cbf9bd61 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:35.742421 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b72b8-7ed3-444a-a137-4698cbf9bd61 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:35.742749 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b72b8-7ed3-444a-a137-4698cbf9bd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:35.771583 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-615b72b8-7ed3-444a-a137-4698cbf9bd61 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:35.772801 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-615b72b8-7ed3-444a-a137-4698cbf9bd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:35.848505 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 992/1986] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:51:35.864040 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c534faa-6ce1-485e-b41e-3e04a5401694 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:35.866333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-6c534faa-6ce1-485e-b41e-3e04a5401694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:35.925509 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c534faa-6ce1-485e-b41e-3e04a5401694 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:35.929065 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c548c-f506-4896-8580-b9b7dc719cb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:35.929740 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c548c-f506-4896-8580-b9b7dc719cb3 service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:35.930095 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c548c-f506-4896-8580-b9b7dc719cb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:35.930437 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c548c-f506-4896-8580-b9b7dc719cb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:35.941086 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c548c-f506-4896-8580-b9b7dc719cb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:35.942538 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c548c-f506-4896-8580-b9b7dc719cb3 service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:35.953796 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 995/1987] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:51:36.285179 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:36.477862 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b72b8-7ed3-444a-a137-4698cbf9bd61 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:36.482110 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-615b72b8-7ed3-444a-a137-4698cbf9bd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:36.494508 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b72b8-7ed3-444a-a137-4698cbf9bd61 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:36.502580 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a73dbb-8a68-4b96-97bf-80855def08be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:36.503284 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a73dbb-8a68-4b96-97bf-80855def08be admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:36.503568 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a73dbb-8a68-4b96-97bf-80855def08be admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:36.503839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a73dbb-8a68-4b96-97bf-80855def08be admin admin] PATH_INFO: `/v3/projects/cd8284c864984530869171fb79ac399d` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:36.505011 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a73dbb-8a68-4b96-97bf-80855def08be admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd8284c864984530869171fb79ac399d)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:36.507174 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a73dbb-8a68-4b96-97bf-80855def08be admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:36.618446 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-51a73dbb-8a68-4b96-97bf-80855def08be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd8284c864984530869171fb79ac399d', 'request_id': 'req-51a73dbb-8a68-4b96-97bf-80855def08be'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:36.623933 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-51a73dbb-8a68-4b96-97bf-80855def08be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd8284c864984530869171fb79ac399d', 'request_id': 'req-51a73dbb-8a68-4b96-97bf-80855def08be'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:36.679116 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:36.707652 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-51a73dbb-8a68-4b96-97bf-80855def08be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd8284c864984530869171fb79ac399d', 'request_id': 'req-51a73dbb-8a68-4b96-97bf-80855def08be'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:36.723045 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-51a73dbb-8a68-4b96-97bf-80855def08be admin admin] The token cache is being invalidate because project cd8284c864984530869171fb79ac399d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:51:36.723398 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-51a73dbb-8a68-4b96-97bf-80855def08be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:36.724112 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-51a73dbb-8a68-4b96-97bf-80855def08be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:36.725628 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 993/1988] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:51:36 2022] DELETE /identity/v3/projects/cd8284c864984530869171fb79ac399d => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:36.729855 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c548c-f506-4896-8580-b9b7dc719cb3 service neutron] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:36.740136 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c548c-f506-4896-8580-b9b7dc719cb3 service neutron] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:36.798272 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db59aae-ab5a-44e0-905e-996fb57ea375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:36.798913 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db59aae-ab5a-44e0-905e-996fb57ea375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:36.799198 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db59aae-ab5a-44e0-905e-996fb57ea375 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:36.799474 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db59aae-ab5a-44e0-905e-996fb57ea375 admin admin] PATH_INFO: `/v3/users/512115a7c7af4551ab91693fafd8c471` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:36.800663 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db59aae-ab5a-44e0-905e-996fb57ea375 admin admin] RBAC: Authorizing `identity:delete_user(user_id=512115a7c7af4551ab91693fafd8c471)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:36.802752 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db59aae-ab5a-44e0-905e-996fb57ea375 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:36.994974 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-4db59aae-ab5a-44e0-905e-996fb57ea375 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '512115a7c7af4551ab91693fafd8c471'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:37.055826 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-4db59aae-ab5a-44e0-905e-996fb57ea375 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '512115a7c7af4551ab91693fafd8c471'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:37.056477 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-4db59aae-ab5a-44e0-905e-996fb57ea375 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '512115a7c7af4551ab91693fafd8c471'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:37.057126 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-4db59aae-ab5a-44e0-905e-996fb57ea375 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '512115a7c7af4551ab91693fafd8c471'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:37.065111 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-4db59aae-ab5a-44e0-905e-996fb57ea375 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '512115a7c7af4551ab91693fafd8c471'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:37.083874 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 996/1989] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:51:36 2022] DELETE /identity/v3/users/512115a7c7af4551ab91693fafd8c471 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:37.508971 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a73dbb-8a68-4b96-97bf-80855def08be admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:37.510514 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-51a73dbb-8a68-4b96-97bf-80855def08be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:37.530859 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a73dbb-8a68-4b96-97bf-80855def08be admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:37.611830 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669128c-2189-4cb6-9eee-5478d0773d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:37.612577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669128c-2189-4cb6-9eee-5478d0773d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:37.612868 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669128c-2189-4cb6-9eee-5478d0773d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:37.613192 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669128c-2189-4cb6-9eee-5478d0773d59 admin admin] PATH_INFO: `/v3/projects/db30669c86a545dd82e15dbb970df131` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:37.614337 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669128c-2189-4cb6-9eee-5478d0773d59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db30669c86a545dd82e15dbb970df131)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:37.616269 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669128c-2189-4cb6-9eee-5478d0773d59 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:37.715703 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-7669128c-2189-4cb6-9eee-5478d0773d59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db30669c86a545dd82e15dbb970df131', 'request_id': 'req-7669128c-2189-4cb6-9eee-5478d0773d59'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:37.718099 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:37.722311 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-7669128c-2189-4cb6-9eee-5478d0773d59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db30669c86a545dd82e15dbb970df131', 'request_id': 'req-7669128c-2189-4cb6-9eee-5478d0773d59'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:37.792052 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-7669128c-2189-4cb6-9eee-5478d0773d59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db30669c86a545dd82e15dbb970df131', 'request_id': 'req-7669128c-2189-4cb6-9eee-5478d0773d59'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:37.794762 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=75,keystone:DELETE=22,keystone:INSERT=3 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:37.806621 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-7669128c-2189-4cb6-9eee-5478d0773d59 admin admin] The token cache is being invalidate because project db30669c86a545dd82e15dbb970df131 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:51:37.806921 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-7669128c-2189-4cb6-9eee-5478d0773d59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:37.807614 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-7669128c-2189-4cb6-9eee-5478d0773d59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:37.809870 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 994/1990] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:51:37 2022] DELETE /identity/v3/projects/db30669c86a545dd82e15dbb970df131 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:37.814936 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198a790-a659-4565-84f6-37a0c99ca82e None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:37.815247 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198a790-a659-4565-84f6-37a0c99ca82e None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:37.815502 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198a790-a659-4565-84f6-37a0c99ca82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:37.836476 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-b198a790-a659-4565-84f6-37a0c99ca82e None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:37.837878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-b198a790-a659-4565-84f6-37a0c99ca82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:37.909603 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 997/1991] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:37.922044 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bca4a-e2fc-4951-a397-2cba9c72c4d5 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:37.922342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bca4a-e2fc-4951-a397-2cba9c72c4d5 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:37.922615 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bca4a-e2fc-4951-a397-2cba9c72c4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:37.957883 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-447bca4a-e2fc-4951-a397-2cba9c72c4d5 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:37.959150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-447bca4a-e2fc-4951-a397-2cba9c72c4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:37.974378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 995/1992] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:37.979032 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198a790-a659-4565-84f6-37a0c99ca82e None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:37.990072 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198a790-a659-4565-84f6-37a0c99ca82e None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:37.994722 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1779e9-2ea3-446a-93d0-6679ee407f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:37.995327 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1779e9-2ea3-446a-93d0-6679ee407f77 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:37.995926 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1779e9-2ea3-446a-93d0-6679ee407f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:37.996018 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1779e9-2ea3-446a-93d0-6679ee407f77 admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:37.996644 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1779e9-2ea3-446a-93d0-6679ee407f77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:51:37.996931 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1779e9-2ea3-446a-93d0-6679ee407f77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:37.998571 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1779e9-2ea3-446a-93d0-6679ee407f77 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:38.010879 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 998/1993] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:51:38.015660 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447bca4a-e2fc-4951-a397-2cba9c72c4d5 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:38.025424 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447bca4a-e2fc-4951-a397-2cba9c72c4d5 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:38.031150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2d5d7-e7b7-47b9-beac-8879f987502f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:38.031771 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2d5d7-e7b7-47b9-beac-8879f987502f admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:38.032078 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2d5d7-e7b7-47b9-beac-8879f987502f admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:38.032353 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2d5d7-e7b7-47b9-beac-8879f987502f admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:38.032986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b2d5d7-e7b7-47b9-beac-8879f987502f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:38.035063 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b2d5d7-e7b7-47b9-beac-8879f987502f admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:38.116181 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 996/1994] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:51:38 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:38.118141 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1779e9-2ea3-446a-93d0-6679ee407f77 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:38.128401 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1779e9-2ea3-446a-93d0-6679ee407f77 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:38.188375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4296c63-639b-4f32-a2ff-93455a2cacd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:38.189282 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4296c63-639b-4f32-a2ff-93455a2cacd8 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:38.189567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4296c63-639b-4f32-a2ff-93455a2cacd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:38.189843 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4296c63-639b-4f32-a2ff-93455a2cacd8 admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:38.190483 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4296c63-639b-4f32-a2ff-93455a2cacd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:38.192448 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4296c63-639b-4f32-a2ff-93455a2cacd8 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:38.290808 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 999/1995] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:51:38 2022] POST /identity/v3/users => generated 294 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:51:38.294867 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2d5d7-e7b7-47b9-beac-8879f987502f admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:38.306348 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2d5d7-e7b7-47b9-beac-8879f987502f admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:38.311511 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc716417-3421-4552-b0bf-b7b83873e451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:38.312167 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc716417-3421-4552-b0bf-b7b83873e451 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:38.312430 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc716417-3421-4552-b0bf-b7b83873e451 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:38.312704 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc716417-3421-4552-b0bf-b7b83873e451 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:38.313635 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc716417-3421-4552-b0bf-b7b83873e451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:38.315249 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc716417-3421-4552-b0bf-b7b83873e451 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:38.327153 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 997/1996] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:51:38.331027 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4296c63-639b-4f32-a2ff-93455a2cacd8 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:38.341947 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4296c63-639b-4f32-a2ff-93455a2cacd8 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:38.347738 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47419b87-156d-4680-90b7-8b358d839e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:38.348403 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47419b87-156d-4680-90b7-8b358d839e47 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:38.348815 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47419b87-156d-4680-90b7-8b358d839e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:38.349133 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47419b87-156d-4680-90b7-8b358d839e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:38.349787 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47419b87-156d-4680-90b7-8b358d839e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:38.351689 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47419b87-156d-4680-90b7-8b358d839e47 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:38.366661 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1000/1997] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:51:38.368412 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc716417-3421-4552-b0bf-b7b83873e451 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:38.376255 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:38.379962 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc716417-3421-4552-b0bf-b7b83873e451 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:38.384725 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16188a-e29c-4d62-9352-753ce5bd2d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:38.390628 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16188a-e29c-4d62-9352-753ce5bd2d2a admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:38.390628 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16188a-e29c-4d62-9352-753ce5bd2d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:38.390628 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16188a-e29c-4d62-9352-753ce5bd2d2a admin admin] PATH_INFO: `/v3/projects/648d1c9b6dd14d5d96d622e40d14af2a/users/54fa6bc6258d488b87af673c3a0e8449/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:38.402088 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d16188a-e29c-4d62-9352-753ce5bd2d2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=648d1c9b6dd14d5d96d622e40d14af2a, user_id=54fa6bc6258d488b87af673c3a0e8449, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:38.404955 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d16188a-e29c-4d62-9352-753ce5bd2d2a admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:38.491350 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 998/1998] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:51:38 2022] PUT /identity/v3/projects/648d1c9b6dd14d5d96d622e40d14af2a/users/54fa6bc6258d488b87af673c3a0e8449/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:51:38.502706 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e59dc-4f0c-4a61-8161-b0012d8b48c8 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:38.503014 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e59dc-4f0c-4a61-8161-b0012d8b48c8 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:38.503326 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e59dc-4f0c-4a61-8161-b0012d8b48c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:38.537368 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-6d1e59dc-4f0c-4a61-8161-b0012d8b48c8 None None] MFA Rules not processed for user `54fa6bc6258d488b87af673c3a0e8449`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:38.538648 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-6d1e59dc-4f0c-4a61-8161-b0012d8b48c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:38.603655 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1001/1999] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:38.608268 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16188a-e29c-4d62-9352-753ce5bd2d2a admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:38.673542 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16188a-e29c-4d62-9352-753ce5bd2d2a admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:38.678187 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d9917-ab49-4641-862b-df7e2b09e0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:38.678801 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d9917-ab49-4641-862b-df7e2b09e0b7 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:38.679089 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d9917-ab49-4641-862b-df7e2b09e0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:38.679370 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d9917-ab49-4641-862b-df7e2b09e0b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:38.680014 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d9917-ab49-4641-862b-df7e2b09e0b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:38.681970 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d9917-ab49-4641-862b-df7e2b09e0b7 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:38.748380 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:38.783193 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 999/2000] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:51:38 2022] POST /identity/v3/projects => generated 387 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:38.787568 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e59dc-4f0c-4a61-8161-b0012d8b48c8 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:38.799305 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e59dc-4f0c-4a61-8161-b0012d8b48c8 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:38.859871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4acef-0430-4990-b500-5d877a3d6fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:38.860491 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4acef-0430-4990-b500-5d877a3d6fee admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:38.860769 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4acef-0430-4990-b500-5d877a3d6fee admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:38.861050 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4acef-0430-4990-b500-5d877a3d6fee admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:38.861694 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4acef-0430-4990-b500-5d877a3d6fee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:38.863635 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4acef-0430-4990-b500-5d877a3d6fee admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:38.989002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1002/2001] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:51:38 2022] POST /identity/v3/users => generated 300 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:38.992971 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d9917-ab49-4641-862b-df7e2b09e0b7 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:39.006625 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d9917-ab49-4641-862b-df7e2b09e0b7 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:39.010325 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee701e7-9536-466c-bf3c-c07968c6edd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:39.011000 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee701e7-9536-466c-bf3c-c07968c6edd2 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:39.011305 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee701e7-9536-466c-bf3c-c07968c6edd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:39.011836 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee701e7-9536-466c-bf3c-c07968c6edd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:39.012417 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee701e7-9536-466c-bf3c-c07968c6edd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:39.014106 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee701e7-9536-466c-bf3c-c07968c6edd2 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:39.028186 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1000/2002] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:51:39.032371 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4acef-0430-4990-b500-5d877a3d6fee admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:39.042528 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4acef-0430-4990-b500-5d877a3d6fee admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:39.048266 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42084d-5dfb-43ba-99e4-507253ee876d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:39.048918 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42084d-5dfb-43ba-99e4-507253ee876d admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:39.049369 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42084d-5dfb-43ba-99e4-507253ee876d admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:39.049509 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42084d-5dfb-43ba-99e4-507253ee876d admin admin] PATH_INFO: `/v3/projects/3b213f4a6bc245758657080f6e1eedd6/users/73e182a11bbd45aead2bb932a1bfff2c/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:39.067415 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a42084d-5dfb-43ba-99e4-507253ee876d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b213f4a6bc245758657080f6e1eedd6, user_id=73e182a11bbd45aead2bb932a1bfff2c, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:39.070563 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a42084d-5dfb-43ba-99e4-507253ee876d admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:39.199202 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1003/2003] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:51:39 2022] PUT /identity/v3/projects/3b213f4a6bc245758657080f6e1eedd6/users/73e182a11bbd45aead2bb932a1bfff2c/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:39.203347 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee701e7-9536-466c-bf3c-c07968c6edd2 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:39.214027 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee701e7-9536-466c-bf3c-c07968c6edd2 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:39.250987 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:39.282954 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908c93e-15bc-421f-a7b2-ee5cea168b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:39.283664 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908c93e-15bc-421f-a7b2-ee5cea168b33 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:39.284036 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908c93e-15bc-421f-a7b2-ee5cea168b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:39.284374 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908c93e-15bc-421f-a7b2-ee5cea168b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:39.285273 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c908c93e-15bc-421f-a7b2-ee5cea168b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:39.287587 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c908c93e-15bc-421f-a7b2-ee5cea168b33 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:39.305208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1001/2004] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:51:39.311504 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42084d-5dfb-43ba-99e4-507253ee876d admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:39.323895 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42084d-5dfb-43ba-99e4-507253ee876d admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:39.329114 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f6c00-571c-4a14-b37a-0430021a4bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:39.329579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f6c00-571c-4a14-b37a-0430021a4bd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:39.329861 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f6c00-571c-4a14-b37a-0430021a4bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:39.330192 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f6c00-571c-4a14-b37a-0430021a4bd3 admin admin] PATH_INFO: `/v3/projects/3b213f4a6bc245758657080f6e1eedd6/users/73e182a11bbd45aead2bb932a1bfff2c/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:39.332057 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f6c00-571c-4a14-b37a-0430021a4bd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b213f4a6bc245758657080f6e1eedd6, user_id=73e182a11bbd45aead2bb932a1bfff2c, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:39.334724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f6c00-571c-4a14-b37a-0430021a4bd3 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:39.346085 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1004/2005] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:51:39 2022] PUT /identity/v3/projects/3b213f4a6bc245758657080f6e1eedd6/users/73e182a11bbd45aead2bb932a1bfff2c/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:39.360144 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60821e01-a017-4c96-840f-37bc0eb7e258 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:39.360473 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60821e01-a017-4c96-840f-37bc0eb7e258 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:39.360751 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60821e01-a017-4c96-840f-37bc0eb7e258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:39.394573 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-60821e01-a017-4c96-840f-37bc0eb7e258 None None] MFA Rules not processed for user `73e182a11bbd45aead2bb932a1bfff2c`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:39.395931 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-60821e01-a017-4c96-840f-37bc0eb7e258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:39.486427 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:39.522964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1002/2006] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:39 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:39.535210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f6c00-571c-4a14-b37a-0430021a4bd3 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:39.537447 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-882f6c00-571c-4a14-b37a-0430021a4bd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:39.576800 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:39.621378 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f6c00-571c-4a14-b37a-0430021a4bd3 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:39.623557 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32fd299-62ef-4f47-9a7f-9c06b540c6f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:39.624420 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fd299-62ef-4f47-9a7f-9c06b540c6f7 service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:39.624707 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fd299-62ef-4f47-9a7f-9c06b540c6f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:39.624982 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fd299-62ef-4f47-9a7f-9c06b540c6f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:39.635751 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32fd299-62ef-4f47-9a7f-9c06b540c6f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:39.637971 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32fd299-62ef-4f47-9a7f-9c06b540c6f7 service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:39.661363 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1005/2007] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:39 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:51:39.671056 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:39.749095 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60821e01-a017-4c96-840f-37bc0eb7e258 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:39.760301 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:39.789984 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:39.829573 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60821e01-a017-4c96-840f-37bc0eb7e258 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:39.834371 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96e5c3-3de0-4178-8098-7392d0b9b824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:39.835018 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96e5c3-3de0-4178-8098-7392d0b9b824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:39.835301 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96e5c3-3de0-4178-8098-7392d0b9b824 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:39.835583 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96e5c3-3de0-4178-8098-7392d0b9b824 admin admin] PATH_INFO: `/v3/users/54fa6bc6258d488b87af673c3a0e8449` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:39.837011 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96e5c3-3de0-4178-8098-7392d0b9b824 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54fa6bc6258d488b87af673c3a0e8449)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:39.838976 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96e5c3-3de0-4178-8098-7392d0b9b824 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:40.073269 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-3e96e5c3-3de0-4178-8098-7392d0b9b824 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54fa6bc6258d488b87af673c3a0e8449'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:40.182236 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-3e96e5c3-3de0-4178-8098-7392d0b9b824 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54fa6bc6258d488b87af673c3a0e8449'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:40.183054 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-3e96e5c3-3de0-4178-8098-7392d0b9b824 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54fa6bc6258d488b87af673c3a0e8449'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:40.184232 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-3e96e5c3-3de0-4178-8098-7392d0b9b824 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54fa6bc6258d488b87af673c3a0e8449'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:40.194716 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-3e96e5c3-3de0-4178-8098-7392d0b9b824 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54fa6bc6258d488b87af673c3a0e8449'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:40.220097 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1003/2008] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:51:39 2022] DELETE /identity/v3/users/54fa6bc6258d488b87af673c3a0e8449 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:40.224342 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b094014-42a3-441e-b21b-305786377b23 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:40.225048 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b094014-42a3-441e-b21b-305786377b23 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:40.225426 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b094014-42a3-441e-b21b-305786377b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:40.260848 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-7b094014-42a3-441e-b21b-305786377b23 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:40.263511 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-7b094014-42a3-441e-b21b-305786377b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:40.333439 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1006/2009] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:40.343556 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96e5c3-3de0-4178-8098-7392d0b9b824 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:40.346363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-3e96e5c3-3de0-4178-8098-7392d0b9b824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:40.411041 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:40.423111 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96e5c3-3de0-4178-8098-7392d0b9b824 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:40.426978 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0d724-a8f9-4234-96bd-f413e20d2710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:40.427584 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0d724-a8f9-4234-96bd-f413e20d2710 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:40.427866 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0d724-a8f9-4234-96bd-f413e20d2710 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:40.428143 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0d724-a8f9-4234-96bd-f413e20d2710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:40.438310 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0d724-a8f9-4234-96bd-f413e20d2710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:40.440061 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0d724-a8f9-4234-96bd-f413e20d2710 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:40.450667 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1004/2010] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:51:40.644761 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:40.805394 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:40.833656 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:41.079250 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:41.217940 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b094014-42a3-441e-b21b-305786377b23 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:41.219908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-7b094014-42a3-441e-b21b-305786377b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:41.233771 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b094014-42a3-441e-b21b-305786377b23 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:41.239377 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba1ebc-dd9e-4610-a438-3170e71460be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:41.240078 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:41.240195 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba1ebc-dd9e-4610-a438-3170e71460be admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:41.240412 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba1ebc-dd9e-4610-a438-3170e71460be admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:41.240696 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba1ebc-dd9e-4610-a438-3170e71460be admin admin] PATH_INFO: `/v3/projects/648d1c9b6dd14d5d96d622e40d14af2a` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:41.242224 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba1ebc-dd9e-4610-a438-3170e71460be admin admin] RBAC: Authorizing `identity:delete_project(project_id=648d1c9b6dd14d5d96d622e40d14af2a)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:41.244525 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba1ebc-dd9e-4610-a438-3170e71460be admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:41.375559 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-99ba1ebc-dd9e-4610-a438-3170e71460be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '648d1c9b6dd14d5d96d622e40d14af2a', 'request_id': 'req-99ba1ebc-dd9e-4610-a438-3170e71460be'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:41.382411 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-99ba1ebc-dd9e-4610-a438-3170e71460be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '648d1c9b6dd14d5d96d622e40d14af2a', 'request_id': 'req-99ba1ebc-dd9e-4610-a438-3170e71460be'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:41.427199 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:41.456333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-99ba1ebc-dd9e-4610-a438-3170e71460be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '648d1c9b6dd14d5d96d622e40d14af2a', 'request_id': 'req-99ba1ebc-dd9e-4610-a438-3170e71460be'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:41.474321 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-99ba1ebc-dd9e-4610-a438-3170e71460be admin admin] The token cache is being invalidate because project 648d1c9b6dd14d5d96d622e40d14af2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:51:41.474797 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-99ba1ebc-dd9e-4610-a438-3170e71460be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:41.475465 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-99ba1ebc-dd9e-4610-a438-3170e71460be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:41.477005 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1007/2011] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:51:41 2022] DELETE /identity/v3/projects/648d1c9b6dd14d5d96d622e40d14af2a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:41.482387 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0d724-a8f9-4234-96bd-f413e20d2710 service neutron] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:41.493459 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0d724-a8f9-4234-96bd-f413e20d2710 service neutron] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:41.543955 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:41.574198 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633779e-0904-4e0a-bb33-bc88ea5963cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:41.575733 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633779e-0904-4e0a-bb33-bc88ea5963cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:41.576028 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633779e-0904-4e0a-bb33-bc88ea5963cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:41.576435 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633779e-0904-4e0a-bb33-bc88ea5963cc admin admin] PATH_INFO: `/v3/users/73e182a11bbd45aead2bb932a1bfff2c` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:41.577664 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8633779e-0904-4e0a-bb33-bc88ea5963cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=73e182a11bbd45aead2bb932a1bfff2c)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:41.579826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8633779e-0904-4e0a-bb33-bc88ea5963cc admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:41.606603 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:41.623619 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:41.799744 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-8633779e-0904-4e0a-bb33-bc88ea5963cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73e182a11bbd45aead2bb932a1bfff2c'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:41.848289 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-8633779e-0904-4e0a-bb33-bc88ea5963cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73e182a11bbd45aead2bb932a1bfff2c'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:41.853780 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-8633779e-0904-4e0a-bb33-bc88ea5963cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73e182a11bbd45aead2bb932a1bfff2c'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:41.854241 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-8633779e-0904-4e0a-bb33-bc88ea5963cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73e182a11bbd45aead2bb932a1bfff2c'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:41.861863 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-8633779e-0904-4e0a-bb33-bc88ea5963cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73e182a11bbd45aead2bb932a1bfff2c'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:41.882895 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1005/2012] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:51:41 2022] DELETE /identity/v3/users/73e182a11bbd45aead2bb932a1bfff2c => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:51:41.999572 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:42.125889 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:42.689504 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba1ebc-dd9e-4610-a438-3170e71460be admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:42.690762 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-99ba1ebc-dd9e-4610-a438-3170e71460be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:42.708003 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba1ebc-dd9e-4610-a438-3170e71460be admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:42.770382 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce77516-4007-406c-885f-b42e6c213e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:42.771159 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce77516-4007-406c-885f-b42e6c213e9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:42.771443 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce77516-4007-406c-885f-b42e6c213e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:42.771720 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce77516-4007-406c-885f-b42e6c213e9e admin admin] PATH_INFO: `/v3/projects/3b213f4a6bc245758657080f6e1eedd6` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:42.772851 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce77516-4007-406c-885f-b42e6c213e9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b213f4a6bc245758657080f6e1eedd6)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:42.775756 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce77516-4007-406c-885f-b42e6c213e9e admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:42.788761 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:42.892119 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633779e-0904-4e0a-bb33-bc88ea5963cc admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:42.895410 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-8633779e-0904-4e0a-bb33-bc88ea5963cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:42.896933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-2ce77516-4007-406c-885f-b42e6c213e9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b213f4a6bc245758657080f6e1eedd6', 'request_id': 'req-2ce77516-4007-406c-885f-b42e6c213e9e'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:42.903348 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-2ce77516-4007-406c-885f-b42e6c213e9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b213f4a6bc245758657080f6e1eedd6', 'request_id': 'req-2ce77516-4007-406c-885f-b42e6c213e9e'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:42.925801 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633779e-0904-4e0a-bb33-bc88ea5963cc admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:42.940381 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:42.999110 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-2ce77516-4007-406c-885f-b42e6c213e9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b213f4a6bc245758657080f6e1eedd6', 'request_id': 'req-2ce77516-4007-406c-885f-b42e6c213e9e'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:43.015326 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-2ce77516-4007-406c-885f-b42e6c213e9e admin admin] The token cache is being invalidate because project 3b213f4a6bc245758657080f6e1eedd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:51:43.015622 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-2ce77516-4007-406c-885f-b42e6c213e9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:43.021694 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-2ce77516-4007-406c-885f-b42e6c213e9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:43.027037 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1008/2013] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:51:42 2022] DELETE /identity/v3/projects/3b213f4a6bc245758657080f6e1eedd6 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:43.028379 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014b9a7-9268-45d5-be97-459f520ffc19 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:43.028617 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014b9a7-9268-45d5-be97-459f520ffc19 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:43.029192 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014b9a7-9268-45d5-be97-459f520ffc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:43.037436 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5e2c8-a9a9-43da-8196-fe8e1f01f7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:43.038676 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5e2c8-a9a9-43da-8196-fe8e1f01f7e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:43.039174 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5e2c8-a9a9-43da-8196-fe8e1f01f7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:43.039968 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5e2c8-a9a9-43da-8196-fe8e1f01f7e2 admin admin] PATH_INFO: `/v3/users/d69d0a4ead38423b84ca5a28372e7017` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:43.042700 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f5e2c8-a9a9-43da-8196-fe8e1f01f7e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d69d0a4ead38423b84ca5a28372e7017)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:43.046112 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f5e2c8-a9a9-43da-8196-fe8e1f01f7e2 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:43.060945 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-8014b9a7-9268-45d5-be97-459f520ffc19 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:43.062600 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-8014b9a7-9268-45d5-be97-459f520ffc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:43.078167 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1009/2014] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:43.091584 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdbd90-9188-4cf7-938c-0fd3e7305527 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:43.095417 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdbd90-9188-4cf7-938c-0fd3e7305527 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:43.095417 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdbd90-9188-4cf7-938c-0fd3e7305527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:43.117465 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-14bdbd90-9188-4cf7-938c-0fd3e7305527 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:43.118689 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-14bdbd90-9188-4cf7-938c-0fd3e7305527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:43.130416 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1010/2015] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:43.135061 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bdbd90-9188-4cf7-938c-0fd3e7305527 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:43.146671 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bdbd90-9188-4cf7-938c-0fd3e7305527 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:43.151330 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93c794-3ad1-4597-a050-616e2c6dea4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:43.151925 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93c794-3ad1-4597-a050-616e2c6dea4b admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:43.152202 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93c794-3ad1-4597-a050-616e2c6dea4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:43.152474 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93c794-3ad1-4597-a050-616e2c6dea4b admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:43.153426 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93c794-3ad1-4597-a050-616e2c6dea4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:51:43.153728 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93c794-3ad1-4597-a050-616e2c6dea4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:43.155314 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93c794-3ad1-4597-a050-616e2c6dea4b admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:43.166968 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1011/2016] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:51:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:51:43.171900 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93c794-3ad1-4597-a050-616e2c6dea4b admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:43.182648 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93c794-3ad1-4597-a050-616e2c6dea4b admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:43.189979 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177456c-8901-467c-a8ec-884fd7afaa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:43.190536 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177456c-8901-467c-a8ec-884fd7afaa26 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:43.190813 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177456c-8901-467c-a8ec-884fd7afaa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:43.191085 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177456c-8901-467c-a8ec-884fd7afaa26 admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:43.191737 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7177456c-8901-467c-a8ec-884fd7afaa26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:43.193636 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7177456c-8901-467c-a8ec-884fd7afaa26 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:43.319989 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1012/2017] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:51:43 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:43.321079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177456c-8901-467c-a8ec-884fd7afaa26 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:43.325419 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-a8f5e2c8-a9a9-43da-8196-fe8e1f01f7e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd69d0a4ead38423b84ca5a28372e7017'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:43.394431 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177456c-8901-467c-a8ec-884fd7afaa26 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:43.399232 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b99e2-91d2-41c6-933c-dfe02c8ae0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:43.399839 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b99e2-91d2-41c6-933c-dfe02c8ae0d8 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:43.400120 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b99e2-91d2-41c6-933c-dfe02c8ae0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:43.400391 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b99e2-91d2-41c6-933c-dfe02c8ae0d8 admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:43.401065 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b99e2-91d2-41c6-933c-dfe02c8ae0d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:43.404537 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b99e2-91d2-41c6-933c-dfe02c8ae0d8 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:43.405282 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-a8f5e2c8-a9a9-43da-8196-fe8e1f01f7e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd69d0a4ead38423b84ca5a28372e7017'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:43.406539 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-a8f5e2c8-a9a9-43da-8196-fe8e1f01f7e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd69d0a4ead38423b84ca5a28372e7017'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:43.409077 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-a8f5e2c8-a9a9-43da-8196-fe8e1f01f7e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd69d0a4ead38423b84ca5a28372e7017'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:43.416006 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-a8f5e2c8-a9a9-43da-8196-fe8e1f01f7e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd69d0a4ead38423b84ca5a28372e7017'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:43.434554 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1006/2018] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:51:42 2022] DELETE /identity/v3/users/d69d0a4ead38423b84ca5a28372e7017 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:51:43.439214 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db0379-5162-4da3-8da7-b0e55418b74e None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:43.439504 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db0379-5162-4da3-8da7-b0e55418b74e None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:43.439925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db0379-5162-4da3-8da7-b0e55418b74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:43.459379 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-a1db0379-5162-4da3-8da7-b0e55418b74e None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:43.460585 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-a1db0379-5162-4da3-8da7-b0e55418b74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:43.490858 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1013/2019] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:51:43 2022] POST /identity/v3/users => generated 287 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:43.495076 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b99e2-91d2-41c6-933c-dfe02c8ae0d8 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:43.497424 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-332b99e2-91d2-41c6-933c-dfe02c8ae0d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:43.509829 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b99e2-91d2-41c6-933c-dfe02c8ae0d8 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:43.522737 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1007/2020] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:43.535497 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db0379-5162-4da3-8da7-b0e55418b74e None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:43.536885 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-a1db0379-5162-4da3-8da7-b0e55418b74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:43.583659 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606a55d-b348-4151-b0c4-1632e1324498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:43.584344 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606a55d-b348-4151-b0c4-1632e1324498 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:43.584628 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606a55d-b348-4151-b0c4-1632e1324498 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:43.584903 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606a55d-b348-4151-b0c4-1632e1324498 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:43.586662 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606a55d-b348-4151-b0c4-1632e1324498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:43.588755 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606a55d-b348-4151-b0c4-1632e1324498 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:43.601169 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1014/2021] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:51:43.604936 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606a55d-b348-4151-b0c4-1632e1324498 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:43.609695 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db0379-5162-4da3-8da7-b0e55418b74e None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:43.613653 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32742c41-9a10-48e9-9319-6a10527bc11f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:43.614273 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32742c41-9a10-48e9-9319-6a10527bc11f service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:43.614558 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32742c41-9a10-48e9-9319-6a10527bc11f service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:43.614835 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32742c41-9a10-48e9-9319-6a10527bc11f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:43.617378 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606a55d-b348-4151-b0c4-1632e1324498 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:43.623042 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:43.625693 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9fc63-4a64-4169-a41f-f75a1461cc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:43.630738 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9fc63-4a64-4169-a41f-f75a1461cc72 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:43.630738 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9fc63-4a64-4169-a41f-f75a1461cc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:43.630738 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9fc63-4a64-4169-a41f-f75a1461cc72 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:43.630738 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda9fc63-4a64-4169-a41f-f75a1461cc72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:43.630738 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda9fc63-4a64-4169-a41f-f75a1461cc72 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:43.631200 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32742c41-9a10-48e9-9319-6a10527bc11f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:43.631420 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32742c41-9a10-48e9-9319-6a10527bc11f service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:43.645892 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1015/2022] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:51:43.646453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1008/2023] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:51:43.647523 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9fc63-4a64-4169-a41f-f75a1461cc72 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:43.668270 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9fc63-4a64-4169-a41f-f75a1461cc72 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:43.675883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b457f8f-f3e5-453f-bbaa-43fee4ec274e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:43.678536 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b457f8f-f3e5-453f-bbaa-43fee4ec274e admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:43.679023 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b457f8f-f3e5-453f-bbaa-43fee4ec274e admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:43.679617 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b457f8f-f3e5-453f-bbaa-43fee4ec274e admin admin] PATH_INFO: `/v3/projects/89cf7fb7e8214388b0f439b6282e128e/users/ac108193d32240489d5989c3cabf7ce6/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:43.699282 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b457f8f-f3e5-453f-bbaa-43fee4ec274e admin admin] RBAC: Authorizing `identity:create_grant(project_id=89cf7fb7e8214388b0f439b6282e128e, user_id=ac108193d32240489d5989c3cabf7ce6, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:43.707721 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b457f8f-f3e5-453f-bbaa-43fee4ec274e admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:43.727961 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:43.783474 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1016/2024] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:51:43 2022] PUT /identity/v3/projects/89cf7fb7e8214388b0f439b6282e128e/users/ac108193d32240489d5989c3cabf7ce6/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:51:43.789734 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53893d-f977-414d-bbb3-acc16e444f86 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:43.792806 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53893d-f977-414d-bbb3-acc16e444f86 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:43.792806 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53893d-f977-414d-bbb3-acc16e444f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:43.830218 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-6f53893d-f977-414d-bbb3-acc16e444f86 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:43.831620 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-6f53893d-f977-414d-bbb3-acc16e444f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:43.920486 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:43.925961 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1009/2025] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:43.943101 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b457f8f-f3e5-453f-bbaa-43fee4ec274e admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:44.023436 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b457f8f-f3e5-453f-bbaa-43fee4ec274e admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:44.032263 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873f54d-c315-4bff-a759-1cea04be37c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:44.035772 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873f54d-c315-4bff-a759-1cea04be37c9 service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:44.035772 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873f54d-c315-4bff-a759-1cea04be37c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:44.035772 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873f54d-c315-4bff-a759-1cea04be37c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:44.056006 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873f54d-c315-4bff-a759-1cea04be37c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:44.063698 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:44.064216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873f54d-c315-4bff-a759-1cea04be37c9 service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:44.076558 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1017/2026] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:51:44.299811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53893d-f977-414d-bbb3-acc16e444f86 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:44.302000 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-6f53893d-f977-414d-bbb3-acc16e444f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:44.315110 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53893d-f977-414d-bbb3-acc16e444f86 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:44.320327 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83aed80-73b3-4606-beeb-62f54ae80e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:44.321461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83aed80-73b3-4606-beeb-62f54ae80e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:44.321461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83aed80-73b3-4606-beeb-62f54ae80e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:44.321648 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83aed80-73b3-4606-beeb-62f54ae80e95 admin admin] PATH_INFO: `/v3/projects/751da548652745fcb545ebe626346141` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:44.322843 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83aed80-73b3-4606-beeb-62f54ae80e95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=751da548652745fcb545ebe626346141)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:44.325517 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83aed80-73b3-4606-beeb-62f54ae80e95 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:44.491983 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-a83aed80-73b3-4606-beeb-62f54ae80e95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '751da548652745fcb545ebe626346141', 'request_id': 'req-a83aed80-73b3-4606-beeb-62f54ae80e95'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:44.498175 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-a83aed80-73b3-4606-beeb-62f54ae80e95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '751da548652745fcb545ebe626346141', 'request_id': 'req-a83aed80-73b3-4606-beeb-62f54ae80e95'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:44.501551 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:44.589154 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-a83aed80-73b3-4606-beeb-62f54ae80e95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '751da548652745fcb545ebe626346141', 'request_id': 'req-a83aed80-73b3-4606-beeb-62f54ae80e95'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:44.604199 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-a83aed80-73b3-4606-beeb-62f54ae80e95 admin admin] The token cache is being invalidate because project 751da548652745fcb545ebe626346141 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:51:44.604499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-a83aed80-73b3-4606-beeb-62f54ae80e95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:44.605182 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-a83aed80-73b3-4606-beeb-62f54ae80e95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:44.608532 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1010/2027] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:51:44 2022] DELETE /identity/v3/projects/751da548652745fcb545ebe626346141 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:44.613527 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902d745-5b90-479f-82b0-c5d881a4cc9a None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:44.614544 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902d745-5b90-479f-82b0-c5d881a4cc9a None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:44.615096 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902d745-5b90-479f-82b0-c5d881a4cc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:44.648965 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-7902d745-5b90-479f-82b0-c5d881a4cc9a None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:44.650955 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-7902d745-5b90-479f-82b0-c5d881a4cc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:44.722566 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbddc2b-4e46-45b6-adc7-12017c0d68cc None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:44.727256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbddc2b-4e46-45b6-adc7-12017c0d68cc None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:44.727256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbddc2b-4e46-45b6-adc7-12017c0d68cc None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:44.727256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1011/2028] 10.222.0.70 () {54 vars in 921 bytes} [Mon Aug 8 17:51:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 17:51:44.743968 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1018/2029] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:44.748772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbeb8c-6861-4486-8189-e5ebbc5566fe None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:44.749186 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbeb8c-6861-4486-8189-e5ebbc5566fe None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:44.749487 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbeb8c-6861-4486-8189-e5ebbc5566fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:44.759628 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c2a99-bd31-416c-8d7a-9061293aff04 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:44.760234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c2a99-bd31-416c-8d7a-9061293aff04 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:44.760797 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c2a99-bd31-416c-8d7a-9061293aff04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:44.773069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-a8bbeb8c-6861-4486-8189-e5ebbc5566fe None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:44.774277 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-a8bbeb8c-6861-4486-8189-e5ebbc5566fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:44.791095 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1012/2030] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:44.792080 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bbeb8c-6861-4486-8189-e5ebbc5566fe None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:44.792330 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-c07c2a99-bd31-416c-8d7a-9061293aff04 None None] MFA Rules not processed for user `68717c19e74e434da825d9b1d6ca202a`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:44.794426 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-c07c2a99-bd31-416c-8d7a-9061293aff04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:44.802997 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bbeb8c-6861-4486-8189-e5ebbc5566fe None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:44.810485 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9c608-64a9-4a0e-a57b-12a3dba883d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:44.811548 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9c608-64a9-4a0e-a57b-12a3dba883d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:44.812029 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9c608-64a9-4a0e-a57b-12a3dba883d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:44.812529 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9c608-64a9-4a0e-a57b-12a3dba883d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:44.813433 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d9c608-64a9-4a0e-a57b-12a3dba883d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:51:44.813931 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d9c608-64a9-4a0e-a57b-12a3dba883d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:44.815961 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d9c608-64a9-4a0e-a57b-12a3dba883d2 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:44.836659 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1013/2031] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:51:44.837385 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9c608-64a9-4a0e-a57b-12a3dba883d2 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:44.848010 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9c608-64a9-4a0e-a57b-12a3dba883d2 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:44.852853 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5b24e-bf97-4b8c-8cca-ade3a206ff92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:44.854378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5b24e-bf97-4b8c-8cca-ade3a206ff92 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:44.854378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5b24e-bf97-4b8c-8cca-ade3a206ff92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:44.854378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5b24e-bf97-4b8c-8cca-ade3a206ff92 admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:44.854970 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5b24e-bf97-4b8c-8cca-ade3a206ff92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:44.857645 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5b24e-bf97-4b8c-8cca-ade3a206ff92 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:44.885077 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1019/2032] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Aug 8 17:51:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:44.887908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c2a99-bd31-416c-8d7a-9061293aff04 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:44.890575 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-c07c2a99-bd31-416c-8d7a-9061293aff04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:44.904241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c2a99-bd31-416c-8d7a-9061293aff04 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:44.909550 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe200ff-7db5-4cf4-90ff-ee1b539484f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:44.910185 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe200ff-7db5-4cf4-90ff-ee1b539484f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:44.910467 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe200ff-7db5-4cf4-90ff-ee1b539484f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:44.911077 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe200ff-7db5-4cf4-90ff-ee1b539484f0 admin admin] PATH_INFO: `/v3/users/5037a7b0ba994938ae10d2b3316dab93` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:44.911948 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe200ff-7db5-4cf4-90ff-ee1b539484f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5037a7b0ba994938ae10d2b3316dab93)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:44.914072 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe200ff-7db5-4cf4-90ff-ee1b539484f0 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:44.957812 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1014/2033] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:51:44 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:44.957812 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5b24e-bf97-4b8c-8cca-ade3a206ff92 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:44.957812 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-90c5b24e-bf97-4b8c-8cca-ade3a206ff92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:44.984103 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:45.034511 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5b24e-bf97-4b8c-8cca-ade3a206ff92 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:45.040941 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f640f4c2-5baf-4524-b2e2-b1ac60ceb49b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68717c19e74e434da825d9b1d6ca202a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:45.041223 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640f4c2-5baf-4524-b2e2-b1ac60ceb49b service placement] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:45.041509 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640f4c2-5baf-4524-b2e2-b1ac60ceb49b service placement] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:45.041779 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640f4c2-5baf-4524-b2e2-b1ac60ceb49b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:45.052015 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f640f4c2-5baf-4524-b2e2-b1ac60ceb49b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:45.053641 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f640f4c2-5baf-4524-b2e2-b1ac60ceb49b service placement] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:45.067721 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1015/2034] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:51:45.069136 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f640f4c2-5baf-4524-b2e2-b1ac60ceb49b service placement] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:45.102091 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-cfe200ff-7db5-4cf4-90ff-ee1b539484f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5037a7b0ba994938ae10d2b3316dab93'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:45.141222 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f640f4c2-5baf-4524-b2e2-b1ac60ceb49b service placement] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:45.146018 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6de57b-457d-446b-b76b-a752dfdb2671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:45.146634 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6de57b-457d-446b-b76b-a752dfdb2671 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:45.146915 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6de57b-457d-446b-b76b-a752dfdb2671 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:45.147187 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6de57b-457d-446b-b76b-a752dfdb2671 admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:45.147811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6de57b-457d-446b-b76b-a752dfdb2671 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:45.149765 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6de57b-457d-446b-b76b-a752dfdb2671 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:45.239726 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-cfe200ff-7db5-4cf4-90ff-ee1b539484f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5037a7b0ba994938ae10d2b3316dab93'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:45.240711 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-cfe200ff-7db5-4cf4-90ff-ee1b539484f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5037a7b0ba994938ae10d2b3316dab93'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:45.241796 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-cfe200ff-7db5-4cf4-90ff-ee1b539484f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5037a7b0ba994938ae10d2b3316dab93'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:45.250639 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-cfe200ff-7db5-4cf4-90ff-ee1b539484f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5037a7b0ba994938ae10d2b3316dab93'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:45.266150 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:45.269102 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1016/2035] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:51:45 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:45.273407 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6de57b-457d-446b-b76b-a752dfdb2671 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:45.274809 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1020/2036] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:51:44 2022] DELETE /identity/v3/users/5037a7b0ba994938ae10d2b3316dab93 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:45.275621 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-5f6de57b-457d-446b-b76b-a752dfdb2671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:45.290361 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6de57b-457d-446b-b76b-a752dfdb2671 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:45.354288 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1839d5-f1e1-463e-8df7-c40a2643e750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:45.354949 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1839d5-f1e1-463e-8df7-c40a2643e750 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:45.355251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1839d5-f1e1-463e-8df7-c40a2643e750 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:45.355525 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1839d5-f1e1-463e-8df7-c40a2643e750 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:45.356993 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1839d5-f1e1-463e-8df7-c40a2643e750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:45.359149 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1839d5-f1e1-463e-8df7-c40a2643e750 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:45.372791 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1017/2037] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:51:45.374203 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe200ff-7db5-4cf4-90ff-ee1b539484f0 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:45.384507 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe200ff-7db5-4cf4-90ff-ee1b539484f0 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:45.393073 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd52a5-2d1d-4962-b15f-78658f47c3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:45.393073 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd52a5-2d1d-4962-b15f-78658f47c3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:45.393073 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd52a5-2d1d-4962-b15f-78658f47c3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:45.393073 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd52a5-2d1d-4962-b15f-78658f47c3a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:45.398254 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd52a5-2d1d-4962-b15f-78658f47c3a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:45.398254 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd52a5-2d1d-4962-b15f-78658f47c3a4 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:45.406688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1021/2038] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:51:45.411558 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1839d5-f1e1-463e-8df7-c40a2643e750 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:45.424719 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1839d5-f1e1-463e-8df7-c40a2643e750 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:45.429784 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c64be-9ae3-4453-80e1-8db854ce7d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:45.430507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c64be-9ae3-4453-80e1-8db854ce7d44 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:45.430796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c64be-9ae3-4453-80e1-8db854ce7d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:45.431079 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c64be-9ae3-4453-80e1-8db854ce7d44 admin admin] PATH_INFO: `/v3/projects/44c2d0513ff54cd4864df48a3e05b505/users/80a62354f9e743cc8e01afd1765eb1f7/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:45.447336 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c64be-9ae3-4453-80e1-8db854ce7d44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44c2d0513ff54cd4864df48a3e05b505, user_id=80a62354f9e743cc8e01afd1765eb1f7, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:45.450955 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c64be-9ae3-4453-80e1-8db854ce7d44 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:45.546142 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1018/2039] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:51:45 2022] PUT /identity/v3/projects/44c2d0513ff54cd4864df48a3e05b505/users/80a62354f9e743cc8e01afd1765eb1f7/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:51:45.548024 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29f08e-9f36-4c26-8960-fba812c16234 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:45.548573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29f08e-9f36-4c26-8960-fba812c16234 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:45.548958 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29f08e-9f36-4c26-8960-fba812c16234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:45.571269 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-5d29f08e-9f36-4c26-8960-fba812c16234 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:45.572512 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-5d29f08e-9f36-4c26-8960-fba812c16234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:45.635653 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1022/2040] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:51:45.647725 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c64be-9ae3-4453-80e1-8db854ce7d44 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:45.649510 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-b63c64be-9ae3-4453-80e1-8db854ce7d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:45.704742 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29f08e-9f36-4c26-8960-fba812c16234 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:45.706924 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-5d29f08e-9f36-4c26-8960-fba812c16234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:45.714536 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c64be-9ae3-4453-80e1-8db854ce7d44 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:45.720199 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e82626-47e9-4816-b048-b10824c25c93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:45.720889 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e82626-47e9-4816-b048-b10824c25c93 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:45.721285 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e82626-47e9-4816-b048-b10824c25c93 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:45.721666 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e82626-47e9-4816-b048-b10824c25c93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:45.724583 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29f08e-9f36-4c26-8960-fba812c16234 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:45.733569 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fd735-e6d7-41df-a557-35dd330af008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:45.734426 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fd735-e6d7-41df-a557-35dd330af008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:45.734643 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e82626-47e9-4816-b048-b10824c25c93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:45.734774 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fd735-e6d7-41df-a557-35dd330af008 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:45.735222 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fd735-e6d7-41df-a557-35dd330af008 admin admin] PATH_INFO: `/v3/projects/b23851d552fe4761a597f6564e0b2f47` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:45.736410 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957fd735-e6d7-41df-a557-35dd330af008 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b23851d552fe4761a597f6564e0b2f47)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:45.736897 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e82626-47e9-4816-b048-b10824c25c93 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:45.738605 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957fd735-e6d7-41df-a557-35dd330af008 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:45.752813 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1019/2041] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:51:45.754043 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e82626-47e9-4816-b048-b10824c25c93 service neutron] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:45.755457 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-63e82626-47e9-4816-b048-b10824c25c93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:45.776172 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e82626-47e9-4816-b048-b10824c25c93 service neutron] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:45.784821 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a811c46-1910-465d-b34b-252cec799d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:45.785668 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a811c46-1910-465d-b34b-252cec799d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:45.786059 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a811c46-1910-465d-b34b-252cec799d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:45.787772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a811c46-1910-465d-b34b-252cec799d77 admin admin] PATH_INFO: `/v3/users/e3568db866254622b62a4f3e06ff737e` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:45.788698 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a811c46-1910-465d-b34b-252cec799d77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3568db866254622b62a4f3e06ff737e)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:45.790695 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:45.791212 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a811c46-1910-465d-b34b-252cec799d77 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:45.839956 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:45.882062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-957fd735-e6d7-41df-a557-35dd330af008 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b23851d552fe4761a597f6564e0b2f47', 'request_id': 'req-957fd735-e6d7-41df-a557-35dd330af008'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:45.888372 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-957fd735-e6d7-41df-a557-35dd330af008 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b23851d552fe4761a597f6564e0b2f47', 'request_id': 'req-957fd735-e6d7-41df-a557-35dd330af008'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:45.976834 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-957fd735-e6d7-41df-a557-35dd330af008 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b23851d552fe4761a597f6564e0b2f47', 'request_id': 'req-957fd735-e6d7-41df-a557-35dd330af008'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:45.996357 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-957fd735-e6d7-41df-a557-35dd330af008 admin admin] The token cache is being invalidate because project b23851d552fe4761a597f6564e0b2f47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:51:45.997222 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-957fd735-e6d7-41df-a557-35dd330af008 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:45.998018 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-957fd735-e6d7-41df-a557-35dd330af008 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:46.000392 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1023/2042] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:51:45 2022] DELETE /identity/v3/projects/b23851d552fe4761a597f6564e0b2f47 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:51:46.000842 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-9a811c46-1910-465d-b34b-252cec799d77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3568db866254622b62a4f3e06ff737e'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:46.005529 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66bc51-8b5c-4ae9-b2b0-3dab1903b02a None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:46.005846 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66bc51-8b5c-4ae9-b2b0-3dab1903b02a None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:46.006130 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66bc51-8b5c-4ae9-b2b0-3dab1903b02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:46.027839 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-1e66bc51-8b5c-4ae9-b2b0-3dab1903b02a None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:46.029508 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-1e66bc51-8b5c-4ae9-b2b0-3dab1903b02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:46.085941 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-9a811c46-1910-465d-b34b-252cec799d77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3568db866254622b62a4f3e06ff737e'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:46.087209 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-9a811c46-1910-465d-b34b-252cec799d77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3568db866254622b62a4f3e06ff737e'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:46.089239 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-9a811c46-1910-465d-b34b-252cec799d77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3568db866254622b62a4f3e06ff737e'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:46.129319 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1024/2043] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:46.129319 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0043f8-a6b8-444f-b059-275c05e86eba None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:46.129319 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0043f8-a6b8-444f-b059-275c05e86eba None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:46.129319 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0043f8-a6b8-444f-b059-275c05e86eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:46.129974 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-9a811c46-1910-465d-b34b-252cec799d77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3568db866254622b62a4f3e06ff737e'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:46.156084 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-cf0043f8-a6b8-444f-b059-275c05e86eba None None] MFA Rules not processed for user `ac108193d32240489d5989c3cabf7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:46.157660 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-cf0043f8-a6b8-444f-b059-275c05e86eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:46.158374 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1020/2044] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:51:45 2022] DELETE /identity/v3/users/e3568db866254622b62a4f3e06ff737e => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:46.160939 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509699ce-4afd-4df3-b170-b699fdc0b133 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:46.161368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509699ce-4afd-4df3-b170-b699fdc0b133 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:46.161746 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509699ce-4afd-4df3-b170-b699fdc0b133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:46.185946 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-509699ce-4afd-4df3-b170-b699fdc0b133 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:46.190536 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-509699ce-4afd-4df3-b170-b699fdc0b133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:46.245580 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1025/2045] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:46.249326 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709cfff-662f-4f5b-8af5-4f9a5353197c None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:46.253055 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709cfff-662f-4f5b-8af5-4f9a5353197c None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:46.253055 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709cfff-662f-4f5b-8af5-4f9a5353197c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:46.268514 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1021/2046] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:46.269690 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509699ce-4afd-4df3-b170-b699fdc0b133 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:46.271041 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-a709cfff-662f-4f5b-8af5-4f9a5353197c None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:46.272348 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-a709cfff-662f-4f5b-8af5-4f9a5353197c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:46.273176 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-509699ce-4afd-4df3-b170-b699fdc0b133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:46.285995 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1026/2047] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:46.287773 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709cfff-662f-4f5b-8af5-4f9a5353197c None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:46.289501 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509699ce-4afd-4df3-b170-b699fdc0b133 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:46.294414 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d193ee8-fd6e-4d04-84d3-44f55bdb61c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:46.295134 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d193ee8-fd6e-4d04-84d3-44f55bdb61c9 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:46.295416 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d193ee8-fd6e-4d04-84d3-44f55bdb61c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:46.295847 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d193ee8-fd6e-4d04-84d3-44f55bdb61c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:46.296498 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d193ee8-fd6e-4d04-84d3-44f55bdb61c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:46.298494 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d193ee8-fd6e-4d04-84d3-44f55bdb61c9 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:46.299598 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709cfff-662f-4f5b-8af5-4f9a5353197c None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:46.305552 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f753b8-4627-4d87-83c4-7b84cb4496bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:46.306515 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f753b8-4627-4d87-83c4-7b84cb4496bb admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:46.306859 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f753b8-4627-4d87-83c4-7b84cb4496bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:46.307183 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f753b8-4627-4d87-83c4-7b84cb4496bb admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:46.307934 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f753b8-4627-4d87-83c4-7b84cb4496bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:51:46.308685 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f753b8-4627-4d87-83c4-7b84cb4496bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:46.310762 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f753b8-4627-4d87-83c4-7b84cb4496bb admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:46.324335 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1027/2048] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:51:46.327340 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f753b8-4627-4d87-83c4-7b84cb4496bb admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:46.329575 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-19f753b8-4627-4d87-83c4-7b84cb4496bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:46.393407 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f753b8-4627-4d87-83c4-7b84cb4496bb admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:46.397317 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ade43f-2232-4947-8fc2-c91a86130739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:46.398138 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ade43f-2232-4947-8fc2-c91a86130739 service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:46.398463 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ade43f-2232-4947-8fc2-c91a86130739 service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:46.398698 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ade43f-2232-4947-8fc2-c91a86130739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:46.413073 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ade43f-2232-4947-8fc2-c91a86130739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:46.413073 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ade43f-2232-4947-8fc2-c91a86130739 service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:46.418219 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1022/2049] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:51:46 2022] POST /identity/v3/projects => generated 371 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:46.418446 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d193ee8-fd6e-4d04-84d3-44f55bdb61c9 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:46.430796 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1028/2050] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:51:46.432546 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ade43f-2232-4947-8fc2-c91a86130739 service neutron] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:46.447221 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ade43f-2232-4947-8fc2-c91a86130739 service neutron] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:46.504580 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d193ee8-fd6e-4d04-84d3-44f55bdb61c9 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:46.514510 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a231af-b779-46eb-9e78-b000436bcb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:46.515212 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a231af-b779-46eb-9e78-b000436bcb7b admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:46.515482 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a231af-b779-46eb-9e78-b000436bcb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:46.515766 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a231af-b779-46eb-9e78-b000436bcb7b admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:46.516435 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a231af-b779-46eb-9e78-b000436bcb7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:46.518518 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a231af-b779-46eb-9e78-b000436bcb7b admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:46.519478 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90654662-a7e9-4649-b605-81db97a7a96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:46.520213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90654662-a7e9-4649-b605-81db97a7a96d admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:46.520583 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90654662-a7e9-4649-b605-81db97a7a96d admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:46.520922 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90654662-a7e9-4649-b605-81db97a7a96d admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:46.521741 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90654662-a7e9-4649-b605-81db97a7a96d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:46.523881 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90654662-a7e9-4649-b605-81db97a7a96d admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:46.631707 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1029/2051] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:51:46 2022] POST /identity/v3/users => generated 292 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:46.633258 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90654662-a7e9-4649-b605-81db97a7a96d admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:46.633662 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1023/2052] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:51:46 2022] POST /identity/v3/projects => generated 393 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:46.639636 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a231af-b779-46eb-9e78-b000436bcb7b admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:46.649987 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90654662-a7e9-4649-b605-81db97a7a96d admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:46.736224 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a231af-b779-46eb-9e78-b000436bcb7b admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:46.740466 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b25c1-2baa-4c04-87e0-99f224b3df32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:46.741185 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b25c1-2baa-4c04-87e0-99f224b3df32 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:46.741440 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a297e8b-7872-46e0-91ac-83e9c245ae3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:46.741562 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b25c1-2baa-4c04-87e0-99f224b3df32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:46.741841 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b25c1-2baa-4c04-87e0-99f224b3df32 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:46.742385 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a297e8b-7872-46e0-91ac-83e9c245ae3f admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:46.742554 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372b25c1-2baa-4c04-87e0-99f224b3df32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:46.742654 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a297e8b-7872-46e0-91ac-83e9c245ae3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:46.743065 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a297e8b-7872-46e0-91ac-83e9c245ae3f admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:46.743765 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a297e8b-7872-46e0-91ac-83e9c245ae3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:46.744711 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372b25c1-2baa-4c04-87e0-99f224b3df32 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:46.749519 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a297e8b-7872-46e0-91ac-83e9c245ae3f admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:46.759495 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1030/2053] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:51:46.764624 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b25c1-2baa-4c04-87e0-99f224b3df32 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:46.776633 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b25c1-2baa-4c04-87e0-99f224b3df32 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:46.785968 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fcd8ce-f1d1-4086-a15f-c386a286201f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:46.786326 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcd8ce-f1d1-4086-a15f-c386a286201f admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:46.786603 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcd8ce-f1d1-4086-a15f-c386a286201f admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:46.786901 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcd8ce-f1d1-4086-a15f-c386a286201f admin admin] PATH_INFO: `/v3/projects/3de8e890d475434c91d2971d1740aba5/users/df305cac75b740fa8cc0acc97f211821/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:46.803002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fcd8ce-f1d1-4086-a15f-c386a286201f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3de8e890d475434c91d2971d1740aba5, user_id=df305cac75b740fa8cc0acc97f211821, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:46.805655 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fcd8ce-f1d1-4086-a15f-c386a286201f admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:46.838885 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1024/2054] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:51:46 2022] POST /identity/v3/users => generated 297 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:51:46.843946 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a297e8b-7872-46e0-91ac-83e9c245ae3f admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:46.854858 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a297e8b-7872-46e0-91ac-83e9c245ae3f admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:46.861683 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5956485-2fce-4870-9386-5f0110d74c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:46.862325 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5956485-2fce-4870-9386-5f0110d74c51 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:46.862608 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5956485-2fce-4870-9386-5f0110d74c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:46.862881 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5956485-2fce-4870-9386-5f0110d74c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:46.863531 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5956485-2fce-4870-9386-5f0110d74c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:46.865390 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5956485-2fce-4870-9386-5f0110d74c51 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:46.878881 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1025/2055] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:51:46.885015 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5956485-2fce-4870-9386-5f0110d74c51 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:46.896670 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5956485-2fce-4870-9386-5f0110d74c51 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:46.902271 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd3297-c5ce-4ccf-b9d7-97f6acd2db34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:46.904629 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd3297-c5ce-4ccf-b9d7-97f6acd2db34 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:46.904629 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd3297-c5ce-4ccf-b9d7-97f6acd2db34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:46.904629 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd3297-c5ce-4ccf-b9d7-97f6acd2db34 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:46.904865 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd3297-c5ce-4ccf-b9d7-97f6acd2db34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:46.911676 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd3297-c5ce-4ccf-b9d7-97f6acd2db34 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:46.913024 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1031/2056] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:51:46 2022] PUT /identity/v3/projects/3de8e890d475434c91d2971d1740aba5/users/df305cac75b740fa8cc0acc97f211821/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:46.921282 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fcd8ce-f1d1-4086-a15f-c386a286201f admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:46.933450 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1026/2057] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:51:46.934115 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd3297-c5ce-4ccf-b9d7-97f6acd2db34 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:46.936992 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-28cd3297-c5ce-4ccf-b9d7-97f6acd2db34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:46.952552 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd3297-c5ce-4ccf-b9d7-97f6acd2db34 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:47.015488 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817130ad-5eee-432e-af8e-97aaf2005b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:47.015488 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817130ad-5eee-432e-af8e-97aaf2005b0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:47.015488 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817130ad-5eee-432e-af8e-97aaf2005b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:47.015488 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817130ad-5eee-432e-af8e-97aaf2005b0e admin admin] PATH_INFO: `/v3/projects/3eabfda9ac4a45629cb2497763b00dc8` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:47.016349 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817130ad-5eee-432e-af8e-97aaf2005b0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eabfda9ac4a45629cb2497763b00dc8)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:47.016635 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fcd8ce-f1d1-4086-a15f-c386a286201f admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:47.017860 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817130ad-5eee-432e-af8e-97aaf2005b0e admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:47.022183 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53183fe-a64e-4384-a308-afc371fa4bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:47.022792 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53183fe-a64e-4384-a308-afc371fa4bef admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:47.023071 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53183fe-a64e-4384-a308-afc371fa4bef admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:47.023342 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53183fe-a64e-4384-a308-afc371fa4bef admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:47.024100 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53183fe-a64e-4384-a308-afc371fa4bef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:47.025741 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53183fe-a64e-4384-a308-afc371fa4bef admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:47.042423 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1032/2058] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:51:47.042423 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53183fe-a64e-4384-a308-afc371fa4bef admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:47.042423 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:47.053809 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53183fe-a64e-4384-a308-afc371fa4bef admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:47.058728 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2775a3-0731-4df8-812a-060b8e0a4d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:47.060024 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2775a3-0731-4df8-812a-060b8e0a4d1e admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:47.060308 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2775a3-0731-4df8-812a-060b8e0a4d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:47.060658 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2775a3-0731-4df8-812a-060b8e0a4d1e admin admin] PATH_INFO: `/v3/projects/847f631fd84f47cfbce86a3d59b27da4/users/81e69ba7717f4956bf327292fdf98cb5/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:47.075682 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2775a3-0731-4df8-812a-060b8e0a4d1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=847f631fd84f47cfbce86a3d59b27da4, user_id=81e69ba7717f4956bf327292fdf98cb5, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:47.078430 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2775a3-0731-4df8-812a-060b8e0a4d1e admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:47.243694 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:47.245780 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1033/2059] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:51:47 2022] PUT /identity/v3/projects/847f631fd84f47cfbce86a3d59b27da4/users/81e69ba7717f4956bf327292fdf98cb5/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:47.251474 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2775a3-0731-4df8-812a-060b8e0a4d1e admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:47.264251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-817130ad-5eee-432e-af8e-97aaf2005b0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eabfda9ac4a45629cb2497763b00dc8', 'request_id': 'req-817130ad-5eee-432e-af8e-97aaf2005b0e'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:47.271817 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-817130ad-5eee-432e-af8e-97aaf2005b0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eabfda9ac4a45629cb2497763b00dc8', 'request_id': 'req-817130ad-5eee-432e-af8e-97aaf2005b0e'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:47.324913 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2775a3-0731-4df8-812a-060b8e0a4d1e admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:47.383795 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218590a-155a-495a-9bb9-d337c59ad8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:47.384469 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218590a-155a-495a-9bb9-d337c59ad8ea admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:47.384748 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218590a-155a-495a-9bb9-d337c59ad8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:47.385044 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218590a-155a-495a-9bb9-d337c59ad8ea admin admin] PATH_INFO: `/v3/projects/3de8e890d475434c91d2971d1740aba5/users/df305cac75b740fa8cc0acc97f211821/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:47.387060 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218590a-155a-495a-9bb9-d337c59ad8ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=3de8e890d475434c91d2971d1740aba5, user_id=df305cac75b740fa8cc0acc97f211821, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:47.389954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218590a-155a-495a-9bb9-d337c59ad8ea admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:47.400582 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1034/2060] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:51:47 2022] PUT /identity/v3/projects/3de8e890d475434c91d2971d1740aba5/users/df305cac75b740fa8cc0acc97f211821/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:47.401890 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56033f3f-1a47-45f5-a9b6-724798c5ae9e None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:47.402171 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56033f3f-1a47-45f5-a9b6-724798c5ae9e None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:47.402443 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56033f3f-1a47-45f5-a9b6-724798c5ae9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:47.405645 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-817130ad-5eee-432e-af8e-97aaf2005b0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eabfda9ac4a45629cb2497763b00dc8', 'request_id': 'req-817130ad-5eee-432e-af8e-97aaf2005b0e'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:47.423906 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-56033f3f-1a47-45f5-a9b6-724798c5ae9e None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:47.424591 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-817130ad-5eee-432e-af8e-97aaf2005b0e admin admin] The token cache is being invalidate because project 3eabfda9ac4a45629cb2497763b00dc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:51:47.424961 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-817130ad-5eee-432e-af8e-97aaf2005b0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:47.425333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-56033f3f-1a47-45f5-a9b6-724798c5ae9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:47.426226 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-817130ad-5eee-432e-af8e-97aaf2005b0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:51:47.428095 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1027/2061] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:51:46 2022] DELETE /identity/v3/projects/3eabfda9ac4a45629cb2497763b00dc8 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:47.436144 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685c662-201c-4b5a-b975-02a038e013b9 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:47.436448 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685c662-201c-4b5a-b975-02a038e013b9 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:47.440561 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685c662-201c-4b5a-b975-02a038e013b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:47.467881 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-4685c662-201c-4b5a-b975-02a038e013b9 None None] MFA Rules not processed for user `80a62354f9e743cc8e01afd1765eb1f7`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:47.469184 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-4685c662-201c-4b5a-b975-02a038e013b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:47.494849 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1035/2062] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:47.494849 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7139c3-cf84-4b58-8233-a5493d8b817a None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:47.494849 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7139c3-cf84-4b58-8233-a5493d8b817a None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:47.494849 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7139c3-cf84-4b58-8233-a5493d8b817a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:47.517998 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-1d7139c3-cf84-4b58-8233-a5493d8b817a None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:47.519386 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-1d7139c3-cf84-4b58-8233-a5493d8b817a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:47.528891 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1036/2063] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:47.529815 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7139c3-cf84-4b58-8233-a5493d8b817a None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:47.538123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-1d7139c3-cf84-4b58-8233-a5493d8b817a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:47.553978 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1028/2064] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:47.556569 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae30e3-30db-40d8-8c9a-278f6f9b9fae None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:47.557131 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae30e3-30db-40d8-8c9a-278f6f9b9fae None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:47.557602 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae30e3-30db-40d8-8c9a-278f6f9b9fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:47.581850 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-3fae30e3-30db-40d8-8c9a-278f6f9b9fae None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:47.583263 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-3fae30e3-30db-40d8-8c9a-278f6f9b9fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:47.597324 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1029/2065] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:47.597324 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae30e3-30db-40d8-8c9a-278f6f9b9fae None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:47.601847 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-3fae30e3-30db-40d8-8c9a-278f6f9b9fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:47.611748 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7139c3-cf84-4b58-8233-a5493d8b817a None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:47.615857 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e22079-b9b2-4462-ad7c-230342610135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:47.616477 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e22079-b9b2-4462-ad7c-230342610135 service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:47.616762 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e22079-b9b2-4462-ad7c-230342610135 service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:47.617062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e22079-b9b2-4462-ad7c-230342610135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:47.626737 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e22079-b9b2-4462-ad7c-230342610135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:47.628229 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e22079-b9b2-4462-ad7c-230342610135 service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:47.639110 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1037/2066] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:51:47.640246 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e22079-b9b2-4462-ad7c-230342610135 service neutron] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:47.649648 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e22079-b9b2-4462-ad7c-230342610135 service neutron] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:47.655248 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2974a-73ab-4818-b397-5df5ff325fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:47.655858 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2974a-73ab-4818-b397-5df5ff325fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:47.658343 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2974a-73ab-4818-b397-5df5ff325fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:47.658343 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2974a-73ab-4818-b397-5df5ff325fe2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:47.658343 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2974a-73ab-4818-b397-5df5ff325fe2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:51:47.658343 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2974a-73ab-4818-b397-5df5ff325fe2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:47.659010 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2974a-73ab-4818-b397-5df5ff325fe2 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:47.671013 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae30e3-30db-40d8-8c9a-278f6f9b9fae None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:47.675731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1038/2067] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:51:47.675874 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7442038-c1ee-423e-835d-b57f0edbc5c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:47.676005 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7442038-c1ee-423e-835d-b57f0edbc5c8 service cinder] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:47.676443 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7442038-c1ee-423e-835d-b57f0edbc5c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:47.676726 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7442038-c1ee-423e-835d-b57f0edbc5c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:47.676830 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2974a-73ab-4818-b397-5df5ff325fe2 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:47.687453 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2974a-73ab-4818-b397-5df5ff325fe2 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:47.687846 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7442038-c1ee-423e-835d-b57f0edbc5c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:47.689449 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7442038-c1ee-423e-835d-b57f0edbc5c8 service cinder] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:47.692673 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e574b78-83b4-4c9c-ad23-ffe2e14642d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:47.693395 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e574b78-83b4-4c9c-ad23-ffe2e14642d7 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:47.693669 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e574b78-83b4-4c9c-ad23-ffe2e14642d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:47.693944 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e574b78-83b4-4c9c-ad23-ffe2e14642d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:47.696976 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e574b78-83b4-4c9c-ad23-ffe2e14642d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:47.696976 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e574b78-83b4-4c9c-ad23-ffe2e14642d7 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:47.708918 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1030/2068] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:51:47.801078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1039/2069] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:51:47 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:51:47.804933 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7442038-c1ee-423e-835d-b57f0edbc5c8 service cinder] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:47.819769 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7442038-c1ee-423e-835d-b57f0edbc5c8 service cinder] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:47.889023 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5e734-77b1-483e-89fc-fee68b1a5b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:47.889716 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5e734-77b1-483e-89fc-fee68b1a5b26 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:47.889997 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5e734-77b1-483e-89fc-fee68b1a5b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:47.890266 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5e734-77b1-483e-89fc-fee68b1a5b26 admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:47.890901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5e734-77b1-483e-89fc-fee68b1a5b26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:47.893005 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5e734-77b1-483e-89fc-fee68b1a5b26 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:47.960352 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:48.024212 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1031/2070] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:51:47 2022] POST /identity/v3/users => generated 287 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:51:48.028505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e574b78-83b4-4c9c-ad23-ffe2e14642d7 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:48.038950 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e574b78-83b4-4c9c-ad23-ffe2e14642d7 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:48.045117 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc693246-95ec-4adb-b810-e82368377e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:48.045824 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc693246-95ec-4adb-b810-e82368377e90 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:48.046112 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc693246-95ec-4adb-b810-e82368377e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:48.046387 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc693246-95ec-4adb-b810-e82368377e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:48.047056 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc693246-95ec-4adb-b810-e82368377e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:48.048681 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc693246-95ec-4adb-b810-e82368377e90 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:48.060161 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1040/2071] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:51:48.064752 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5e734-77b1-483e-89fc-fee68b1a5b26 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:48.076835 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5e734-77b1-483e-89fc-fee68b1a5b26 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:48.100369 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762fe26-a80e-498c-864c-77052c6a35c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:48.101342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762fe26-a80e-498c-864c-77052c6a35c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:48.101730 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762fe26-a80e-498c-864c-77052c6a35c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:48.102077 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762fe26-a80e-498c-864c-77052c6a35c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:48.103157 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762fe26-a80e-498c-864c-77052c6a35c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:48.105208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762fe26-a80e-498c-864c-77052c6a35c9 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:48.120056 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1032/2072] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:51:48.122204 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc693246-95ec-4adb-b810-e82368377e90 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:48.132700 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc693246-95ec-4adb-b810-e82368377e90 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:48.137344 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8834e9e-f34f-473e-89bb-7b99f13cb44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:48.138533 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8834e9e-f34f-473e-89bb-7b99f13cb44b admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:48.138815 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8834e9e-f34f-473e-89bb-7b99f13cb44b admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:48.139103 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8834e9e-f34f-473e-89bb-7b99f13cb44b admin admin] PATH_INFO: `/v3/projects/650d29be0dcc416497e3cd72bd4e8077/users/6b5852d7e98d40b6abd2eccd3efc6748/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:48.154922 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8834e9e-f34f-473e-89bb-7b99f13cb44b admin admin] RBAC: Authorizing `identity:create_grant(project_id=650d29be0dcc416497e3cd72bd4e8077, user_id=6b5852d7e98d40b6abd2eccd3efc6748, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:48.157607 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8834e9e-f34f-473e-89bb-7b99f13cb44b admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:48.257477 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1041/2073] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:51:48 2022] PUT /identity/v3/projects/650d29be0dcc416497e3cd72bd4e8077/users/6b5852d7e98d40b6abd2eccd3efc6748/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:51:48.272862 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b62cce-26cc-439b-96c8-5361768ccf59 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:48.273496 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b62cce-26cc-439b-96c8-5361768ccf59 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:48.273918 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b62cce-26cc-439b-96c8-5361768ccf59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:48.323606 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-f2b62cce-26cc-439b-96c8-5361768ccf59 None None] MFA Rules not processed for user `6b5852d7e98d40b6abd2eccd3efc6748`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:48.326471 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-f2b62cce-26cc-439b-96c8-5361768ccf59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:48.401187 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1033/2074] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:48.411173 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8834e9e-f34f-473e-89bb-7b99f13cb44b admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:48.413937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-e8834e9e-f34f-473e-89bb-7b99f13cb44b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:48.438096 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:48.505281 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8834e9e-f34f-473e-89bb-7b99f13cb44b admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:48.513210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97072789-4d2f-4187-8e43-62842516cb1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:48.513398 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97072789-4d2f-4187-8e43-62842516cb1c service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:48.514218 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97072789-4d2f-4187-8e43-62842516cb1c service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:48.514995 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97072789-4d2f-4187-8e43-62842516cb1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:48.535038 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97072789-4d2f-4187-8e43-62842516cb1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:48.536758 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97072789-4d2f-4187-8e43-62842516cb1c service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:48.549297 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1042/2075] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:51:48.916425 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed8540-b020-48ac-986e-de1d37c7016a None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:48.916425 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed8540-b020-48ac-986e-de1d37c7016a None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:48.916581 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed8540-b020-48ac-986e-de1d37c7016a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:48.949557 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-70ed8540-b020-48ac-986e-de1d37c7016a None None] MFA Rules not processed for user `df305cac75b740fa8cc0acc97f211821`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:48.950991 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-70ed8540-b020-48ac-986e-de1d37c7016a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:49.049178 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1034/2076] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:48 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:49.060048 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95d3f6-412f-4c98-8579-18cbf95bba5f None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:49.060553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95d3f6-412f-4c98-8579-18cbf95bba5f None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:49.060672 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95d3f6-412f-4c98-8579-18cbf95bba5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:49.067783 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:49.080160 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-7b95d3f6-412f-4c98-8579-18cbf95bba5f None None] MFA Rules not processed for user `ac108193d32240489d5989c3cabf7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:49.081434 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-7b95d3f6-412f-4c98-8579-18cbf95bba5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:49.163153 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1043/2077] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:49.174966 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed8540-b020-48ac-986e-de1d37c7016a None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:49.176408 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-70ed8540-b020-48ac-986e-de1d37c7016a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:49.251214 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed8540-b020-48ac-986e-de1d37c7016a None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:49.257566 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3dadf-d879-448a-8539-272ca1435d5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:49.258310 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3dadf-d879-448a-8539-272ca1435d5e service nova] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:49.258595 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3dadf-d879-448a-8539-272ca1435d5e service nova] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:49.258894 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3dadf-d879-448a-8539-272ca1435d5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:49.260865 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-35e3dadf-d879-448a-8539-272ca1435d5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:49.272497 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3dadf-d879-448a-8539-272ca1435d5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:49.274113 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3dadf-d879-448a-8539-272ca1435d5e service nova] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:49.284282 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1035/2078] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:51:49.659150 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692c4ac-87e0-4da6-9546-89e162ca1be1 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:49.659430 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692c4ac-87e0-4da6-9546-89e162ca1be1 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:49.661117 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692c4ac-87e0-4da6-9546-89e162ca1be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:49.690296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-6692c4ac-87e0-4da6-9546-89e162ca1be1 None None] MFA Rules not processed for user `80a62354f9e743cc8e01afd1765eb1f7`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:49.691539 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-6692c4ac-87e0-4da6-9546-89e162ca1be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:49.765508 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1044/2079] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:50.244950 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:51.628812 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:52.183385 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:53.067449 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:54.686935 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:55.138319 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093117a6-fab0-4336-bdb0-1eb8093e17d2 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:55.138805 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093117a6-fab0-4336-bdb0-1eb8093e17d2 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:55.139057 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093117a6-fab0-4336-bdb0-1eb8093e17d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:55.183537 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-093117a6-fab0-4336-bdb0-1eb8093e17d2 None None] MFA Rules not processed for user `81e69ba7717f4956bf327292fdf98cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:55.185784 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-093117a6-fab0-4336-bdb0-1eb8093e17d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:55.236855 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:55.308808 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1036/2080] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:55.320181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94643a85-5c7f-40c5-8e1a-d5340657ebc1 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:55.320466 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94643a85-5c7f-40c5-8e1a-d5340657ebc1 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:55.320954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94643a85-5c7f-40c5-8e1a-d5340657ebc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:55.366223 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-94643a85-5c7f-40c5-8e1a-d5340657ebc1 None None] MFA Rules not processed for user `81e69ba7717f4956bf327292fdf98cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:55.367873 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-94643a85-5c7f-40c5-8e1a-d5340657ebc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:55.376819 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1045/2081] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:55.388760 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093117a6-fab0-4336-bdb0-1eb8093e17d2 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:51:55.390268 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-093117a6-fab0-4336-bdb0-1eb8093e17d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:55.425303 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093117a6-fab0-4336-bdb0-1eb8093e17d2 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:51:55.442819 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74e404-b88a-4439-9bd4-95b9da7be205 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:51:55.443617 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74e404-b88a-4439-9bd4-95b9da7be205 service nova] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:55.444024 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74e404-b88a-4439-9bd4-95b9da7be205 service nova] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:55.444324 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74e404-b88a-4439-9bd4-95b9da7be205 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:55.464594 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de74e404-b88a-4439-9bd4-95b9da7be205 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:51:55.467702 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de74e404-b88a-4439-9bd4-95b9da7be205 service nova] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:51:55.500691 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1037/2082] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:51:55 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:51:55.733126 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:56.274520 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:56.925331 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea193d3-250a-48ba-966b-01334689bf40 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:51:56.925855 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea193d3-250a-48ba-966b-01334689bf40 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:51:56.925855 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea193d3-250a-48ba-966b-01334689bf40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:51:56.960672 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-0ea193d3-250a-48ba-966b-01334689bf40 None None] MFA Rules not processed for user `81e69ba7717f4956bf327292fdf98cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:51:56.963643 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-0ea193d3-250a-48ba-966b-01334689bf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:51:57.010410 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1046/2083] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:51:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:51:57.309928 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:58.035313 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:59.311385 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:59.840591 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:51:59.990333 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:52:00.382865 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:52:00.462485 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:52:00.777887 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:52:01.327338 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:52:01.890663 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74e404-b88a-4439-9bd4-95b9da7be205 service nova] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:01.985868 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74e404-b88a-4439-9bd4-95b9da7be205 service nova] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:01.991870 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf37623-5797-46ed-afd0-9ef560665af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:01.992662 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf37623-5797-46ed-afd0-9ef560665af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:01.993017 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf37623-5797-46ed-afd0-9ef560665af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:01.993489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf37623-5797-46ed-afd0-9ef560665af7 admin admin] PATH_INFO: `/v3/users/6b5852d7e98d40b6abd2eccd3efc6748` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:01.994786 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf37623-5797-46ed-afd0-9ef560665af7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b5852d7e98d40b6abd2eccd3efc6748)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:01.997017 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf37623-5797-46ed-afd0-9ef560665af7 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:02.274912 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:52:02.376167 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-faf37623-5797-46ed-afd0-9ef560665af7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b5852d7e98d40b6abd2eccd3efc6748'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:02.500104 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-faf37623-5797-46ed-afd0-9ef560665af7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b5852d7e98d40b6abd2eccd3efc6748'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:02.501841 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-faf37623-5797-46ed-afd0-9ef560665af7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b5852d7e98d40b6abd2eccd3efc6748'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:02.502784 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-faf37623-5797-46ed-afd0-9ef560665af7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b5852d7e98d40b6abd2eccd3efc6748'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:02.521356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-faf37623-5797-46ed-afd0-9ef560665af7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b5852d7e98d40b6abd2eccd3efc6748'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:02.553241 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1038/2084] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:52:01 2022] DELETE /identity/v3/users/6b5852d7e98d40b6abd2eccd3efc6748 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:52:02.557554 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab3f22-82a0-4a42-9a4d-9d6fb08b2d68 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:02.558695 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab3f22-82a0-4a42-9a4d-9d6fb08b2d68 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:02.559221 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab3f22-82a0-4a42-9a4d-9d6fb08b2d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:02.582091 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-53ab3f22-82a0-4a42-9a4d-9d6fb08b2d68 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:52:02.583352 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-53ab3f22-82a0-4a42-9a4d-9d6fb08b2d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:02.720059 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1047/2085] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:52:02.728678 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf37623-5797-46ed-afd0-9ef560665af7 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:02.731155 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-faf37623-5797-46ed-afd0-9ef560665af7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:02.866359 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf37623-5797-46ed-afd0-9ef560665af7 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:02.871153 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b3778-0722-49bd-9669-2446d21df7cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:02.871781 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b3778-0722-49bd-9669-2446d21df7cd service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:02.872068 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b3778-0722-49bd-9669-2446d21df7cd service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:02.872345 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b3778-0722-49bd-9669-2446d21df7cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:02.887699 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b3778-0722-49bd-9669-2446d21df7cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:02.889690 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b3778-0722-49bd-9669-2446d21df7cd service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:02.975722 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1039/2086] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:52:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:52:03.657460 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:52:03.808713 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab3f22-82a0-4a42-9a4d-9d6fb08b2d68 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:03.811745 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-53ab3f22-82a0-4a42-9a4d-9d6fb08b2d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:03.827603 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab3f22-82a0-4a42-9a4d-9d6fb08b2d68 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:03.833376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4ae5a-c90f-4be8-be6d-b9c031c5bd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:03.834115 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4ae5a-c90f-4be8-be6d-b9c031c5bd35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:03.836910 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4ae5a-c90f-4be8-be6d-b9c031c5bd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:03.836910 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4ae5a-c90f-4be8-be6d-b9c031c5bd35 admin admin] PATH_INFO: `/v3/projects/650d29be0dcc416497e3cd72bd4e8077` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:03.836910 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4ae5a-c90f-4be8-be6d-b9c031c5bd35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=650d29be0dcc416497e3cd72bd4e8077)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:03.838658 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4ae5a-c90f-4be8-be6d-b9c031c5bd35 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:03.965791 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-2bb4ae5a-c90f-4be8-be6d-b9c031c5bd35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '650d29be0dcc416497e3cd72bd4e8077', 'request_id': 'req-2bb4ae5a-c90f-4be8-be6d-b9c031c5bd35'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:03.976552 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-2bb4ae5a-c90f-4be8-be6d-b9c031c5bd35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '650d29be0dcc416497e3cd72bd4e8077', 'request_id': 'req-2bb4ae5a-c90f-4be8-be6d-b9c031c5bd35'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:04.069529 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-2bb4ae5a-c90f-4be8-be6d-b9c031c5bd35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '650d29be0dcc416497e3cd72bd4e8077', 'request_id': 'req-2bb4ae5a-c90f-4be8-be6d-b9c031c5bd35'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:04.087022 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-2bb4ae5a-c90f-4be8-be6d-b9c031c5bd35 admin admin] The token cache is being invalidate because project 650d29be0dcc416497e3cd72bd4e8077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:52:04.087676 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-2bb4ae5a-c90f-4be8-be6d-b9c031c5bd35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:04.088608 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-2bb4ae5a-c90f-4be8-be6d-b9c031c5bd35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:04.090366 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1048/2087] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:52:03 2022] DELETE /identity/v3/projects/650d29be0dcc416497e3cd72bd4e8077 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:52:04.095737 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fb5c8-ae57-4c93-906f-aec8d69f654c None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:04.096057 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fb5c8-ae57-4c93-906f-aec8d69f654c None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:04.096343 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fb5c8-ae57-4c93-906f-aec8d69f654c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:04.118909 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-ad6fb5c8-ae57-4c93-906f-aec8d69f654c None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:52:04.120995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-ad6fb5c8-ae57-4c93-906f-aec8d69f654c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:04.204156 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e1082-7618-4723-8fc4-8ed3d0cef3a1 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:04.204156 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e1082-7618-4723-8fc4-8ed3d0cef3a1 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:04.204156 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e1082-7618-4723-8fc4-8ed3d0cef3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:04.205226 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1040/2088] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:52:04.230559 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-f85e1082-7618-4723-8fc4-8ed3d0cef3a1 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:52:04.232577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-f85e1082-7618-4723-8fc4-8ed3d0cef3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:04.252466 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1049/2089] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:52:04.257118 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6fb5c8-ae57-4c93-906f-aec8d69f654c None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:04.266820 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6fb5c8-ae57-4c93-906f-aec8d69f654c None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:04.271770 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fef27d-578e-4b55-9b8d-42d29c319548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:04.272564 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fef27d-578e-4b55-9b8d-42d29c319548 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:04.272847 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fef27d-578e-4b55-9b8d-42d29c319548 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:04.273232 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fef27d-578e-4b55-9b8d-42d29c319548 admin admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:04.273883 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fef27d-578e-4b55-9b8d-42d29c319548 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:52:04.274181 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fef27d-578e-4b55-9b8d-42d29c319548 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:04.275795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fef27d-578e-4b55-9b8d-42d29c319548 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:04.288779 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1041/2090] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:52:04.293339 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e1082-7618-4723-8fc4-8ed3d0cef3a1 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:04.303902 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e1082-7618-4723-8fc4-8ed3d0cef3a1 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:04.311523 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679119a-213a-4a81-99ad-a10132102f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:04.312408 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679119a-213a-4a81-99ad-a10132102f3a admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:04.312851 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679119a-213a-4a81-99ad-a10132102f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:04.313249 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679119a-213a-4a81-99ad-a10132102f3a admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:04.314633 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679119a-213a-4a81-99ad-a10132102f3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:04.316548 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679119a-213a-4a81-99ad-a10132102f3a admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:04.333442 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:52:04.430434 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1050/2091] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:52:04 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:52:04.434626 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fef27d-578e-4b55-9b8d-42d29c319548 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:04.445688 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fef27d-578e-4b55-9b8d-42d29c319548 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:04.516526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1eaf0-5158-4a07-b4be-108e9f21e22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:04.517245 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1eaf0-5158-4a07-b4be-108e9f21e22d admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:04.517579 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1eaf0-5158-4a07-b4be-108e9f21e22d admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:04.517892 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1eaf0-5158-4a07-b4be-108e9f21e22d admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:04.518669 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1eaf0-5158-4a07-b4be-108e9f21e22d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:04.520823 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1eaf0-5158-4a07-b4be-108e9f21e22d admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:04.645282 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679119a-213a-4a81-99ad-a10132102f3a admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:04.647322 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-1679119a-213a-4a81-99ad-a10132102f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:04.660789 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679119a-213a-4a81-99ad-a10132102f3a admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:04.668207 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c748c42-ad36-426a-a6cf-8ebca1fb71c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:04.674073 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c748c42-ad36-426a-a6cf-8ebca1fb71c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:04.674073 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c748c42-ad36-426a-a6cf-8ebca1fb71c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:04.674073 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c748c42-ad36-426a-a6cf-8ebca1fb71c0 admin admin] PATH_INFO: `/v3/users/ccf986d2496c4749bc66aea08881fe6b` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:04.674073 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c748c42-ad36-426a-a6cf-8ebca1fb71c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccf986d2496c4749bc66aea08881fe6b)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:04.674073 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c748c42-ad36-426a-a6cf-8ebca1fb71c0 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:04.766672 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1042/2092] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:52:04 2022] POST /identity/v3/users => generated 293 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:52:04.768234 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1eaf0-5158-4a07-b4be-108e9f21e22d admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:04.782101 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1eaf0-5158-4a07-b4be-108e9f21e22d admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:04.789620 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2af0d8-152b-452f-8b0b-4b66881aea7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:04.794495 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2af0d8-152b-452f-8b0b-4b66881aea7f admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:04.794495 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2af0d8-152b-452f-8b0b-4b66881aea7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:04.794495 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2af0d8-152b-452f-8b0b-4b66881aea7f admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:04.794495 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2af0d8-152b-452f-8b0b-4b66881aea7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:04.795030 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2af0d8-152b-452f-8b0b-4b66881aea7f admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:04.815529 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1043/2093] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:52:04.823180 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2af0d8-152b-452f-8b0b-4b66881aea7f admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:04.851035 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2af0d8-152b-452f-8b0b-4b66881aea7f admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:04.857100 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6bc73-83b6-47a9-9105-cba73bb4539f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:04.857803 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6bc73-83b6-47a9-9105-cba73bb4539f admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:04.858174 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6bc73-83b6-47a9-9105-cba73bb4539f admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:04.858537 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6bc73-83b6-47a9-9105-cba73bb4539f admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:04.859263 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6bc73-83b6-47a9-9105-cba73bb4539f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:04.861055 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6bc73-83b6-47a9-9105-cba73bb4539f admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:04.873074 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1044/2094] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:52:04.876102 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6bc73-83b6-47a9-9105-cba73bb4539f admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:04.885940 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6bc73-83b6-47a9-9105-cba73bb4539f admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:04.892065 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb54c70-737b-4f45-932d-a1f471149477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:04.892930 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb54c70-737b-4f45-932d-a1f471149477 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:04.893265 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb54c70-737b-4f45-932d-a1f471149477 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:04.893545 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb54c70-737b-4f45-932d-a1f471149477 admin admin] PATH_INFO: `/v3/projects/e228efa1fb8648a7b9eb6c11a0518a54/users/a3b26e0fa6fe44fe9240106ee5445527/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:04.908772 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1c748c42-ad36-426a-a6cf-8ebca1fb71c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccf986d2496c4749bc66aea08881fe6b'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:04.909584 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb54c70-737b-4f45-932d-a1f471149477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e228efa1fb8648a7b9eb6c11a0518a54, user_id=a3b26e0fa6fe44fe9240106ee5445527, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:04.912481 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb54c70-737b-4f45-932d-a1f471149477 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:04.965869 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1c748c42-ad36-426a-a6cf-8ebca1fb71c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccf986d2496c4749bc66aea08881fe6b'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:04.966591 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1c748c42-ad36-426a-a6cf-8ebca1fb71c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccf986d2496c4749bc66aea08881fe6b'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:04.967212 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1c748c42-ad36-426a-a6cf-8ebca1fb71c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccf986d2496c4749bc66aea08881fe6b'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:04.974715 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1c748c42-ad36-426a-a6cf-8ebca1fb71c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccf986d2496c4749bc66aea08881fe6b'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:04.985479 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1045/2095] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:52:04 2022] PUT /identity/v3/projects/e228efa1fb8648a7b9eb6c11a0518a54/users/a3b26e0fa6fe44fe9240106ee5445527/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:52:04.990618 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a033f58-6b3c-4c29-9f20-1e1342888210 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:04.990960 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a033f58-6b3c-4c29-9f20-1e1342888210 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:04.991242 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a033f58-6b3c-4c29-9f20-1e1342888210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:04.993151 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1051/2096] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:52:04 2022] DELETE /identity/v3/users/ccf986d2496c4749bc66aea08881fe6b => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:52:04.999862 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6144c72-038a-4092-9956-55e06fd4b12f None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:05.000155 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6144c72-038a-4092-9956-55e06fd4b12f None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:05.000432 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6144c72-038a-4092-9956-55e06fd4b12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:05.011215 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-4a033f58-6b3c-4c29-9f20-1e1342888210 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:52:05.012496 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-4a033f58-6b3c-4c29-9f20-1e1342888210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:05.020171 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-a6144c72-038a-4092-9956-55e06fd4b12f None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:52:05.021402 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-a6144c72-038a-4092-9956-55e06fd4b12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:05.038742 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:52:05.078947 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1046/2097] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:52:05.088661 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a033f58-6b3c-4c29-9f20-1e1342888210 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:05.090248 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-4a033f58-6b3c-4c29-9f20-1e1342888210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:05.096007 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1052/2098] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:52:05.113641 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6144c72-038a-4092-9956-55e06fd4b12f None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:05.115005 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-a6144c72-038a-4092-9956-55e06fd4b12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:05.149488 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a033f58-6b3c-4c29-9f20-1e1342888210 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:05.155110 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef59b85-0549-4ec1-90b6-a011d42e9779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:05.157146 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef59b85-0549-4ec1-90b6-a011d42e9779 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:05.157146 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef59b85-0549-4ec1-90b6-a011d42e9779 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:05.157146 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef59b85-0549-4ec1-90b6-a011d42e9779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:05.165477 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef59b85-0549-4ec1-90b6-a011d42e9779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:05.166893 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef59b85-0549-4ec1-90b6-a011d42e9779 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:05.172682 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6144c72-038a-4092-9956-55e06fd4b12f None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:05.176426 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758f2c4-9b30-48fa-b8a6-6477836d9f6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:05.183381 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758f2c4-9b30-48fa-b8a6-6477836d9f6f service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:05.183381 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758f2c4-9b30-48fa-b8a6-6477836d9f6f service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:05.183381 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758f2c4-9b30-48fa-b8a6-6477836d9f6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:05.183925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1047/2099] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:52:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:52:05.188558 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758f2c4-9b30-48fa-b8a6-6477836d9f6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:05.190465 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758f2c4-9b30-48fa-b8a6-6477836d9f6f service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:05.200806 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1053/2100] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:52:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:52:05.745024 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef59b85-0549-4ec1-90b6-a011d42e9779 service neutron] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:05.746602 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-9ef59b85-0549-4ec1-90b6-a011d42e9779 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:05.761115 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef59b85-0549-4ec1-90b6-a011d42e9779 service neutron] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:05.766930 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b56753-0df1-40c2-94ca-af94760b41b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:05.767566 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b56753-0df1-40c2-94ca-af94760b41b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:05.767885 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b56753-0df1-40c2-94ca-af94760b41b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:05.768120 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b56753-0df1-40c2-94ca-af94760b41b6 admin admin] PATH_INFO: `/v3/projects/3c59602891de4881861c8ad5baa6f5d0` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:05.769335 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b56753-0df1-40c2-94ca-af94760b41b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c59602891de4881861c8ad5baa6f5d0)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:05.771490 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b56753-0df1-40c2-94ca-af94760b41b6 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:05.906025 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-24b56753-0df1-40c2-94ca-af94760b41b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c59602891de4881861c8ad5baa6f5d0', 'request_id': 'req-24b56753-0df1-40c2-94ca-af94760b41b6'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:05.911614 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-24b56753-0df1-40c2-94ca-af94760b41b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c59602891de4881861c8ad5baa6f5d0', 'request_id': 'req-24b56753-0df1-40c2-94ca-af94760b41b6'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:05.973346 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-24b56753-0df1-40c2-94ca-af94760b41b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c59602891de4881861c8ad5baa6f5d0', 'request_id': 'req-24b56753-0df1-40c2-94ca-af94760b41b6'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:05.986073 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-24b56753-0df1-40c2-94ca-af94760b41b6 admin admin] The token cache is being invalidate because project 3c59602891de4881861c8ad5baa6f5d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:52:05.989987 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-24b56753-0df1-40c2-94ca-af94760b41b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:05.989987 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-24b56753-0df1-40c2-94ca-af94760b41b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:05.989987 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1048/2101] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:52:05 2022] DELETE /identity/v3/projects/3c59602891de4881861c8ad5baa6f5d0 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:52:05.994361 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb634f2-9dcd-4eee-a97a-e3db5e193ba1 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:05.995307 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb634f2-9dcd-4eee-a97a-e3db5e193ba1 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:05.995795 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb634f2-9dcd-4eee-a97a-e3db5e193ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:06.017528 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-0bb634f2-9dcd-4eee-a97a-e3db5e193ba1 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:52:06.018853 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-0bb634f2-9dcd-4eee-a97a-e3db5e193ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:06.025948 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:52:06.088425 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1054/2102] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:52:06.097071 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361a7bb-1697-4dc4-bce1-294ed49e0ea5 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:06.099010 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361a7bb-1697-4dc4-bce1-294ed49e0ea5 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:06.099010 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361a7bb-1697-4dc4-bce1-294ed49e0ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:06.119142 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-7361a7bb-1697-4dc4-bce1-294ed49e0ea5 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:52:06.120366 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-7361a7bb-1697-4dc4-bce1-294ed49e0ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:06.129506 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1049/2103] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:52:06.133973 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb634f2-9dcd-4eee-a97a-e3db5e193ba1 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:06.145683 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb634f2-9dcd-4eee-a97a-e3db5e193ba1 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:06.150447 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed44ea-a011-49db-b0a5-7332ae6dacce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:06.151048 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed44ea-a011-49db-b0a5-7332ae6dacce admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:06.158883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed44ea-a011-49db-b0a5-7332ae6dacce admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:06.158883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed44ea-a011-49db-b0a5-7332ae6dacce admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:06.158883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed44ea-a011-49db-b0a5-7332ae6dacce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:52:06.158883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed44ea-a011-49db-b0a5-7332ae6dacce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:06.158883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed44ea-a011-49db-b0a5-7332ae6dacce admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:06.165723 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1055/2104] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:52:06.170357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361a7bb-1697-4dc4-bce1-294ed49e0ea5 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:06.179941 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361a7bb-1697-4dc4-bce1-294ed49e0ea5 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:06.184779 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b24ac-6113-41d4-a016-0c418f5e8296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:06.187742 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b24ac-6113-41d4-a016-0c418f5e8296 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:06.187742 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b24ac-6113-41d4-a016-0c418f5e8296 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:06.187742 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b24ac-6113-41d4-a016-0c418f5e8296 admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:06.187742 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b24ac-6113-41d4-a016-0c418f5e8296 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:06.189729 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b24ac-6113-41d4-a016-0c418f5e8296 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:06.207313 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:52:06.355356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1050/2105] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:52:06 2022] POST /identity/v3/projects => generated 371 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:52:06.357062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed44ea-a011-49db-b0a5-7332ae6dacce admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:06.370477 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed44ea-a011-49db-b0a5-7332ae6dacce admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:06.432150 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9330043f-1eaf-4b60-9e8d-e094f2d0cb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:06.432753 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330043f-1eaf-4b60-9e8d-e094f2d0cb8c admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:06.433068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330043f-1eaf-4b60-9e8d-e094f2d0cb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:06.433342 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330043f-1eaf-4b60-9e8d-e094f2d0cb8c admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:06.434019 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9330043f-1eaf-4b60-9e8d-e094f2d0cb8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:06.436534 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9330043f-1eaf-4b60-9e8d-e094f2d0cb8c admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:06.580229 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1056/2106] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:52:06 2022] POST /identity/v3/users => generated 286 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:52:06.584209 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b24ac-6113-41d4-a016-0c418f5e8296 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:06.612356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b24ac-6113-41d4-a016-0c418f5e8296 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:06.617137 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ee512-874d-46de-a3a7-a96790a0aa57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:06.617899 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ee512-874d-46de-a3a7-a96790a0aa57 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:06.620009 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ee512-874d-46de-a3a7-a96790a0aa57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:06.620449 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ee512-874d-46de-a3a7-a96790a0aa57 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:06.621273 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ee512-874d-46de-a3a7-a96790a0aa57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:06.623852 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ee512-874d-46de-a3a7-a96790a0aa57 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:06.639750 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1051/2107] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:52:06.641168 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9330043f-1eaf-4b60-9e8d-e094f2d0cb8c admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:06.653988 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9330043f-1eaf-4b60-9e8d-e094f2d0cb8c admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:06.661381 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb59ca6-6aad-4a50-a8de-0ac2b149f6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:06.664554 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb59ca6-6aad-4a50-a8de-0ac2b149f6cf admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:06.664554 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb59ca6-6aad-4a50-a8de-0ac2b149f6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:06.664554 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb59ca6-6aad-4a50-a8de-0ac2b149f6cf admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:06.664554 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb59ca6-6aad-4a50-a8de-0ac2b149f6cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:06.665095 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb59ca6-6aad-4a50-a8de-0ac2b149f6cf admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:06.686006 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1057/2108] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:52:06.690582 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ee512-874d-46de-a3a7-a96790a0aa57 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:06.703260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ee512-874d-46de-a3a7-a96790a0aa57 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:06.708903 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1739d2-bb08-427b-99a5-557a0d906950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:06.710036 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1739d2-bb08-427b-99a5-557a0d906950 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:06.710327 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1739d2-bb08-427b-99a5-557a0d906950 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:06.710606 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1739d2-bb08-427b-99a5-557a0d906950 admin admin] PATH_INFO: `/v3/projects/ae5db99f36fd412a883741ff22967bdd/users/72910ba91d12416b90ce5a3c71cc5728/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:06.731527 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1739d2-bb08-427b-99a5-557a0d906950 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae5db99f36fd412a883741ff22967bdd, user_id=72910ba91d12416b90ce5a3c71cc5728, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:06.737316 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1739d2-bb08-427b-99a5-557a0d906950 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:06.835282 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1052/2109] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:52:06 2022] PUT /identity/v3/projects/ae5db99f36fd412a883741ff22967bdd/users/72910ba91d12416b90ce5a3c71cc5728/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:52:06.846322 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a7f31-3df1-4b15-887d-f75826bbb105 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:06.846607 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a7f31-3df1-4b15-887d-f75826bbb105 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:06.847137 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a7f31-3df1-4b15-887d-f75826bbb105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:06.875823 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-882a7f31-3df1-4b15-887d-f75826bbb105 None None] MFA Rules not processed for user `72910ba91d12416b90ce5a3c71cc5728`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:52:06.877050 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-882a7f31-3df1-4b15-887d-f75826bbb105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:06.946178 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1058/2110] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:52:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:52:06.958320 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1739d2-bb08-427b-99a5-557a0d906950 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:06.960199 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-5a1739d2-bb08-427b-99a5-557a0d906950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:07.028246 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1739d2-bb08-427b-99a5-557a0d906950 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:07.032731 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22d358-de25-46b7-b8d3-bd92eb3f40d0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab95367403451b921099425345b3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:07.037879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22d358-de25-46b7-b8d3-bd92eb3f40d0 service glance] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:07.037879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22d358-de25-46b7-b8d3-bd92eb3f40d0 service glance] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:07.037879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22d358-de25-46b7-b8d3-bd92eb3f40d0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:07.044310 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa22d358-de25-46b7-b8d3-bd92eb3f40d0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:07.046801 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa22d358-de25-46b7-b8d3-bd92eb3f40d0 service glance] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:07.064766 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1053/2111] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:52:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:52:07.355937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:INSERT=2,keystone:SELECT=95,keystone:DELETE=3 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:52:12.043427 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23295578-e101-4f62-bdaa-4e486801a7b8 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:12.044810 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23295578-e101-4f62-bdaa-4e486801a7b8 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:12.045961 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23295578-e101-4f62-bdaa-4e486801a7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:12.063160 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:52:12.085321 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-23295578-e101-4f62-bdaa-4e486801a7b8 None None] MFA Rules not processed for user `a3b26e0fa6fe44fe9240106ee5445527`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:52:12.086787 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-23295578-e101-4f62-bdaa-4e486801a7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:12.174545 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1059/2112] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:52:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:52:12.180690 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22d358-de25-46b7-b8d3-bd92eb3f40d0 service glance] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:12.183418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-aa22d358-de25-46b7-b8d3-bd92eb3f40d0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:12.286487 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22d358-de25-46b7-b8d3-bd92eb3f40d0 service glance] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:12.291231 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb6ede-a6bf-47d4-9b10-cd7f7806fa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:12.291931 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb6ede-a6bf-47d4-9b10-cd7f7806fa5a admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:12.292209 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb6ede-a6bf-47d4-9b10-cd7f7806fa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:12.292506 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb6ede-a6bf-47d4-9b10-cd7f7806fa5a admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:12.293194 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb6ede-a6bf-47d4-9b10-cd7f7806fa5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:12.295270 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb6ede-a6bf-47d4-9b10-cd7f7806fa5a admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:12.384686 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:52:12.393348 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1054/2113] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:52:12 2022] POST /identity/v3/projects => generated 385 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:52:12.398892 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23295578-e101-4f62-bdaa-4e486801a7b8 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:12.411457 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23295578-e101-4f62-bdaa-4e486801a7b8 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:12.476207 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ccd6e-a1ef-42e2-bc73-2600d07ee486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:12.476838 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ccd6e-a1ef-42e2-bc73-2600d07ee486 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:12.477182 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ccd6e-a1ef-42e2-bc73-2600d07ee486 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:12.477424 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ccd6e-a1ef-42e2-bc73-2600d07ee486 admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:12.478066 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ccd6e-a1ef-42e2-bc73-2600d07ee486 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:12.480230 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ccd6e-a1ef-42e2-bc73-2600d07ee486 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:12.584937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1060/2114] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:52:12 2022] POST /identity/v3/users => generated 299 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:52:12.585975 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb6ede-a6bf-47d4-9b10-cd7f7806fa5a admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:12.598237 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb6ede-a6bf-47d4-9b10-cd7f7806fa5a admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:12.608339 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f1301-704a-4210-b812-b76a2d0db522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:12.609054 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f1301-704a-4210-b812-b76a2d0db522 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:12.609349 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f1301-704a-4210-b812-b76a2d0db522 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:12.609665 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f1301-704a-4210-b812-b76a2d0db522 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:12.610302 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f1301-704a-4210-b812-b76a2d0db522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:12.611945 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f1301-704a-4210-b812-b76a2d0db522 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:12.626169 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1055/2115] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:52:12.630571 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ccd6e-a1ef-42e2-bc73-2600d07ee486 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:12.643471 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ccd6e-a1ef-42e2-bc73-2600d07ee486 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:12.649801 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8315af7-d480-4b63-b212-361143db9a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:12.650736 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8315af7-d480-4b63-b212-361143db9a99 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:12.651118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8315af7-d480-4b63-b212-361143db9a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:12.651539 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8315af7-d480-4b63-b212-361143db9a99 admin admin] PATH_INFO: `/v3/projects/7d051f5d761341fa9a4179922c0f5f8d/users/cfdccb06ca1643e4965766bab25bf1f1/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:12.677317 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8315af7-d480-4b63-b212-361143db9a99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d051f5d761341fa9a4179922c0f5f8d, user_id=cfdccb06ca1643e4965766bab25bf1f1, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:12.680077 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8315af7-d480-4b63-b212-361143db9a99 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:12.789338 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1061/2116] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:52:12 2022] PUT /identity/v3/projects/7d051f5d761341fa9a4179922c0f5f8d/users/cfdccb06ca1643e4965766bab25bf1f1/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:52:12.794683 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f1301-704a-4210-b812-b76a2d0db522 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:12.809211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f1301-704a-4210-b812-b76a2d0db522 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:12.883199 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6feb46-ea9e-49e3-8ac0-0e3ff7b6963b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:12.887267 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6feb46-ea9e-49e3-8ac0-0e3ff7b6963b admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:12.887267 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6feb46-ea9e-49e3-8ac0-0e3ff7b6963b admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:12.887267 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6feb46-ea9e-49e3-8ac0-0e3ff7b6963b admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:12.887267 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6feb46-ea9e-49e3-8ac0-0e3ff7b6963b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:12.887267 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6feb46-ea9e-49e3-8ac0-0e3ff7b6963b admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:12.898227 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1056/2117] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:52:12.902776 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8315af7-d480-4b63-b212-361143db9a99 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:12.913972 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8315af7-d480-4b63-b212-361143db9a99 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:12.918913 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db766af9-189c-4c79-91d0-9b301c9dbd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:12.919656 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db766af9-189c-4c79-91d0-9b301c9dbd12 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:12.920094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db766af9-189c-4c79-91d0-9b301c9dbd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:12.920375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db766af9-189c-4c79-91d0-9b301c9dbd12 admin admin] PATH_INFO: `/v3/projects/7d051f5d761341fa9a4179922c0f5f8d/users/cfdccb06ca1643e4965766bab25bf1f1/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:12.922403 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db766af9-189c-4c79-91d0-9b301c9dbd12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d051f5d761341fa9a4179922c0f5f8d, user_id=cfdccb06ca1643e4965766bab25bf1f1, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:12.925116 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db766af9-189c-4c79-91d0-9b301c9dbd12 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:12.937107 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1062/2118] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:52:12 2022] PUT /identity/v3/projects/7d051f5d761341fa9a4179922c0f5f8d/users/cfdccb06ca1643e4965766bab25bf1f1/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:52:13.728736 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b8833-c2ac-48df-8871-6165b36b8efb None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:13.729296 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b8833-c2ac-48df-8871-6165b36b8efb None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:13.729296 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b8833-c2ac-48df-8871-6165b36b8efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:13.749128 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-7f1b8833-c2ac-48df-8871-6165b36b8efb None None] MFA Rules not processed for user `80a62354f9e743cc8e01afd1765eb1f7`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:52:13.750460 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-7f1b8833-c2ac-48df-8871-6165b36b8efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:13.774161 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db766af9-189c-4c79-91d0-9b301c9dbd12 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:13.776914 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-db766af9-189c-4c79-91d0-9b301c9dbd12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:13.811758 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1057/2119] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:52:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:52:13.846972 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:52:13.852930 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db766af9-189c-4c79-91d0-9b301c9dbd12 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:13.856793 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c5ddc-9ef9-4f5c-baa8-990f18e3c072 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:13.857517 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c5ddc-9ef9-4f5c-baa8-990f18e3c072 service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:13.858875 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c5ddc-9ef9-4f5c-baa8-990f18e3c072 service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:13.859159 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c5ddc-9ef9-4f5c-baa8-990f18e3c072 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:13.864507 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-a54c5ddc-9ef9-4f5c-baa8-990f18e3c072 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:13.965976 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c5ddc-9ef9-4f5c-baa8-990f18e3c072 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:13.968578 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c5ddc-9ef9-4f5c-baa8-990f18e3c072 service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:13.980975 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1063/2120] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:52:13 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:52:20.732080 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f8138-f3d7-4fa9-b95d-a88862b38afb None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:20.732609 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f8138-f3d7-4fa9-b95d-a88862b38afb None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:20.732609 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f8138-f3d7-4fa9-b95d-a88862b38afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:20.783463 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-4a5f8138-f3d7-4fa9-b95d-a88862b38afb None None] MFA Rules not processed for user `cfdccb06ca1643e4965766bab25bf1f1`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:52:20.784743 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-4a5f8138-f3d7-4fa9-b95d-a88862b38afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:20.884552 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1058/2121] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:52:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:52:20.900178 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c5ddc-9ef9-4f5c-baa8-990f18e3c072 service cinder] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:21.099644 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c5ddc-9ef9-4f5c-baa8-990f18e3c072 service cinder] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:21.118971 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a886c2b-c730-4612-a838-d309a48f60d5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab95367403451b921099425345b3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:21.120066 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a886c2b-c730-4612-a838-d309a48f60d5 service glance] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:21.120499 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a886c2b-c730-4612-a838-d309a48f60d5 service glance] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:21.121166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a886c2b-c730-4612-a838-d309a48f60d5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:21.224489 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a886c2b-c730-4612-a838-d309a48f60d5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:21.226064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a886c2b-c730-4612-a838-d309a48f60d5 service glance] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:21.245117 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1064/2122] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:52:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:52:21.573302 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f615aa-8c75-4ea7-90ec-b77df3e85dc4 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:21.574877 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f615aa-8c75-4ea7-90ec-b77df3e85dc4 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:21.574877 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f615aa-8c75-4ea7-90ec-b77df3e85dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:21.595089 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-a2f615aa-8c75-4ea7-90ec-b77df3e85dc4 None None] MFA Rules not processed for user `c880ab908c114c5897d11aad7fb48607`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:52:21.602051 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-a2f615aa-8c75-4ea7-90ec-b77df3e85dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:21.609968 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:52:21.690779 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1059/2123] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Aug 8 17:52:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:52:21.768207 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a886c2b-c730-4612-a838-d309a48f60d5 service glance] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:21.770088 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-5a886c2b-c730-4612-a838-d309a48f60d5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:21.836369 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:52:21.860066 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a886c2b-c730-4612-a838-d309a48f60d5 service glance] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:21.867847 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225eb338-a9c1-4846-a717-7f45834f4feb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b83ff95ed44f35af2e412a700ca567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:21.868413 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225eb338-a9c1-4846-a717-7f45834f4feb service swift] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:21.868747 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225eb338-a9c1-4846-a717-7f45834f4feb service swift] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:21.869025 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225eb338-a9c1-4846-a717-7f45834f4feb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:21.884125 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225eb338-a9c1-4846-a717-7f45834f4feb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:21.890873 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225eb338-a9c1-4846-a717-7f45834f4feb service swift] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:21.911807 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1065/2124] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Aug 8 17:52:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 17:52:29.280047 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafa992-8977-467e-9d4c-7e1a878f1f10 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:29.281781 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafa992-8977-467e-9d4c-7e1a878f1f10 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:29.282213 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafa992-8977-467e-9d4c-7e1a878f1f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:29.315839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-9fafa992-8977-467e-9d4c-7e1a878f1f10 None None] MFA Rules not processed for user `7d84d1d6d0ab469f905d01d8a1276dec`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:52:29.317180 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-9fafa992-8977-467e-9d4c-7e1a878f1f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:29.439210 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1060/2125] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:52:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:52:32.206321 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=8 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:52:37.209840 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb8794-8550-4e88-8a83-5ebbd3a45acf None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:37.210543 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb8794-8550-4e88-8a83-5ebbd3a45acf None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:37.210543 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb8794-8550-4e88-8a83-5ebbd3a45acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:37.250858 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-a0bb8794-8550-4e88-8a83-5ebbd3a45acf None None] MFA Rules not processed for user `a3b26e0fa6fe44fe9240106ee5445527`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:52:37.256425 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-a0bb8794-8550-4e88-8a83-5ebbd3a45acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:37.278026 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1066/2126] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:52:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:52:39.150660 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafa992-8977-467e-9d4c-7e1a878f1f10 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:39.324040 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafa992-8977-467e-9d4c-7e1a878f1f10 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:39.336861 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06784fb4-8225-4789-af8b-155cc7acee5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:39.341982 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06784fb4-8225-4789-af8b-155cc7acee5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:39.343391 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06784fb4-8225-4789-af8b-155cc7acee5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:39.343551 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06784fb4-8225-4789-af8b-155cc7acee5b admin admin] PATH_INFO: `/v3/users/72910ba91d12416b90ce5a3c71cc5728` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:39.347098 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06784fb4-8225-4789-af8b-155cc7acee5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=72910ba91d12416b90ce5a3c71cc5728)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:39.349516 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06784fb4-8225-4789-af8b-155cc7acee5b admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:39.682819 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-06784fb4-8225-4789-af8b-155cc7acee5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72910ba91d12416b90ce5a3c71cc5728'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:39.782277 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-06784fb4-8225-4789-af8b-155cc7acee5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72910ba91d12416b90ce5a3c71cc5728'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:39.788328 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-06784fb4-8225-4789-af8b-155cc7acee5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72910ba91d12416b90ce5a3c71cc5728'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:39.788328 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-06784fb4-8225-4789-af8b-155cc7acee5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72910ba91d12416b90ce5a3c71cc5728'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:39.801845 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-06784fb4-8225-4789-af8b-155cc7acee5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72910ba91d12416b90ce5a3c71cc5728'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:39.807249 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:52:39.838278 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1061/2127] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:52:39 2022] DELETE /identity/v3/users/72910ba91d12416b90ce5a3c71cc5728 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:52:39.842888 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63483ce2-65cd-4c55-ae8c-ec51f3d98dd9 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:39.844023 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63483ce2-65cd-4c55-ae8c-ec51f3d98dd9 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:39.844023 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63483ce2-65cd-4c55-ae8c-ec51f3d98dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:39.872506 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-63483ce2-65cd-4c55-ae8c-ec51f3d98dd9 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:52:39.882285 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-63483ce2-65cd-4c55-ae8c-ec51f3d98dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:39.985390 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1067/2128] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:52:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:52:39.995671 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06784fb4-8225-4789-af8b-155cc7acee5b admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:39.998494 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-06784fb4-8225-4789-af8b-155cc7acee5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:40.049085 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6763844-2717-4e6a-8364-d8bc40f5bfe6 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:40.049379 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6763844-2717-4e6a-8364-d8bc40f5bfe6 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:40.049657 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6763844-2717-4e6a-8364-d8bc40f5bfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:40.072994 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-f6763844-2717-4e6a-8364-d8bc40f5bfe6 None None] MFA Rules not processed for user `c880ab908c114c5897d11aad7fb48607`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:52:40.074796 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-f6763844-2717-4e6a-8364-d8bc40f5bfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:40.079585 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06784fb4-8225-4789-af8b-155cc7acee5b admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:40.083679 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8f615-9fd0-49f8-9a7a-a6d1f706d2bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:40.084378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8f615-9fd0-49f8-9a7a-a6d1f706d2bc service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:40.084666 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8f615-9fd0-49f8-9a7a-a6d1f706d2bc service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:40.085184 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8f615-9fd0-49f8-9a7a-a6d1f706d2bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:40.095195 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c8f615-9fd0-49f8-9a7a-a6d1f706d2bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:40.096598 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c8f615-9fd0-49f8-9a7a-a6d1f706d2bc service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:40.106471 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1062/2129] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:52:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:52:40.133592 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1068/2130] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Aug 8 17:52:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:52:40.146763 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8f615-9fd0-49f8-9a7a-a6d1f706d2bc service neutron] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:40.148266 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-b3c8f615-9fd0-49f8-9a7a-a6d1f706d2bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:40.229933 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8f615-9fd0-49f8-9a7a-a6d1f706d2bc service neutron] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:40.235953 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42b070-61de-4266-9b42-5679fcb5bf45 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b83ff95ed44f35af2e412a700ca567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:40.236556 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42b070-61de-4266-9b42-5679fcb5bf45 service swift] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:40.236836 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42b070-61de-4266-9b42-5679fcb5bf45 service swift] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:40.237143 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42b070-61de-4266-9b42-5679fcb5bf45 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:40.245406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42b070-61de-4266-9b42-5679fcb5bf45 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:40.247044 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42b070-61de-4266-9b42-5679fcb5bf45 service swift] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:40.255324 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1063/2131] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Aug 8 17:52:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 17:52:40.750757 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6763844-2717-4e6a-8364-d8bc40f5bfe6 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:40.752460 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-f6763844-2717-4e6a-8364-d8bc40f5bfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:40.800724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6763844-2717-4e6a-8364-d8bc40f5bfe6 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:40.805648 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8c76e-a6ac-470c-b5e2-9920e93bbe04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:40.806784 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8c76e-a6ac-470c-b5e2-9920e93bbe04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:40.808586 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8c76e-a6ac-470c-b5e2-9920e93bbe04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:40.809651 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8c76e-a6ac-470c-b5e2-9920e93bbe04 admin admin] PATH_INFO: `/v3/projects/ae5db99f36fd412a883741ff22967bdd` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:40.811167 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8c76e-a6ac-470c-b5e2-9920e93bbe04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae5db99f36fd412a883741ff22967bdd)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:40.814775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8c76e-a6ac-470c-b5e2-9920e93bbe04 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:41.115392 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-04b8c76e-a6ac-470c-b5e2-9920e93bbe04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae5db99f36fd412a883741ff22967bdd', 'request_id': 'req-04b8c76e-a6ac-470c-b5e2-9920e93bbe04'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:41.129018 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-04b8c76e-a6ac-470c-b5e2-9920e93bbe04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae5db99f36fd412a883741ff22967bdd', 'request_id': 'req-04b8c76e-a6ac-470c-b5e2-9920e93bbe04'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:41.260608 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-04b8c76e-a6ac-470c-b5e2-9920e93bbe04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae5db99f36fd412a883741ff22967bdd', 'request_id': 'req-04b8c76e-a6ac-470c-b5e2-9920e93bbe04'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:41.274409 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-04b8c76e-a6ac-470c-b5e2-9920e93bbe04 admin admin] The token cache is being invalidate because project ae5db99f36fd412a883741ff22967bdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:52:41.274933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-04b8c76e-a6ac-470c-b5e2-9920e93bbe04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:41.275793 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-04b8c76e-a6ac-470c-b5e2-9920e93bbe04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:41.277674 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1069/2132] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:52:40 2022] DELETE /identity/v3/projects/ae5db99f36fd412a883741ff22967bdd => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:52:41.282808 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5f5ce-c5b1-45ea-9486-8c4aaa30200d None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:41.283692 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5f5ce-c5b1-45ea-9486-8c4aaa30200d None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:41.284131 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5f5ce-c5b1-45ea-9486-8c4aaa30200d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:41.305468 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-baa5f5ce-c5b1-45ea-9486-8c4aaa30200d None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:52:41.306838 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-baa5f5ce-c5b1-45ea-9486-8c4aaa30200d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:41.403738 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee91102-40e0-41bd-98c5-f511f9373213 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:41.404101 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee91102-40e0-41bd-98c5-f511f9373213 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:41.404462 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee91102-40e0-41bd-98c5-f511f9373213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:41.405912 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1064/2133] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:52:41.451658 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-5ee91102-40e0-41bd-98c5-f511f9373213 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:52:41.454283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-5ee91102-40e0-41bd-98c5-f511f9373213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:41.469873 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5f5ce-c5b1-45ea-9486-8c4aaa30200d None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:41.483927 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1070/2134] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:52:41.484595 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5f5ce-c5b1-45ea-9486-8c4aaa30200d None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:41.489386 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca76977-59e1-4cc4-8b85-d705a0d4d844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:41.492426 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca76977-59e1-4cc4-8b85-d705a0d4d844 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:41.492984 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca76977-59e1-4cc4-8b85-d705a0d4d844 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:41.492984 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca76977-59e1-4cc4-8b85-d705a0d4d844 admin admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:41.493960 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca76977-59e1-4cc4-8b85-d705a0d4d844 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:52:41.494273 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca76977-59e1-4cc4-8b85-d705a0d4d844 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:41.496183 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca76977-59e1-4cc4-8b85-d705a0d4d844 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:41.528552 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1065/2135] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:52:41.529804 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee91102-40e0-41bd-98c5-f511f9373213 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:41.546322 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee91102-40e0-41bd-98c5-f511f9373213 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:41.556970 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78116c9-97c6-4c74-85dc-40070ee4bad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:41.557746 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78116c9-97c6-4c74-85dc-40070ee4bad9 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:41.558771 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78116c9-97c6-4c74-85dc-40070ee4bad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:41.559118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78116c9-97c6-4c74-85dc-40070ee4bad9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:41.564765 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78116c9-97c6-4c74-85dc-40070ee4bad9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:41.566861 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78116c9-97c6-4c74-85dc-40070ee4bad9 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:41.586139 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:52:41.736631 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1071/2136] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:52:41 2022] POST /identity/v3/projects => generated 363 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:52:41.740833 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca76977-59e1-4cc4-8b85-d705a0d4d844 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:41.747500 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:52:41.759983 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca76977-59e1-4cc4-8b85-d705a0d4d844 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:41.853219 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa1205-5411-4053-84de-b717ff5c7ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:41.853854 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa1205-5411-4053-84de-b717ff5c7ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:41.856179 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa1205-5411-4053-84de-b717ff5c7ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:41.856676 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa1205-5411-4053-84de-b717ff5c7ae8 admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:41.858158 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa1205-5411-4053-84de-b717ff5c7ae8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:41.863251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa1205-5411-4053-84de-b717ff5c7ae8 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:41.971394 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1066/2137] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:52:41 2022] POST /identity/v3/users => generated 282 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:52:41.975590 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78116c9-97c6-4c74-85dc-40070ee4bad9 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:42.002733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78116c9-97c6-4c74-85dc-40070ee4bad9 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:42.010814 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e998a9-3083-494b-9a6d-d08ab8028378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:42.011726 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e998a9-3083-494b-9a6d-d08ab8028378 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:42.012324 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e998a9-3083-494b-9a6d-d08ab8028378 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:42.012808 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e998a9-3083-494b-9a6d-d08ab8028378 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:42.013743 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e998a9-3083-494b-9a6d-d08ab8028378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:42.016723 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e998a9-3083-494b-9a6d-d08ab8028378 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:42.035934 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1072/2138] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:52:42.037171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa1205-5411-4053-84de-b717ff5c7ae8 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:42.049080 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa1205-5411-4053-84de-b717ff5c7ae8 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:42.057186 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94d31c-79d7-44ce-83d2-283106348c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:42.058496 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94d31c-79d7-44ce-83d2-283106348c5d admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:42.058496 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94d31c-79d7-44ce-83d2-283106348c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:42.058700 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94d31c-79d7-44ce-83d2-283106348c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:42.059263 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94d31c-79d7-44ce-83d2-283106348c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:42.060879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94d31c-79d7-44ce-83d2-283106348c5d admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:42.080086 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1067/2139] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:52:42.081129 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e998a9-3083-494b-9a6d-d08ab8028378 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:42.096017 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e998a9-3083-494b-9a6d-d08ab8028378 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:42.101883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd96ba8-6819-4e4a-8177-d9635e796c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:42.102716 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd96ba8-6819-4e4a-8177-d9635e796c6f admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:42.102996 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd96ba8-6819-4e4a-8177-d9635e796c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:42.103268 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd96ba8-6819-4e4a-8177-d9635e796c6f admin admin] PATH_INFO: `/v3/projects/86c5d317d1e34e129f0baebc382a41c8/users/4266569454a74cfe8218190ab351b7bb/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:42.152176 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd96ba8-6819-4e4a-8177-d9635e796c6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=86c5d317d1e34e129f0baebc382a41c8, user_id=4266569454a74cfe8218190ab351b7bb, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:42.155160 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd96ba8-6819-4e4a-8177-d9635e796c6f admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:42.274320 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1073/2140] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:52:42 2022] PUT /identity/v3/projects/86c5d317d1e34e129f0baebc382a41c8/users/4266569454a74cfe8218190ab351b7bb/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:52:42.288007 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574b970-07f1-457c-830c-4a0317d731b1 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:42.288497 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574b970-07f1-457c-830c-4a0317d731b1 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:42.293347 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574b970-07f1-457c-830c-4a0317d731b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:42.358131 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-e574b970-07f1-457c-830c-4a0317d731b1 None None] MFA Rules not processed for user `4266569454a74cfe8218190ab351b7bb`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:52:42.362186 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-e574b970-07f1-457c-830c-4a0317d731b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:42.506034 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1068/2141] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:52:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:52:42.519092 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd96ba8-6819-4e4a-8177-d9635e796c6f admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:42.521224 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-fbd96ba8-6819-4e4a-8177-d9635e796c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:42.605956 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd96ba8-6819-4e4a-8177-d9635e796c6f admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:42.610361 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c4ad9-4d02-429c-bbbe-8c55a7db473d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:42.611054 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c4ad9-4d02-429c-bbbe-8c55a7db473d service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:42.611407 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c4ad9-4d02-429c-bbbe-8c55a7db473d service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:42.611748 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c4ad9-4d02-429c-bbbe-8c55a7db473d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:42.623485 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c4ad9-4d02-429c-bbbe-8c55a7db473d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:42.626102 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c4ad9-4d02-429c-bbbe-8c55a7db473d service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:42.636555 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1074/2142] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:52:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:52:45.050157 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9de9c-7c11-40b5-8767-bbf475abaf49 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:45.069005 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9de9c-7c11-40b5-8767-bbf475abaf49 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:45.069005 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9de9c-7c11-40b5-8767-bbf475abaf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:45.090666 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-bcc9de9c-7c11-40b5-8767-bbf475abaf49 None None] MFA Rules not processed for user `c880ab908c114c5897d11aad7fb48607`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:52:45.092054 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-bcc9de9c-7c11-40b5-8767-bbf475abaf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:45.266134 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1069/2143] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Aug 8 17:52:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:52:45.282614 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c4ad9-4d02-429c-bbbe-8c55a7db473d service cinder] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:45.285705 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-e57c4ad9-4d02-429c-bbbe-8c55a7db473d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:45.469869 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c4ad9-4d02-429c-bbbe-8c55a7db473d service cinder] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:45.476107 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56242f77-e4c6-4c32-a983-138ec9ffc38a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b83ff95ed44f35af2e412a700ca567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:45.476973 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56242f77-e4c6-4c32-a983-138ec9ffc38a service swift] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:45.477397 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56242f77-e4c6-4c32-a983-138ec9ffc38a service swift] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:45.477773 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56242f77-e4c6-4c32-a983-138ec9ffc38a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:45.492115 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56242f77-e4c6-4c32-a983-138ec9ffc38a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:45.500515 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56242f77-e4c6-4c32-a983-138ec9ffc38a service swift] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:45.520772 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1075/2144] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Aug 8 17:52:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 17:52:48.337579 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb6151-a1a5-4557-9bd3-6060b2b1cd32 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:48.338060 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb6151-a1a5-4557-9bd3-6060b2b1cd32 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:48.338146 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb6151-a1a5-4557-9bd3-6060b2b1cd32 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:48.339757 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1070/2145] 10.222.0.70 () {54 vars in 921 bytes} [Mon Aug 8 17:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:52:48.357724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e6630-1873-4f9d-a5fc-948cc865a6c8 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:48.358234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e6630-1873-4f9d-a5fc-948cc865a6c8 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:48.358343 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e6630-1873-4f9d-a5fc-948cc865a6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:48.417558 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-0f2e6630-1873-4f9d-a5fc-948cc865a6c8 None None] MFA Rules not processed for user `68717c19e74e434da825d9b1d6ca202a`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:52:48.419009 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-0f2e6630-1873-4f9d-a5fc-948cc865a6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:48.511340 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:52:48.587126 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1076/2146] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Aug 8 17:52:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:52:48.615580 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb6151-a1a5-4557-9bd3-6060b2b1cd32 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:48.617880 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-ebdb6151-a1a5-4557-9bd3-6060b2b1cd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:48.694732 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb6151-a1a5-4557-9bd3-6060b2b1cd32 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:48.722152 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bced5d9-e83b-436f-8e4c-cd3b10ffcc90 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68717c19e74e434da825d9b1d6ca202a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:48.723203 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bced5d9-e83b-436f-8e4c-cd3b10ffcc90 service placement] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:48.723492 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bced5d9-e83b-436f-8e4c-cd3b10ffcc90 service placement] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:48.723767 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bced5d9-e83b-436f-8e4c-cd3b10ffcc90 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:48.749893 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bced5d9-e83b-436f-8e4c-cd3b10ffcc90 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:48.763283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bced5d9-e83b-436f-8e4c-cd3b10ffcc90 service placement] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:48.787107 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1071/2147] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:52:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:52:50.694093 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e6630-1873-4f9d-a5fc-948cc865a6c8 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:50.695552 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-0f2e6630-1873-4f9d-a5fc-948cc865a6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:50.845863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e6630-1873-4f9d-a5fc-948cc865a6c8 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:50.856011 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2831d59-ba4b-4846-a68b-772d10408417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:50.882803 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2831d59-ba4b-4846-a68b-772d10408417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:50.884261 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2831d59-ba4b-4846-a68b-772d10408417 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:50.884837 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2831d59-ba4b-4846-a68b-772d10408417 admin admin] PATH_INFO: `/v3/users/ac108193d32240489d5989c3cabf7ce6` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:50.903193 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2831d59-ba4b-4846-a68b-772d10408417 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac108193d32240489d5989c3cabf7ce6)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:50.908333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2831d59-ba4b-4846-a68b-772d10408417 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:51.202104 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a2831d59-ba4b-4846-a68b-772d10408417 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac108193d32240489d5989c3cabf7ce6'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:51.324408 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a2831d59-ba4b-4846-a68b-772d10408417 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac108193d32240489d5989c3cabf7ce6'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:51.325155 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a2831d59-ba4b-4846-a68b-772d10408417 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac108193d32240489d5989c3cabf7ce6'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:51.325939 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a2831d59-ba4b-4846-a68b-772d10408417 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac108193d32240489d5989c3cabf7ce6'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:51.342491 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a2831d59-ba4b-4846-a68b-772d10408417 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac108193d32240489d5989c3cabf7ce6'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:51.394329 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1077/2148] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:52:50 2022] DELETE /identity/v3/users/ac108193d32240489d5989c3cabf7ce6 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:52:51.870134 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bced5d9-e83b-436f-8e4c-cd3b10ffcc90 service placement] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:51.878213 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:52:51.889936 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bced5d9-e83b-436f-8e4c-cd3b10ffcc90 service placement] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:52.049137 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefbe9d4-a438-4c98-ab9b-dfaf023f0612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:52.049792 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbe9d4-a438-4c98-ab9b-dfaf023f0612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:52.050413 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbe9d4-a438-4c98-ab9b-dfaf023f0612 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:52.050694 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbe9d4-a438-4c98-ab9b-dfaf023f0612 admin admin] PATH_INFO: `/v3/projects/89cf7fb7e8214388b0f439b6282e128e` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:52.051877 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefbe9d4-a438-4c98-ab9b-dfaf023f0612 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89cf7fb7e8214388b0f439b6282e128e)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:52.054806 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefbe9d4-a438-4c98-ab9b-dfaf023f0612 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:52.361465 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-fefbe9d4-a438-4c98-ab9b-dfaf023f0612 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89cf7fb7e8214388b0f439b6282e128e', 'request_id': 'req-fefbe9d4-a438-4c98-ab9b-dfaf023f0612'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:52.361465 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-fefbe9d4-a438-4c98-ab9b-dfaf023f0612 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89cf7fb7e8214388b0f439b6282e128e', 'request_id': 'req-fefbe9d4-a438-4c98-ab9b-dfaf023f0612'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:52.895930 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-fefbe9d4-a438-4c98-ab9b-dfaf023f0612 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89cf7fb7e8214388b0f439b6282e128e', 'request_id': 'req-fefbe9d4-a438-4c98-ab9b-dfaf023f0612'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:52.919460 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-fefbe9d4-a438-4c98-ab9b-dfaf023f0612 admin admin] The token cache is being invalidate because project 89cf7fb7e8214388b0f439b6282e128e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:52:52.920168 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-fefbe9d4-a438-4c98-ab9b-dfaf023f0612 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:52.921455 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-fefbe9d4-a438-4c98-ab9b-dfaf023f0612 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:52.929884 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1072/2149] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:52:51 2022] DELETE /identity/v3/projects/89cf7fb7e8214388b0f439b6282e128e => generated 0 bytes in 1054 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:52:52.930029 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2831d59-ba4b-4846-a68b-772d10408417 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:52.930529 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-a2831d59-ba4b-4846-a68b-772d10408417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:52.982526 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2831d59-ba4b-4846-a68b-772d10408417 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:53.113566 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273a9fc-3c3c-4396-a61a-3b89ebc01d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:53.113566 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273a9fc-3c3c-4396-a61a-3b89ebc01d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:53.113566 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273a9fc-3c3c-4396-a61a-3b89ebc01d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:53.113566 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273a9fc-3c3c-4396-a61a-3b89ebc01d46 admin admin] PATH_INFO: `/v3/users/df305cac75b740fa8cc0acc97f211821` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:53.122732 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273a9fc-3c3c-4396-a61a-3b89ebc01d46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df305cac75b740fa8cc0acc97f211821)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:53.125140 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273a9fc-3c3c-4396-a61a-3b89ebc01d46 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:53.132467 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:52:53.358238 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-d273a9fc-3c3c-4396-a61a-3b89ebc01d46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df305cac75b740fa8cc0acc97f211821'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:53.521575 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-d273a9fc-3c3c-4396-a61a-3b89ebc01d46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df305cac75b740fa8cc0acc97f211821'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:53.522470 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-d273a9fc-3c3c-4396-a61a-3b89ebc01d46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df305cac75b740fa8cc0acc97f211821'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:53.523740 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-d273a9fc-3c3c-4396-a61a-3b89ebc01d46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df305cac75b740fa8cc0acc97f211821'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:53.533787 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-d273a9fc-3c3c-4396-a61a-3b89ebc01d46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df305cac75b740fa8cc0acc97f211821'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:53.598445 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1078/2150] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:52:52 2022] DELETE /identity/v3/users/df305cac75b740fa8cc0acc97f211821 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:52:54.179105 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefbe9d4-a438-4c98-ab9b-dfaf023f0612 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:54.180658 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-fefbe9d4-a438-4c98-ab9b-dfaf023f0612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:54.215540 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefbe9d4-a438-4c98-ab9b-dfaf023f0612 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:54.457906 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fe321-7be8-49c6-8e0e-83eb048d7b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:54.458424 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fe321-7be8-49c6-8e0e-83eb048d7b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:54.460752 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fe321-7be8-49c6-8e0e-83eb048d7b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:54.460896 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fe321-7be8-49c6-8e0e-83eb048d7b8b admin admin] PATH_INFO: `/v3/projects/3de8e890d475434c91d2971d1740aba5` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:54.463276 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2fe321-7be8-49c6-8e0e-83eb048d7b8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3de8e890d475434c91d2971d1740aba5)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:54.472155 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2fe321-7be8-49c6-8e0e-83eb048d7b8b admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:54.647002 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-0b2fe321-7be8-49c6-8e0e-83eb048d7b8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3de8e890d475434c91d2971d1740aba5', 'request_id': 'req-0b2fe321-7be8-49c6-8e0e-83eb048d7b8b'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:54.653917 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:52:54.660021 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-0b2fe321-7be8-49c6-8e0e-83eb048d7b8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3de8e890d475434c91d2971d1740aba5', 'request_id': 'req-0b2fe321-7be8-49c6-8e0e-83eb048d7b8b'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:55.061069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-0b2fe321-7be8-49c6-8e0e-83eb048d7b8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3de8e890d475434c91d2971d1740aba5', 'request_id': 'req-0b2fe321-7be8-49c6-8e0e-83eb048d7b8b'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:55.079862 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-0b2fe321-7be8-49c6-8e0e-83eb048d7b8b admin admin] The token cache is being invalidate because project 3de8e890d475434c91d2971d1740aba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:52:55.080205 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-0b2fe321-7be8-49c6-8e0e-83eb048d7b8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:55.081342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-0b2fe321-7be8-49c6-8e0e-83eb048d7b8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:52:55.085222 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1073/2151] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:52:54 2022] DELETE /identity/v3/projects/3de8e890d475434c91d2971d1740aba5 => generated 0 bytes in 904 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:52:55.087596 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17512b-461e-4ee0-ba50-920f8aa639f9 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:55.088106 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17512b-461e-4ee0-ba50-920f8aa639f9 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:55.088190 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17512b-461e-4ee0-ba50-920f8aa639f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:55.117763 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-db17512b-461e-4ee0-ba50-920f8aa639f9 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:52:55.119722 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-db17512b-461e-4ee0-ba50-920f8aa639f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:55.231128 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997557ad-da38-492c-b14f-d5b67036f13c None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:55.232671 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1079/2152] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:52:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:52:55.232793 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997557ad-da38-492c-b14f-d5b67036f13c None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:55.232793 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997557ad-da38-492c-b14f-d5b67036f13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:55.263287 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-997557ad-da38-492c-b14f-d5b67036f13c None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:52:55.269578 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-997557ad-da38-492c-b14f-d5b67036f13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:55.290908 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1074/2153] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:52:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:52:55.295748 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17512b-461e-4ee0-ba50-920f8aa639f9 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:55.314734 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17512b-461e-4ee0-ba50-920f8aa639f9 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:55.330205 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371dd5c-7011-42fd-a2ad-0d6dd9ffa692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:55.334294 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371dd5c-7011-42fd-a2ad-0d6dd9ffa692 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:55.334294 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371dd5c-7011-42fd-a2ad-0d6dd9ffa692 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:55.334294 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371dd5c-7011-42fd-a2ad-0d6dd9ffa692 admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:55.334294 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371dd5c-7011-42fd-a2ad-0d6dd9ffa692 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:52:55.334294 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371dd5c-7011-42fd-a2ad-0d6dd9ffa692 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:55.334294 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371dd5c-7011-42fd-a2ad-0d6dd9ffa692 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:55.378412 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1080/2154] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:52:55.382850 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997557ad-da38-492c-b14f-d5b67036f13c None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:55.395754 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997557ad-da38-492c-b14f-d5b67036f13c None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:55.410012 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb70950-90e2-4e4a-89b5-d09d27ea1c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:55.410644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb70950-90e2-4e4a-89b5-d09d27ea1c57 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:55.410935 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb70950-90e2-4e4a-89b5-d09d27ea1c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:55.411211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb70950-90e2-4e4a-89b5-d09d27ea1c57 admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:55.411850 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb70950-90e2-4e4a-89b5-d09d27ea1c57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:55.415827 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb70950-90e2-4e4a-89b5-d09d27ea1c57 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:55.620958 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1075/2155] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:52:55 2022] POST /identity/v3/projects => generated 377 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:52:55.627624 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371dd5c-7011-42fd-a2ad-0d6dd9ffa692 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:55.643058 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371dd5c-7011-42fd-a2ad-0d6dd9ffa692 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:55.813737 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364e8e8-dac6-459a-af24-142f12607937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:55.814544 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364e8e8-dac6-459a-af24-142f12607937 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:55.815129 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364e8e8-dac6-459a-af24-142f12607937 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:55.815341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364e8e8-dac6-459a-af24-142f12607937 admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:55.821803 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e364e8e8-dac6-459a-af24-142f12607937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:55.824203 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e364e8e8-dac6-459a-af24-142f12607937 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:55.978521 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb70950-90e2-4e4a-89b5-d09d27ea1c57 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:55.979613 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1081/2156] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:52:55 2022] POST /identity/v3/users => generated 289 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:52:55.992917 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb70950-90e2-4e4a-89b5-d09d27ea1c57 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:56.006047 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c03fa-1250-47a6-84d9-062681cdeb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:56.006849 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c03fa-1250-47a6-84d9-062681cdeb9b admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:56.007237 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c03fa-1250-47a6-84d9-062681cdeb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:56.007617 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c03fa-1250-47a6-84d9-062681cdeb9b admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:56.008388 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c03fa-1250-47a6-84d9-062681cdeb9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:56.010127 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c03fa-1250-47a6-84d9-062681cdeb9b admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:56.046373 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1076/2157] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:52:56.050410 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364e8e8-dac6-459a-af24-142f12607937 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:56.056199 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:52:56.070917 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364e8e8-dac6-459a-af24-142f12607937 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:56.078290 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c722c0-4748-4b5b-aba4-265b0c5e44c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:56.079702 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c722c0-4748-4b5b-aba4-265b0c5e44c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:56.080166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c722c0-4748-4b5b-aba4-265b0c5e44c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:56.080554 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c722c0-4748-4b5b-aba4-265b0c5e44c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:56.081512 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c722c0-4748-4b5b-aba4-265b0c5e44c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:56.083362 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c722c0-4748-4b5b-aba4-265b0c5e44c1 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:56.127525 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c03fa-1250-47a6-84d9-062681cdeb9b admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:56.134648 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1082/2158] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:52:56.142746 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c03fa-1250-47a6-84d9-062681cdeb9b admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:56.148755 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d36d1b-2aa2-4bc2-9d8a-cd127a9d4aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:56.149666 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d36d1b-2aa2-4bc2-9d8a-cd127a9d4aad admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:56.149951 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d36d1b-2aa2-4bc2-9d8a-cd127a9d4aad admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:56.150225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d36d1b-2aa2-4bc2-9d8a-cd127a9d4aad admin admin] PATH_INFO: `/v3/projects/61d28508c8714f6ca224b3b0fab9a270/users/c23f6b803dc54145ad8a5d09546e7adf/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:56.181621 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d36d1b-2aa2-4bc2-9d8a-cd127a9d4aad admin admin] RBAC: Authorizing `identity:create_grant(project_id=61d28508c8714f6ca224b3b0fab9a270, user_id=c23f6b803dc54145ad8a5d09546e7adf, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:56.184301 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d36d1b-2aa2-4bc2-9d8a-cd127a9d4aad admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:56.370426 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1077/2159] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:52:56 2022] PUT /identity/v3/projects/61d28508c8714f6ca224b3b0fab9a270/users/c23f6b803dc54145ad8a5d09546e7adf/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:52:56.375036 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b13770-829b-4ffe-a10f-7d3ef94ac61d None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:56.375385 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b13770-829b-4ffe-a10f-7d3ef94ac61d None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:56.376482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b13770-829b-4ffe-a10f-7d3ef94ac61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:56.472073 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-35b13770-829b-4ffe-a10f-7d3ef94ac61d None None] MFA Rules not processed for user `c23f6b803dc54145ad8a5d09546e7adf`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:52:56.472073 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-35b13770-829b-4ffe-a10f-7d3ef94ac61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:56.507770 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1083/2160] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:52:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:52:56.512676 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d36d1b-2aa2-4bc2-9d8a-cd127a9d4aad admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:56.594106 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d36d1b-2aa2-4bc2-9d8a-cd127a9d4aad admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:56.600189 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5bd53e-6595-45a5-9b1c-aed778c17591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:56.601116 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5bd53e-6595-45a5-9b1c-aed778c17591 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:56.601928 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5bd53e-6595-45a5-9b1c-aed778c17591 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:56.602239 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5bd53e-6595-45a5-9b1c-aed778c17591 admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:56.602981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5bd53e-6595-45a5-9b1c-aed778c17591 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:56.605007 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5bd53e-6595-45a5-9b1c-aed778c17591 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:56.724503 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1078/2161] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:52:56 2022] POST /identity/v3/projects => generated 375 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:52:56.725614 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b13770-829b-4ffe-a10f-7d3ef94ac61d None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:56.737144 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b13770-829b-4ffe-a10f-7d3ef94ac61d None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:56.826473 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb617693-9249-42dd-a794-43b72b8b645d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:56.827775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb617693-9249-42dd-a794-43b72b8b645d admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:56.833537 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb617693-9249-42dd-a794-43b72b8b645d admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:56.833906 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb617693-9249-42dd-a794-43b72b8b645d admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:56.834702 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb617693-9249-42dd-a794-43b72b8b645d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:56.837391 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb617693-9249-42dd-a794-43b72b8b645d admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:56.941094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1084/2162] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:52:56 2022] POST /identity/v3/users => generated 288 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:52:56.941991 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5bd53e-6595-45a5-9b1c-aed778c17591 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:56.955988 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5bd53e-6595-45a5-9b1c-aed778c17591 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:56.962901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71aca5-8e9b-44c7-a813-d793fcf55e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:56.963938 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71aca5-8e9b-44c7-a813-d793fcf55e98 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:56.964604 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71aca5-8e9b-44c7-a813-d793fcf55e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:56.965169 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71aca5-8e9b-44c7-a813-d793fcf55e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:56.966353 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71aca5-8e9b-44c7-a813-d793fcf55e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:56.968307 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71aca5-8e9b-44c7-a813-d793fcf55e98 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:56.983526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1079/2163] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:52:56.988513 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb617693-9249-42dd-a794-43b72b8b645d admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:57.001491 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb617693-9249-42dd-a794-43b72b8b645d admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:57.007141 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b196f3-0c71-4b5e-9f23-b4100ca4f79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:57.007846 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b196f3-0c71-4b5e-9f23-b4100ca4f79f admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:57.008228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b196f3-0c71-4b5e-9f23-b4100ca4f79f admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:57.008653 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b196f3-0c71-4b5e-9f23-b4100ca4f79f admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:57.009290 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b196f3-0c71-4b5e-9f23-b4100ca4f79f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:57.011025 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b196f3-0c71-4b5e-9f23-b4100ca4f79f admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:57.023955 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1085/2164] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:52:57.040024 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71aca5-8e9b-44c7-a813-d793fcf55e98 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:57.054786 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71aca5-8e9b-44c7-a813-d793fcf55e98 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:57.060906 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0927dd-bb6d-43bc-beeb-67f42cd15151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:57.061952 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0927dd-bb6d-43bc-beeb-67f42cd15151 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:57.062531 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0927dd-bb6d-43bc-beeb-67f42cd15151 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:57.064450 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0927dd-bb6d-43bc-beeb-67f42cd15151 admin admin] PATH_INFO: `/v3/projects/8107f81f07c04ee9a363471d16cd4020/users/2260b196394f4ecda321ddcea9e5aec4/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:57.087833 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0927dd-bb6d-43bc-beeb-67f42cd15151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8107f81f07c04ee9a363471d16cd4020, user_id=2260b196394f4ecda321ddcea9e5aec4, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:57.091291 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0927dd-bb6d-43bc-beeb-67f42cd15151 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:57.211421 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1080/2165] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:52:57 2022] PUT /identity/v3/projects/8107f81f07c04ee9a363471d16cd4020/users/2260b196394f4ecda321ddcea9e5aec4/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:52:57.224202 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e852e-d0c7-4aec-9dce-5e079ae62bc5 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:57.224735 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e852e-d0c7-4aec-9dce-5e079ae62bc5 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:57.224837 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e852e-d0c7-4aec-9dce-5e079ae62bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:57.287526 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-ea5e852e-d0c7-4aec-9dce-5e079ae62bc5 None None] MFA Rules not processed for user `2260b196394f4ecda321ddcea9e5aec4`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:52:57.291569 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-ea5e852e-d0c7-4aec-9dce-5e079ae62bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:57.356916 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:52:57.385712 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1086/2166] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:52:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:52:57.387837 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0927dd-bb6d-43bc-beeb-67f42cd15151 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:57.402352 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:52:57.466823 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0927dd-bb6d-43bc-beeb-67f42cd15151 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:57.472250 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef1a75-e61c-4bf5-9275-f33a08b55f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:57.475937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef1a75-e61c-4bf5-9275-f33a08b55f61 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:57.475937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef1a75-e61c-4bf5-9275-f33a08b55f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:57.475937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef1a75-e61c-4bf5-9275-f33a08b55f61 admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:57.475937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef1a75-e61c-4bf5-9275-f33a08b55f61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:57.476275 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef1a75-e61c-4bf5-9275-f33a08b55f61 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:57.650270 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1081/2167] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:52:57 2022] POST /identity/v3/projects => generated 375 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:52:57.652145 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e852e-d0c7-4aec-9dce-5e079ae62bc5 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:57.667298 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e852e-d0c7-4aec-9dce-5e079ae62bc5 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:57.740515 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3506f-9eb3-4af9-ba1c-25478e2b5cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:57.741294 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3506f-9eb3-4af9-ba1c-25478e2b5cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:57.741661 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3506f-9eb3-4af9-ba1c-25478e2b5cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:57.742010 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3506f-9eb3-4af9-ba1c-25478e2b5cf4 admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:57.742571 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3506f-9eb3-4af9-ba1c-25478e2b5cf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:57.745085 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3506f-9eb3-4af9-ba1c-25478e2b5cf4 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:57.901384 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1087/2168] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:52:57 2022] POST /identity/v3/users => generated 294 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:52:57.903061 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef1a75-e61c-4bf5-9275-f33a08b55f61 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:57.919759 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef1a75-e61c-4bf5-9275-f33a08b55f61 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:57.925166 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9cc340-b405-4523-883a-5d7bd51f8ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:57.926455 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cc340-b405-4523-883a-5d7bd51f8ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:57.926455 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cc340-b405-4523-883a-5d7bd51f8ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:57.926455 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cc340-b405-4523-883a-5d7bd51f8ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:57.927074 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9cc340-b405-4523-883a-5d7bd51f8ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:57.928695 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9cc340-b405-4523-883a-5d7bd51f8ec1 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:57.968620 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1082/2169] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:52:57.973199 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3506f-9eb3-4af9-ba1c-25478e2b5cf4 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:57.984289 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3506f-9eb3-4af9-ba1c-25478e2b5cf4 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:57.989342 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4187061-7481-41b6-91e3-a0adc4066b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:57.990348 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4187061-7481-41b6-91e3-a0adc4066b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:57.990824 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4187061-7481-41b6-91e3-a0adc4066b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:57.991106 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4187061-7481-41b6-91e3-a0adc4066b13 admin admin] PATH_INFO: `/v3/projects/d54c0db030c44f269cf828d1b12f1265/users/57c8071b78264050a0254e57c1896619/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:58.012527 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4187061-7481-41b6-91e3-a0adc4066b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d54c0db030c44f269cf828d1b12f1265, user_id=57c8071b78264050a0254e57c1896619, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:58.018517 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4187061-7481-41b6-91e3-a0adc4066b13 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:58.134910 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1088/2170] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:52:57 2022] PUT /identity/v3/projects/d54c0db030c44f269cf828d1b12f1265/users/57c8071b78264050a0254e57c1896619/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:52:58.138567 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9cc340-b405-4523-883a-5d7bd51f8ec1 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:58.150500 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9cc340-b405-4523-883a-5d7bd51f8ec1 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:58.228353 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692f0c3-73f8-4e8f-87a3-dd8e35612106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:58.229073 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692f0c3-73f8-4e8f-87a3-dd8e35612106 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:58.229362 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692f0c3-73f8-4e8f-87a3-dd8e35612106 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:58.229639 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692f0c3-73f8-4e8f-87a3-dd8e35612106 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:58.230425 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692f0c3-73f8-4e8f-87a3-dd8e35612106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:58.232438 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692f0c3-73f8-4e8f-87a3-dd8e35612106 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:58.245986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1083/2171] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:52:58.251544 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4187061-7481-41b6-91e3-a0adc4066b13 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:58.267424 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4187061-7481-41b6-91e3-a0adc4066b13 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:58.273885 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995b667-1e90-4b1c-bdb4-d154e1962588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:58.274704 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995b667-1e90-4b1c-bdb4-d154e1962588 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:58.275058 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995b667-1e90-4b1c-bdb4-d154e1962588 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:58.275932 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995b667-1e90-4b1c-bdb4-d154e1962588 admin admin] PATH_INFO: `/v3/projects/d54c0db030c44f269cf828d1b12f1265/users/57c8071b78264050a0254e57c1896619/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:58.278203 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995b667-1e90-4b1c-bdb4-d154e1962588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d54c0db030c44f269cf828d1b12f1265, user_id=57c8071b78264050a0254e57c1896619, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:58.281877 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995b667-1e90-4b1c-bdb4-d154e1962588 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:58.304320 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1089/2172] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:52:58 2022] PUT /identity/v3/projects/d54c0db030c44f269cf828d1b12f1265/users/57c8071b78264050a0254e57c1896619/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:52:58.318684 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f8862-34d6-418d-8f3d-a81a9309f63d None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:58.319018 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f8862-34d6-418d-8f3d-a81a9309f63d None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:58.319297 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f8862-34d6-418d-8f3d-a81a9309f63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:58.354904 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-817f8862-34d6-418d-8f3d-a81a9309f63d None None] MFA Rules not processed for user `57c8071b78264050a0254e57c1896619`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:52:58.356406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-817f8862-34d6-418d-8f3d-a81a9309f63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:58.473221 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1084/2173] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:52:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:52:58.486102 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995b667-1e90-4b1c-bdb4-d154e1962588 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:58.487866 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-1995b667-1e90-4b1c-bdb4-d154e1962588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:58.582255 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995b667-1e90-4b1c-bdb4-d154e1962588 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:58.589878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454821d-17b2-43b2-ad77-c6e713af71c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:58.590485 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454821d-17b2-43b2-ad77-c6e713af71c6 service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:58.597083 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454821d-17b2-43b2-ad77-c6e713af71c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:58.597083 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454821d-17b2-43b2-ad77-c6e713af71c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:58.686013 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:52:58.693326 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d6420-1ee4-465e-83f5-adb0df5bc43d None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:58.693532 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d6420-1ee4-465e-83f5-adb0df5bc43d None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:58.694047 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d6420-1ee4-465e-83f5-adb0df5bc43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:58.694851 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454821d-17b2-43b2-ad77-c6e713af71c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:58.696332 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454821d-17b2-43b2-ad77-c6e713af71c6 service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:58.702410 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:52:58.713617 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1090/2174] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:52:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:52:58.717666 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-b72d6420-1ee4-465e-83f5-adb0df5bc43d None None] MFA Rules not processed for user `c880ab908c114c5897d11aad7fb48607`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:52:58.718925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-b72d6420-1ee4-465e-83f5-adb0df5bc43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:58.804907 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1085/2175] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Aug 8 17:52:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:52:58.819872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454821d-17b2-43b2-ad77-c6e713af71c6 service cinder] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:52:58.825452 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-7454821d-17b2-43b2-ad77-c6e713af71c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:52:58.929886 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454821d-17b2-43b2-ad77-c6e713af71c6 service cinder] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:52:58.935958 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32bf16-6086-4a93-ad10-e03fa7876a05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b83ff95ed44f35af2e412a700ca567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:52:58.936688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32bf16-6086-4a93-ad10-e03fa7876a05 service swift] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:52:58.936976 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32bf16-6086-4a93-ad10-e03fa7876a05 service swift] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:52:58.937280 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32bf16-6086-4a93-ad10-e03fa7876a05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:52:58.948123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32bf16-6086-4a93-ad10-e03fa7876a05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:52:58.949929 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32bf16-6086-4a93-ad10-e03fa7876a05 service swift] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:52:58.959940 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1091/2176] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Aug 8 17:52:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 17:53:02.693217 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d6420-1ee4-465e-83f5-adb0df5bc43d None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:02.695651 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-b72d6420-1ee4-465e-83f5-adb0df5bc43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:02.709373 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d6420-1ee4-465e-83f5-adb0df5bc43d None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:02.713606 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac4765-3c4a-4969-9786-1cd80ce69b5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:02.714530 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac4765-3c4a-4969-9786-1cd80ce69b5c service cinder] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:02.715046 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac4765-3c4a-4969-9786-1cd80ce69b5c service cinder] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:02.715418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac4765-3c4a-4969-9786-1cd80ce69b5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:02.785427 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac4765-3c4a-4969-9786-1cd80ce69b5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:02.787362 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac4765-3c4a-4969-9786-1cd80ce69b5c service cinder] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:02.799219 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1086/2177] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:53:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:53:04.723471 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32bf16-6086-4a93-ad10-e03fa7876a05 service swift] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:04.734631 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32bf16-6086-4a93-ad10-e03fa7876a05 service swift] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:04.740129 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d8cfd-7ea0-4d2b-a637-24943cbe689b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:04.742508 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d8cfd-7ea0-4d2b-a637-24943cbe689b service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:04.742508 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d8cfd-7ea0-4d2b-a637-24943cbe689b service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:04.742508 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d8cfd-7ea0-4d2b-a637-24943cbe689b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:04.752023 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d8cfd-7ea0-4d2b-a637-24943cbe689b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:04.753545 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d8cfd-7ea0-4d2b-a637-24943cbe689b service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:04.764905 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1092/2178] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:53:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:53:09.659651 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b393a27-d7c1-4a95-9971-84d6b9509bc5 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:09.662522 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b393a27-d7c1-4a95-9971-84d6b9509bc5 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:09.663012 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b393a27-d7c1-4a95-9971-84d6b9509bc5 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:09.669654 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1087/2179] 10.222.0.70 () {54 vars in 921 bytes} [Mon Aug 8 17:53:09 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:53:09.673100 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905efd55-fc87-44df-ba5f-de5d00e5dbf2 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:09.673639 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905efd55-fc87-44df-ba5f-de5d00e5dbf2 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:09.673916 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905efd55-fc87-44df-ba5f-de5d00e5dbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:09.716580 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-905efd55-fc87-44df-ba5f-de5d00e5dbf2 None None] MFA Rules not processed for user `3973b8fbfbb9475896e4e110ca8aa615`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:53:09.719042 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-905efd55-fc87-44df-ba5f-de5d00e5dbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:09.830678 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1093/2180] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Aug 8 17:53:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:53:10.752019 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b393a27-d7c1-4a95-9971-84d6b9509bc5 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:10.839792 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b393a27-d7c1-4a95-9971-84d6b9509bc5 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:10.848947 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae337b-0eef-4726-8051-b987529d99b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:10.848947 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae337b-0eef-4726-8051-b987529d99b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:10.848947 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae337b-0eef-4726-8051-b987529d99b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:10.848947 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae337b-0eef-4726-8051-b987529d99b9 admin admin] PATH_INFO: `/v3/users/c23f6b803dc54145ad8a5d09546e7adf` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:10.849357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae337b-0eef-4726-8051-b987529d99b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c23f6b803dc54145ad8a5d09546e7adf)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:10.850236 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae337b-0eef-4726-8051-b987529d99b9 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:11.159176 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-6aae337b-0eef-4726-8051-b987529d99b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c23f6b803dc54145ad8a5d09546e7adf'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:11.163074 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:53:11.273969 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-6aae337b-0eef-4726-8051-b987529d99b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c23f6b803dc54145ad8a5d09546e7adf'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:11.274852 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-6aae337b-0eef-4726-8051-b987529d99b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c23f6b803dc54145ad8a5d09546e7adf'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:11.275643 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-6aae337b-0eef-4726-8051-b987529d99b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c23f6b803dc54145ad8a5d09546e7adf'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:11.292914 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-6aae337b-0eef-4726-8051-b987529d99b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c23f6b803dc54145ad8a5d09546e7adf'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:11.333141 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1088/2181] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:53:10 2022] DELETE /identity/v3/users/c23f6b803dc54145ad8a5d09546e7adf => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:53:11.335451 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e92d09-26e9-4afb-b353-6f467adb8ec3 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:11.335950 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e92d09-26e9-4afb-b353-6f467adb8ec3 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:11.336044 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e92d09-26e9-4afb-b353-6f467adb8ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:11.370560 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-62e92d09-26e9-4afb-b353-6f467adb8ec3 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:53:11.372163 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-62e92d09-26e9-4afb-b353-6f467adb8ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:11.473194 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1094/2182] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:53:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:53:11.483596 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae337b-0eef-4726-8051-b987529d99b9 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:11.486497 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-6aae337b-0eef-4726-8051-b987529d99b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:11.571895 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae337b-0eef-4726-8051-b987529d99b9 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:11.577310 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b4ed6-5676-4214-aa6f-1ed96a3e2795 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:11.581534 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b4ed6-5676-4214-aa6f-1ed96a3e2795 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:11.581534 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b4ed6-5676-4214-aa6f-1ed96a3e2795 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:11.581534 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b4ed6-5676-4214-aa6f-1ed96a3e2795 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:11.603390 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b4ed6-5676-4214-aa6f-1ed96a3e2795 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:11.605161 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b4ed6-5676-4214-aa6f-1ed96a3e2795 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:11.630987 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1089/2183] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:53:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:53:12.167996 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e92d09-26e9-4afb-b353-6f467adb8ec3 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:12.167996 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-62e92d09-26e9-4afb-b353-6f467adb8ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:12.181067 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:53:12.192597 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e92d09-26e9-4afb-b353-6f467adb8ec3 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:12.199139 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4eb0da-5bed-494c-8292-0ef34bfce10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:12.200065 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4eb0da-5bed-494c-8292-0ef34bfce10c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:12.200445 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4eb0da-5bed-494c-8292-0ef34bfce10c admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:12.200934 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4eb0da-5bed-494c-8292-0ef34bfce10c admin admin] PATH_INFO: `/v3/projects/61d28508c8714f6ca224b3b0fab9a270` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:12.202358 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4eb0da-5bed-494c-8292-0ef34bfce10c admin admin] RBAC: Authorizing `identity:delete_project(project_id=61d28508c8714f6ca224b3b0fab9a270)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:12.205227 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4eb0da-5bed-494c-8292-0ef34bfce10c admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:12.348834 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-6c4eb0da-5bed-494c-8292-0ef34bfce10c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61d28508c8714f6ca224b3b0fab9a270', 'request_id': 'req-6c4eb0da-5bed-494c-8292-0ef34bfce10c'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:12.357903 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-6c4eb0da-5bed-494c-8292-0ef34bfce10c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61d28508c8714f6ca224b3b0fab9a270', 'request_id': 'req-6c4eb0da-5bed-494c-8292-0ef34bfce10c'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:12.474087 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-6c4eb0da-5bed-494c-8292-0ef34bfce10c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61d28508c8714f6ca224b3b0fab9a270', 'request_id': 'req-6c4eb0da-5bed-494c-8292-0ef34bfce10c'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:12.487782 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-6c4eb0da-5bed-494c-8292-0ef34bfce10c admin admin] The token cache is being invalidate because project 61d28508c8714f6ca224b3b0fab9a270 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:53:12.492105 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-6c4eb0da-5bed-494c-8292-0ef34bfce10c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:12.492105 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-6c4eb0da-5bed-494c-8292-0ef34bfce10c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:12.492105 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1095/2184] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:53:12 2022] DELETE /identity/v3/projects/61d28508c8714f6ca224b3b0fab9a270 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:53:12.496144 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b4ed6-5676-4214-aa6f-1ed96a3e2795 service neutron] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:12.507049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b4ed6-5676-4214-aa6f-1ed96a3e2795 service neutron] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:12.575953 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a13930-eb91-4cf4-9f1c-7cde1cfef1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:12.576897 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a13930-eb91-4cf4-9f1c-7cde1cfef1b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:12.577372 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a13930-eb91-4cf4-9f1c-7cde1cfef1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:12.577754 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a13930-eb91-4cf4-9f1c-7cde1cfef1b9 admin admin] PATH_INFO: `/v3/users/2260b196394f4ecda321ddcea9e5aec4` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:12.578930 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a13930-eb91-4cf4-9f1c-7cde1cfef1b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2260b196394f4ecda321ddcea9e5aec4)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:12.582331 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a13930-eb91-4cf4-9f1c-7cde1cfef1b9 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:12.786302 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-57a13930-eb91-4cf4-9f1c-7cde1cfef1b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2260b196394f4ecda321ddcea9e5aec4'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:12.885487 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-57a13930-eb91-4cf4-9f1c-7cde1cfef1b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2260b196394f4ecda321ddcea9e5aec4'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:12.886197 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-57a13930-eb91-4cf4-9f1c-7cde1cfef1b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2260b196394f4ecda321ddcea9e5aec4'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:12.886906 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-57a13930-eb91-4cf4-9f1c-7cde1cfef1b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2260b196394f4ecda321ddcea9e5aec4'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:12.895002 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-57a13930-eb91-4cf4-9f1c-7cde1cfef1b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2260b196394f4ecda321ddcea9e5aec4'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:12.903480 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:53:12.915679 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1090/2185] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:53:12 2022] DELETE /identity/v3/users/2260b196394f4ecda321ddcea9e5aec4 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:53:13.461938 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4eb0da-5bed-494c-8292-0ef34bfce10c admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:13.464112 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-6c4eb0da-5bed-494c-8292-0ef34bfce10c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:13.486802 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4eb0da-5bed-494c-8292-0ef34bfce10c admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:13.564635 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabca146-e861-4b51-a445-651a543b1b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:13.565536 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabca146-e861-4b51-a445-651a543b1b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:13.565882 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabca146-e861-4b51-a445-651a543b1b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:13.566229 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabca146-e861-4b51-a445-651a543b1b5f admin admin] PATH_INFO: `/v3/projects/8107f81f07c04ee9a363471d16cd4020` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:13.567640 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabca146-e861-4b51-a445-651a543b1b5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8107f81f07c04ee9a363471d16cd4020)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:13.569972 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabca146-e861-4b51-a445-651a543b1b5f admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:13.693409 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-eabca146-e861-4b51-a445-651a543b1b5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8107f81f07c04ee9a363471d16cd4020', 'request_id': 'req-eabca146-e861-4b51-a445-651a543b1b5f'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:13.701272 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-eabca146-e861-4b51-a445-651a543b1b5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8107f81f07c04ee9a363471d16cd4020', 'request_id': 'req-eabca146-e861-4b51-a445-651a543b1b5f'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:13.791821 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-eabca146-e861-4b51-a445-651a543b1b5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8107f81f07c04ee9a363471d16cd4020', 'request_id': 'req-eabca146-e861-4b51-a445-651a543b1b5f'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:13.815347 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-eabca146-e861-4b51-a445-651a543b1b5f admin admin] The token cache is being invalidate because project 8107f81f07c04ee9a363471d16cd4020 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:53:13.816099 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-eabca146-e861-4b51-a445-651a543b1b5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:13.817292 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-eabca146-e861-4b51-a445-651a543b1b5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:13.826098 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1096/2186] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:53:13 2022] DELETE /identity/v3/projects/8107f81f07c04ee9a363471d16cd4020 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:53:13.827204 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a13930-eb91-4cf4-9f1c-7cde1cfef1b9 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:13.828674 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-57a13930-eb91-4cf4-9f1c-7cde1cfef1b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:13.849303 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a13930-eb91-4cf4-9f1c-7cde1cfef1b9 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:13.936617 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc94a9-04b8-4830-8ad6-2717a465990d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:13.937991 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc94a9-04b8-4830-8ad6-2717a465990d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:13.938657 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc94a9-04b8-4830-8ad6-2717a465990d admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:13.939899 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc94a9-04b8-4830-8ad6-2717a465990d admin admin] PATH_INFO: `/v3/users/57c8071b78264050a0254e57c1896619` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:13.941742 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc94a9-04b8-4830-8ad6-2717a465990d admin admin] RBAC: Authorizing `identity:delete_user(user_id=57c8071b78264050a0254e57c1896619)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:13.944007 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc94a9-04b8-4830-8ad6-2717a465990d admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:14.117599 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-4fbc94a9-04b8-4830-8ad6-2717a465990d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57c8071b78264050a0254e57c1896619'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:14.191790 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-4fbc94a9-04b8-4830-8ad6-2717a465990d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57c8071b78264050a0254e57c1896619'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:14.192570 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-4fbc94a9-04b8-4830-8ad6-2717a465990d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57c8071b78264050a0254e57c1896619'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:14.193324 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-4fbc94a9-04b8-4830-8ad6-2717a465990d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57c8071b78264050a0254e57c1896619'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:14.201844 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-4fbc94a9-04b8-4830-8ad6-2717a465990d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57c8071b78264050a0254e57c1896619'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:14.224429 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1091/2187] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:53:13 2022] DELETE /identity/v3/users/57c8071b78264050a0254e57c1896619 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:53:14.858213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabca146-e861-4b51-a445-651a543b1b5f admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:14.858838 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-eabca146-e861-4b51-a445-651a543b1b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:14.893273 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabca146-e861-4b51-a445-651a543b1b5f admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:14.910463 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:53:14.960786 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6573689-b074-41e4-b034-76b18e670536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:14.961470 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6573689-b074-41e4-b034-76b18e670536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:14.961814 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6573689-b074-41e4-b034-76b18e670536 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:14.962030 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6573689-b074-41e4-b034-76b18e670536 admin admin] PATH_INFO: `/v3/projects/d54c0db030c44f269cf828d1b12f1265` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:14.963212 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6573689-b074-41e4-b034-76b18e670536 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d54c0db030c44f269cf828d1b12f1265)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:14.965401 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6573689-b074-41e4-b034-76b18e670536 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:15.143419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-f6573689-b074-41e4-b034-76b18e670536 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd54c0db030c44f269cf828d1b12f1265', 'request_id': 'req-f6573689-b074-41e4-b034-76b18e670536'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:15.151205 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-f6573689-b074-41e4-b034-76b18e670536 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd54c0db030c44f269cf828d1b12f1265', 'request_id': 'req-f6573689-b074-41e4-b034-76b18e670536'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:15.247560 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-f6573689-b074-41e4-b034-76b18e670536 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd54c0db030c44f269cf828d1b12f1265', 'request_id': 'req-f6573689-b074-41e4-b034-76b18e670536'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:15.261376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-f6573689-b074-41e4-b034-76b18e670536 admin admin] The token cache is being invalidate because project d54c0db030c44f269cf828d1b12f1265 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:53:15.261663 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-f6573689-b074-41e4-b034-76b18e670536 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:15.262380 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-f6573689-b074-41e4-b034-76b18e670536 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:15.263864 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1097/2188] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:53:14 2022] DELETE /identity/v3/projects/d54c0db030c44f269cf828d1b12f1265 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:53:15.269143 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4523ed3-941b-42c0-9621-7b6b26de1add None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:15.270281 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4523ed3-941b-42c0-9621-7b6b26de1add None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:15.270281 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4523ed3-941b-42c0-9621-7b6b26de1add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:15.294065 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-d4523ed3-941b-42c0-9621-7b6b26de1add None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:53:15.295620 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-d4523ed3-941b-42c0-9621-7b6b26de1add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:15.358142 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1092/2189] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:53:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:53:15.372151 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e085a7-3062-4c1b-af19-3bc2a5baf1eb None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:15.372551 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e085a7-3062-4c1b-af19-3bc2a5baf1eb None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:15.372949 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e085a7-3062-4c1b-af19-3bc2a5baf1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:15.440497 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-71e085a7-3062-4c1b-af19-3bc2a5baf1eb None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:53:15.442118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-71e085a7-3062-4c1b-af19-3bc2a5baf1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:15.489251 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1098/2190] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:53:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:53:15.506184 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4523ed3-941b-42c0-9621-7b6b26de1add None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:15.556919 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4523ed3-941b-42c0-9621-7b6b26de1add None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:15.589452 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d1309-7077-4cb1-adea-dc060d3b88ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:15.589452 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d1309-7077-4cb1-adea-dc060d3b88ad admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:15.589452 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d1309-7077-4cb1-adea-dc060d3b88ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:15.589452 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d1309-7077-4cb1-adea-dc060d3b88ad admin admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:15.589852 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d1309-7077-4cb1-adea-dc060d3b88ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:53:15.589852 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d1309-7077-4cb1-adea-dc060d3b88ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:15.589852 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d1309-7077-4cb1-adea-dc060d3b88ad admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:15.589852 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:53:15.606846 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1093/2191] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:53:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:53:15.615352 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e085a7-3062-4c1b-af19-3bc2a5baf1eb None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:15.626485 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e085a7-3062-4c1b-af19-3bc2a5baf1eb None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:15.637265 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23d104-adbf-4460-818c-3a13a6dbfa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:15.638055 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23d104-adbf-4460-818c-3a13a6dbfa1a admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:15.638635 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23d104-adbf-4460-818c-3a13a6dbfa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:15.639136 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23d104-adbf-4460-818c-3a13a6dbfa1a admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:15.640006 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23d104-adbf-4460-818c-3a13a6dbfa1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:15.655534 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23d104-adbf-4460-818c-3a13a6dbfa1a admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:15.749271 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1099/2192] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:53:15 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:53:15.751391 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d1309-7077-4cb1-adea-dc060d3b88ad admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:15.765461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d1309-7077-4cb1-adea-dc060d3b88ad admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:15.850619 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb2b73-4c0f-40ca-b585-39e68dd0fb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:15.851237 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb2b73-4c0f-40ca-b585-39e68dd0fb50 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:15.851518 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb2b73-4c0f-40ca-b585-39e68dd0fb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:15.851790 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb2b73-4c0f-40ca-b585-39e68dd0fb50 admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:15.852434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb2b73-4c0f-40ca-b585-39e68dd0fb50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:15.854975 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb2b73-4c0f-40ca-b585-39e68dd0fb50 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:16.001827 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1094/2193] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:53:15 2022] POST /identity/v3/users => generated 292 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:53:16.005968 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23d104-adbf-4460-818c-3a13a6dbfa1a admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:16.024012 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23d104-adbf-4460-818c-3a13a6dbfa1a admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:16.033415 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aafd4e9-7e0f-43bf-bde9-d9c1041ca2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:16.034564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafd4e9-7e0f-43bf-bde9-d9c1041ca2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:16.034564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafd4e9-7e0f-43bf-bde9-d9c1041ca2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:16.034768 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafd4e9-7e0f-43bf-bde9-d9c1041ca2f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:16.035490 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aafd4e9-7e0f-43bf-bde9-d9c1041ca2f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:16.037231 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aafd4e9-7e0f-43bf-bde9-d9c1041ca2f0 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:16.054074 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1100/2194] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:53:16.058567 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb2b73-4c0f-40ca-b585-39e68dd0fb50 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:16.072587 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb2b73-4c0f-40ca-b585-39e68dd0fb50 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:16.082710 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335224d-7579-495e-977b-0ef66b9b3e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:16.083337 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335224d-7579-495e-977b-0ef66b9b3e24 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:16.083623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335224d-7579-495e-977b-0ef66b9b3e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:16.083895 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335224d-7579-495e-977b-0ef66b9b3e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:16.084548 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335224d-7579-495e-977b-0ef66b9b3e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:16.086181 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335224d-7579-495e-977b-0ef66b9b3e24 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:16.102127 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1095/2195] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:53:16.103694 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aafd4e9-7e0f-43bf-bde9-d9c1041ca2f0 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:16.115881 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aafd4e9-7e0f-43bf-bde9-d9c1041ca2f0 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:16.121473 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a956c-750a-4b5b-88dd-00e7a941c6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:16.132524 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a956c-750a-4b5b-88dd-00e7a941c6a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:16.132524 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a956c-750a-4b5b-88dd-00e7a941c6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:16.132524 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a956c-750a-4b5b-88dd-00e7a941c6a4 admin admin] PATH_INFO: `/v3/projects/aa11ef86b4e54a22b06ea6845c7403d9/users/ec0d1c80df5b47d6956327ba223aa0df/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:16.140126 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a956c-750a-4b5b-88dd-00e7a941c6a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa11ef86b4e54a22b06ea6845c7403d9, user_id=ec0d1c80df5b47d6956327ba223aa0df, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:16.144513 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a956c-750a-4b5b-88dd-00e7a941c6a4 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:16.235334 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1101/2196] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:53:16 2022] PUT /identity/v3/projects/aa11ef86b4e54a22b06ea6845c7403d9/users/ec0d1c80df5b47d6956327ba223aa0df/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:53:16.247503 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249705c-2033-4cd2-8b12-cc12e386a86e None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:16.247850 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249705c-2033-4cd2-8b12-cc12e386a86e None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:16.248276 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249705c-2033-4cd2-8b12-cc12e386a86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:16.282406 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-5249705c-2033-4cd2-8b12-cc12e386a86e None None] MFA Rules not processed for user `ec0d1c80df5b47d6956327ba223aa0df`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:53:16.284694 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-5249705c-2033-4cd2-8b12-cc12e386a86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:16.369791 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1096/2197] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:53:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:53:16.378087 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a956c-750a-4b5b-88dd-00e7a941c6a4 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:16.379815 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-ce3a956c-750a-4b5b-88dd-00e7a941c6a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:16.445481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:53:16.462551 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a956c-750a-4b5b-88dd-00e7a941c6a4 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:16.478647 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51d6e1-d54c-4a6c-a744-8c49914f79e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:16.480896 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51d6e1-d54c-4a6c-a744-8c49914f79e5 service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:16.481617 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51d6e1-d54c-4a6c-a744-8c49914f79e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:16.482054 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51d6e1-d54c-4a6c-a744-8c49914f79e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:16.492944 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d51d6e1-d54c-4a6c-a744-8c49914f79e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:16.499589 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d51d6e1-d54c-4a6c-a744-8c49914f79e5 service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:16.508915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1102/2198] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:53:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:53:17.863795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249705c-2033-4cd2-8b12-cc12e386a86e None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:17.865658 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-5249705c-2033-4cd2-8b12-cc12e386a86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:17.928771 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249705c-2033-4cd2-8b12-cc12e386a86e None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:17.932237 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459f432-c81e-4656-8b38-64f8c7e7e224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:17.932880 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459f432-c81e-4656-8b38-64f8c7e7e224 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:17.933193 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459f432-c81e-4656-8b38-64f8c7e7e224 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:17.933470 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459f432-c81e-4656-8b38-64f8c7e7e224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:17.935224 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-2459f432-c81e-4656-8b38-64f8c7e7e224 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:17.953097 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:53:18.008630 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459f432-c81e-4656-8b38-64f8c7e7e224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:18.010080 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459f432-c81e-4656-8b38-64f8c7e7e224 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:18.020769 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1097/2199] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:53:17 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:53:20.149678 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51d6e1-d54c-4a6c-a744-8c49914f79e5 service cinder] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:20.223706 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51d6e1-d54c-4a6c-a744-8c49914f79e5 service cinder] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:20.228956 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b41f36-1366-4e2a-bdee-bcf7654951b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:20.229622 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b41f36-1366-4e2a-bdee-bcf7654951b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:20.229898 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b41f36-1366-4e2a-bdee-bcf7654951b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:20.230214 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b41f36-1366-4e2a-bdee-bcf7654951b5 admin admin] PATH_INFO: `/v3/users/ec0d1c80df5b47d6956327ba223aa0df` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:20.231456 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b41f36-1366-4e2a-bdee-bcf7654951b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec0d1c80df5b47d6956327ba223aa0df)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:20.233426 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b41f36-1366-4e2a-bdee-bcf7654951b5 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:20.459158 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-15b41f36-1366-4e2a-bdee-bcf7654951b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec0d1c80df5b47d6956327ba223aa0df'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:20.544368 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-15b41f36-1366-4e2a-bdee-bcf7654951b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec0d1c80df5b47d6956327ba223aa0df'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:20.545121 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-15b41f36-1366-4e2a-bdee-bcf7654951b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec0d1c80df5b47d6956327ba223aa0df'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:20.546317 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-15b41f36-1366-4e2a-bdee-bcf7654951b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec0d1c80df5b47d6956327ba223aa0df'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:20.562410 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-15b41f36-1366-4e2a-bdee-bcf7654951b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec0d1c80df5b47d6956327ba223aa0df'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:20.608559 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1103/2200] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:53:20 2022] DELETE /identity/v3/users/ec0d1c80df5b47d6956327ba223aa0df => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:53:20.610412 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664a119-e292-4455-87d3-260a6666e33c None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:20.611563 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664a119-e292-4455-87d3-260a6666e33c None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:20.612070 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664a119-e292-4455-87d3-260a6666e33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:20.651988 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-2664a119-e292-4455-87d3-260a6666e33c None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:53:20.655219 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-2664a119-e292-4455-87d3-260a6666e33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:20.788530 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1098/2201] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:53:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:53:20.800177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b41f36-1366-4e2a-bdee-bcf7654951b5 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:20.807699 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-15b41f36-1366-4e2a-bdee-bcf7654951b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:20.974690 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b41f36-1366-4e2a-bdee-bcf7654951b5 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:20.979576 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f772561-2e11-4042-bad7-230b6abec175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:20.980418 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f772561-2e11-4042-bad7-230b6abec175 service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:20.980914 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f772561-2e11-4042-bad7-230b6abec175 service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:20.981424 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f772561-2e11-4042-bad7-230b6abec175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:20.993809 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f772561-2e11-4042-bad7-230b6abec175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:20.995668 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f772561-2e11-4042-bad7-230b6abec175 service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:21.009881 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1104/2202] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:53:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:53:22.102098 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664a119-e292-4455-87d3-260a6666e33c None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:22.105468 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-2664a119-e292-4455-87d3-260a6666e33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:22.133207 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664a119-e292-4455-87d3-260a6666e33c None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:22.145782 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49def42-ae04-46ff-9e7d-5ad9e97390ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:22.146581 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49def42-ae04-46ff-9e7d-5ad9e97390ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:22.146901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49def42-ae04-46ff-9e7d-5ad9e97390ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:22.147393 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49def42-ae04-46ff-9e7d-5ad9e97390ce admin admin] PATH_INFO: `/v3/projects/aa11ef86b4e54a22b06ea6845c7403d9` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:22.148928 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49def42-ae04-46ff-9e7d-5ad9e97390ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa11ef86b4e54a22b06ea6845c7403d9)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:22.151695 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49def42-ae04-46ff-9e7d-5ad9e97390ce admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:22.335548 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-d49def42-ae04-46ff-9e7d-5ad9e97390ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa11ef86b4e54a22b06ea6845c7403d9', 'request_id': 'req-d49def42-ae04-46ff-9e7d-5ad9e97390ce'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:22.348934 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-d49def42-ae04-46ff-9e7d-5ad9e97390ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa11ef86b4e54a22b06ea6845c7403d9', 'request_id': 'req-d49def42-ae04-46ff-9e7d-5ad9e97390ce'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:22.454953 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-d49def42-ae04-46ff-9e7d-5ad9e97390ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa11ef86b4e54a22b06ea6845c7403d9', 'request_id': 'req-d49def42-ae04-46ff-9e7d-5ad9e97390ce'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:22.468101 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-d49def42-ae04-46ff-9e7d-5ad9e97390ce admin admin] The token cache is being invalidate because project aa11ef86b4e54a22b06ea6845c7403d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:53:22.468778 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-d49def42-ae04-46ff-9e7d-5ad9e97390ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:22.469693 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-d49def42-ae04-46ff-9e7d-5ad9e97390ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:22.476624 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d6bd4-f03a-4702-ae39-038d4eb09cd5 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:22.477595 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d6bd4-f03a-4702-ae39-038d4eb09cd5 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:22.478347 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d6bd4-f03a-4702-ae39-038d4eb09cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:22.481796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1099/2203] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:53:22 2022] DELETE /identity/v3/projects/aa11ef86b4e54a22b06ea6845c7403d9 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:53:22.516173 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-068d6bd4-f03a-4702-ae39-038d4eb09cd5 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:53:22.520451 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-068d6bd4-f03a-4702-ae39-038d4eb09cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:22.531043 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:53:22.657787 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1105/2204] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:53:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:53:22.659660 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b64c2-7e24-40e9-8f4c-64f4702de69b None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:22.659917 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b64c2-7e24-40e9-8f4c-64f4702de69b None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:22.660418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b64c2-7e24-40e9-8f4c-64f4702de69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:22.702270 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-0a9b64c2-7e24-40e9-8f4c-64f4702de69b None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:53:22.703501 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-0a9b64c2-7e24-40e9-8f4c-64f4702de69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:22.713050 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1100/2205] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:53:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:53:22.717152 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d6bd4-f03a-4702-ae39-038d4eb09cd5 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:22.731066 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d6bd4-f03a-4702-ae39-038d4eb09cd5 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:22.738463 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938c347-7c8c-4c4c-b6f2-3ecd05325f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:22.741489 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938c347-7c8c-4c4c-b6f2-3ecd05325f57 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:22.742585 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938c347-7c8c-4c4c-b6f2-3ecd05325f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:22.743102 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938c347-7c8c-4c4c-b6f2-3ecd05325f57 admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:22.744059 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938c347-7c8c-4c4c-b6f2-3ecd05325f57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:53:22.744727 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938c347-7c8c-4c4c-b6f2-3ecd05325f57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:22.746552 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938c347-7c8c-4c4c-b6f2-3ecd05325f57 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:22.766394 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1106/2206] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:53:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:53:22.768152 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b64c2-7e24-40e9-8f4c-64f4702de69b None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:22.778313 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b64c2-7e24-40e9-8f4c-64f4702de69b None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:22.784444 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15819674-ee6c-4faa-9a09-7d7316b8a860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:22.785104 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15819674-ee6c-4faa-9a09-7d7316b8a860 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:22.785388 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15819674-ee6c-4faa-9a09-7d7316b8a860 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:22.785664 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15819674-ee6c-4faa-9a09-7d7316b8a860 admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:22.786588 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15819674-ee6c-4faa-9a09-7d7316b8a860 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:22.788312 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15819674-ee6c-4faa-9a09-7d7316b8a860 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:23.018217 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1101/2207] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:53:22 2022] POST /identity/v3/projects => generated 391 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:53:23.022501 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938c347-7c8c-4c4c-b6f2-3ecd05325f57 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:23.033177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938c347-7c8c-4c4c-b6f2-3ecd05325f57 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:23.132346 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e676c8-2662-4a6f-9767-f5b3f3c24fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:23.132976 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e676c8-2662-4a6f-9767-f5b3f3c24fba admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:23.133682 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e676c8-2662-4a6f-9767-f5b3f3c24fba admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:23.133682 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e676c8-2662-4a6f-9767-f5b3f3c24fba admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:23.134260 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e676c8-2662-4a6f-9767-f5b3f3c24fba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:23.136323 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e676c8-2662-4a6f-9767-f5b3f3c24fba admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:23.262754 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1107/2208] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:53:23 2022] POST /identity/v3/users => generated 296 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:53:23.267014 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15819674-ee6c-4faa-9a09-7d7316b8a860 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:23.278391 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15819674-ee6c-4faa-9a09-7d7316b8a860 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:23.283726 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581dfd62-8d4b-4318-b2d0-6eb7b8d07e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:23.284340 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581dfd62-8d4b-4318-b2d0-6eb7b8d07e7a admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:23.284624 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581dfd62-8d4b-4318-b2d0-6eb7b8d07e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:23.284901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581dfd62-8d4b-4318-b2d0-6eb7b8d07e7a admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:23.285588 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581dfd62-8d4b-4318-b2d0-6eb7b8d07e7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:23.287313 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581dfd62-8d4b-4318-b2d0-6eb7b8d07e7a admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:23.289696 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:53:23.299402 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1102/2209] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:53:23.303524 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e676c8-2662-4a6f-9767-f5b3f3c24fba admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:23.314873 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e676c8-2662-4a6f-9767-f5b3f3c24fba admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:23.322627 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c849c-d6fa-424a-a359-c701f035fd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:23.323251 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c849c-d6fa-424a-a359-c701f035fd77 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:23.323534 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c849c-d6fa-424a-a359-c701f035fd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:23.323808 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c849c-d6fa-424a-a359-c701f035fd77 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:23.324561 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4c849c-d6fa-424a-a359-c701f035fd77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:23.327233 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4c849c-d6fa-424a-a359-c701f035fd77 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:23.338769 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1108/2210] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:53:23.343343 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581dfd62-8d4b-4318-b2d0-6eb7b8d07e7a admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:23.358228 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581dfd62-8d4b-4318-b2d0-6eb7b8d07e7a admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:23.363570 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b057f4-21dc-436b-80f6-d27319cea2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:23.364225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b057f4-21dc-436b-80f6-d27319cea2a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:23.364508 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b057f4-21dc-436b-80f6-d27319cea2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:23.364808 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b057f4-21dc-436b-80f6-d27319cea2a2 admin admin] PATH_INFO: `/v3/projects/9abc03229fd84a60a6a3c892775fcc39/users/15c409b22d5f42afbde8d5dab8e01a0f/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:23.379428 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b057f4-21dc-436b-80f6-d27319cea2a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9abc03229fd84a60a6a3c892775fcc39, user_id=15c409b22d5f42afbde8d5dab8e01a0f, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:23.382123 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b057f4-21dc-436b-80f6-d27319cea2a2 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:23.515625 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c849c-d6fa-424a-a359-c701f035fd77 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:23.517477 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-dd4c849c-d6fa-424a-a359-c701f035fd77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:23.537209 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1103/2211] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:53:23 2022] PUT /identity/v3/projects/9abc03229fd84a60a6a3c892775fcc39/users/15c409b22d5f42afbde8d5dab8e01a0f/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:53:23.550605 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988a5b4-127f-4cae-94a0-df72b8d1fd00 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:23.550897 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988a5b4-127f-4cae-94a0-df72b8d1fd00 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:23.551176 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988a5b4-127f-4cae-94a0-df72b8d1fd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:23.612100 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-7988a5b4-127f-4cae-94a0-df72b8d1fd00 None None] MFA Rules not processed for user `15c409b22d5f42afbde8d5dab8e01a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:53:23.613638 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-7988a5b4-127f-4cae-94a0-df72b8d1fd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:23.617101 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c849c-d6fa-424a-a359-c701f035fd77 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:23.669317 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d6579-c603-4f33-8dce-653c98364997 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fab95367403451b921099425345b3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:23.669925 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d6579-c603-4f33-8dce-653c98364997 service glance] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:23.670207 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d6579-c603-4f33-8dce-653c98364997 service glance] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:23.670508 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d6579-c603-4f33-8dce-653c98364997 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:23.672517 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-c91d6579-c603-4f33-8dce-653c98364997 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:23.681344 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1104/2212] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:53:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:53:23.703566 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988a5b4-127f-4cae-94a0-df72b8d1fd00 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:23.712868 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-7988a5b4-127f-4cae-94a0-df72b8d1fd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:23.758832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d6579-c603-4f33-8dce-653c98364997 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:23.760714 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d6579-c603-4f33-8dce-653c98364997 service glance] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:23.781078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1109/2213] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:53:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:53:23.790809 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988a5b4-127f-4cae-94a0-df72b8d1fd00 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:23.794974 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865a45b-93c6-41a9-b1ea-31350410d66a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:23.795686 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865a45b-93c6-41a9-b1ea-31350410d66a service cinder] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:23.795975 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865a45b-93c6-41a9-b1ea-31350410d66a service cinder] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:23.796250 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865a45b-93c6-41a9-b1ea-31350410d66a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:23.807792 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865a45b-93c6-41a9-b1ea-31350410d66a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:23.809130 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865a45b-93c6-41a9-b1ea-31350410d66a service cinder] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:23.819987 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1105/2214] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:53:23 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:53:24.092400 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03679e-6ce4-4d05-8167-ce59a4181c43 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:24.092661 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03679e-6ce4-4d05-8167-ce59a4181c43 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:24.092999 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03679e-6ce4-4d05-8167-ce59a4181c43 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:24.094405 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1110/2215] 10.222.0.70 () {54 vars in 921 bytes} [Mon Aug 8 17:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:53:24.103082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ac415-52bf-40a8-abd2-6f2294e28ddc None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:24.103371 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ac415-52bf-40a8-abd2-6f2294e28ddc None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:24.103648 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ac415-52bf-40a8-abd2-6f2294e28ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:24.129856 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-7c5ac415-52bf-40a8-abd2-6f2294e28ddc None None] MFA Rules not processed for user `bdb6f0f0cde24b05a34b78d48dc45c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:53:24.131258 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-7c5ac415-52bf-40a8-abd2-6f2294e28ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:24.186060 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1106/2216] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Aug 8 17:53:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:53:24.202079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03679e-6ce4-4d05-8167-ce59a4181c43 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:24.204616 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-2e03679e-6ce4-4d05-8167-ce59a4181c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:24.218454 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03679e-6ce4-4d05-8167-ce59a4181c43 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:24.222257 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690d2f4-e4d3-4a71-b963-94262c9a72b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:24.222857 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690d2f4-e4d3-4a71-b963-94262c9a72b0 service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:24.223138 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690d2f4-e4d3-4a71-b963-94262c9a72b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:24.223413 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690d2f4-e4d3-4a71-b963-94262c9a72b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:24.231149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690d2f4-e4d3-4a71-b963-94262c9a72b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:24.232583 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690d2f4-e4d3-4a71-b963-94262c9a72b0 service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:24.240979 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1111/2217] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:53:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:53:24.345018 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71974fe-71a2-4239-8eb6-e933ea86e778 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:24.345508 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71974fe-71a2-4239-8eb6-e933ea86e778 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:24.345634 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71974fe-71a2-4239-8eb6-e933ea86e778 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:24.347220 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1107/2218] 10.222.0.70 () {54 vars in 921 bytes} [Mon Aug 8 17:53:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:53:24.351494 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:53:24.358757 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87538c-ee67-4be6-b7e6-e654fa1e4886 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:24.359041 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87538c-ee67-4be6-b7e6-e654fa1e4886 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:24.364462 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87538c-ee67-4be6-b7e6-e654fa1e4886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:24.382184 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-8e87538c-ee67-4be6-b7e6-e654fa1e4886 None None] MFA Rules not processed for user `3973b8fbfbb9475896e4e110ca8aa615`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:53:24.383396 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-8e87538c-ee67-4be6-b7e6-e654fa1e4886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:24.393605 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1112/2219] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Aug 8 17:53:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:53:24.405483 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71974fe-71a2-4239-8eb6-e933ea86e778 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:24.416999 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71974fe-71a2-4239-8eb6-e933ea86e778 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:24.421312 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe4198-7dc0-4282-bbce-65500020c724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:24.421917 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe4198-7dc0-4282-bbce-65500020c724 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:24.422277 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe4198-7dc0-4282-bbce-65500020c724 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:24.422587 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe4198-7dc0-4282-bbce-65500020c724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:24.434302 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe4198-7dc0-4282-bbce-65500020c724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:24.435726 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe4198-7dc0-4282-bbce-65500020c724 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:24.446856 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1108/2220] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:53:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:53:24.740702 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34801146-a4f8-4c53-b754-72917d471056 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:24.741153 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34801146-a4f8-4c53-b754-72917d471056 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:24.741478 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34801146-a4f8-4c53-b754-72917d471056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:24.766465 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-34801146-a4f8-4c53-b754-72917d471056 None None] MFA Rules not processed for user `c880ab908c114c5897d11aad7fb48607`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:53:24.767873 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-34801146-a4f8-4c53-b754-72917d471056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:24.831164 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1113/2221] 10.222.0.70 () {58 vars in 967 bytes} [Mon Aug 8 17:53:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:53:24.846749 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe4198-7dc0-4282-bbce-65500020c724 service neutron] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:24.848776 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-b9fe4198-7dc0-4282-bbce-65500020c724 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:24.854736 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:53:24.923568 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe4198-7dc0-4282-bbce-65500020c724 service neutron] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:24.931244 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d78d6-8853-4d22-ad7c-460fa0059040 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b83ff95ed44f35af2e412a700ca567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:24.931880 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d78d6-8853-4d22-ad7c-460fa0059040 service swift] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:24.932164 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d78d6-8853-4d22-ad7c-460fa0059040 service swift] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:24.932881 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d78d6-8853-4d22-ad7c-460fa0059040 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:24.946682 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d78d6-8853-4d22-ad7c-460fa0059040 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:24.946682 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d78d6-8853-4d22-ad7c-460fa0059040 service swift] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:24.959499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1109/2222] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Aug 8 17:53:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 17:53:28.777104 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34801146-a4f8-4c53-b754-72917d471056 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:28.778610 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-34801146-a4f8-4c53-b754-72917d471056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:28.849407 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:53:28.854785 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34801146-a4f8-4c53-b754-72917d471056 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:28.860400 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165ae4c-4053-4992-aaeb-43067873007d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:28.861282 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165ae4c-4053-4992-aaeb-43067873007d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:28.861566 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165ae4c-4053-4992-aaeb-43067873007d admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:28.862481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165ae4c-4053-4992-aaeb-43067873007d admin admin] PATH_INFO: `/v3/users/80a62354f9e743cc8e01afd1765eb1f7` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:28.863793 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165ae4c-4053-4992-aaeb-43067873007d admin admin] RBAC: Authorizing `identity:delete_user(user_id=80a62354f9e743cc8e01afd1765eb1f7)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:28.865809 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165ae4c-4053-4992-aaeb-43067873007d admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:28.942147 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb072d-7841-4329-8c30-1c4733aab884 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:28.946703 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb072d-7841-4329-8c30-1c4733aab884 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:28.946703 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb072d-7841-4329-8c30-1c4733aab884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:28.965179 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-bdfb072d-7841-4329-8c30-1c4733aab884 None None] MFA Rules not processed for user `c880ab908c114c5897d11aad7fb48607`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:53:28.966542 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-bdfb072d-7841-4329-8c30-1c4733aab884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:28.974876 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1110/2223] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Aug 8 17:53:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:53:28.992544 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb072d-7841-4329-8c30-1c4733aab884 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:29.002251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb072d-7841-4329-8c30-1c4733aab884 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:29.007236 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b099407d-378e-41a7-8ece-cdb0cc504633 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b83ff95ed44f35af2e412a700ca567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:29.007818 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099407d-378e-41a7-8ece-cdb0cc504633 service swift] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:29.008093 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099407d-378e-41a7-8ece-cdb0cc504633 service swift] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:29.008364 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099407d-378e-41a7-8ece-cdb0cc504633 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:29.016830 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b099407d-378e-41a7-8ece-cdb0cc504633 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:29.018454 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b099407d-378e-41a7-8ece-cdb0cc504633 service swift] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:29.027106 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1111/2224] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Aug 8 17:53:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 08 17:53:29.155447 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-6165ae4c-4053-4992-aaeb-43067873007d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80a62354f9e743cc8e01afd1765eb1f7'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:29.304615 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-6165ae4c-4053-4992-aaeb-43067873007d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80a62354f9e743cc8e01afd1765eb1f7'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:29.305530 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-6165ae4c-4053-4992-aaeb-43067873007d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80a62354f9e743cc8e01afd1765eb1f7'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:29.306325 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-6165ae4c-4053-4992-aaeb-43067873007d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80a62354f9e743cc8e01afd1765eb1f7'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:29.319189 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-6165ae4c-4053-4992-aaeb-43067873007d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80a62354f9e743cc8e01afd1765eb1f7'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:29.362513 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1114/2225] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:53:28 2022] DELETE /identity/v3/users/80a62354f9e743cc8e01afd1765eb1f7 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:53:29.727287 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b099407d-378e-41a7-8ece-cdb0cc504633 service swift] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:29.750932 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b099407d-378e-41a7-8ece-cdb0cc504633 service swift] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:29.839194 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e465f-1c46-4ee5-befa-cab2040df3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:29.840501 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e465f-1c46-4ee5-befa-cab2040df3d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:29.840809 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e465f-1c46-4ee5-befa-cab2040df3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:29.841122 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e465f-1c46-4ee5-befa-cab2040df3d2 admin admin] PATH_INFO: `/v3/projects/44c2d0513ff54cd4864df48a3e05b505` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:29.842332 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e465f-1c46-4ee5-befa-cab2040df3d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44c2d0513ff54cd4864df48a3e05b505)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:29.844920 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e465f-1c46-4ee5-befa-cab2040df3d2 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:29.983781 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e28e465f-1c46-4ee5-befa-cab2040df3d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44c2d0513ff54cd4864df48a3e05b505', 'request_id': 'req-e28e465f-1c46-4ee5-befa-cab2040df3d2'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:29.990922 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e28e465f-1c46-4ee5-befa-cab2040df3d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44c2d0513ff54cd4864df48a3e05b505', 'request_id': 'req-e28e465f-1c46-4ee5-befa-cab2040df3d2'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:30.089745 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e28e465f-1c46-4ee5-befa-cab2040df3d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44c2d0513ff54cd4864df48a3e05b505', 'request_id': 'req-e28e465f-1c46-4ee5-befa-cab2040df3d2'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:30.102668 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e28e465f-1c46-4ee5-befa-cab2040df3d2 admin admin] The token cache is being invalidate because project 44c2d0513ff54cd4864df48a3e05b505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:53:30.102960 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e28e465f-1c46-4ee5-befa-cab2040df3d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:30.103595 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e28e465f-1c46-4ee5-befa-cab2040df3d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:30.105110 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1112/2226] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:53:29 2022] DELETE /identity/v3/projects/44c2d0513ff54cd4864df48a3e05b505 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:53:30.110679 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b5751-2141-4916-bb27-fb57bad93012 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:30.117583 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b5751-2141-4916-bb27-fb57bad93012 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:30.117583 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b5751-2141-4916-bb27-fb57bad93012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:30.130605 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-7e0b5751-2141-4916-bb27-fb57bad93012 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:53:30.131820 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-7e0b5751-2141-4916-bb27-fb57bad93012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:30.194512 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1115/2227] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:53:30.202841 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c35eb4-b2c4-4d56-b2b9-4bb8c288c018 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:30.203235 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c35eb4-b2c4-4d56-b2b9-4bb8c288c018 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:30.203648 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c35eb4-b2c4-4d56-b2b9-4bb8c288c018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:30.211505 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:53:30.226322 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-46c35eb4-b2c4-4d56-b2b9-4bb8c288c018 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:53:30.227887 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-46c35eb4-b2c4-4d56-b2b9-4bb8c288c018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:30.238856 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1113/2228] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:53:30.242820 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b5751-2141-4916-bb27-fb57bad93012 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:30.253701 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b5751-2141-4916-bb27-fb57bad93012 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:30.258826 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3ce03-5379-4ad4-84bf-d1e8f00dfae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:30.260173 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3ce03-5379-4ad4-84bf-d1e8f00dfae3 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:30.260173 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3ce03-5379-4ad4-84bf-d1e8f00dfae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:30.260173 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3ce03-5379-4ad4-84bf-d1e8f00dfae3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:30.260757 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3ce03-5379-4ad4-84bf-d1e8f00dfae3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:53:30.261122 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3ce03-5379-4ad4-84bf-d1e8f00dfae3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:30.262794 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3ce03-5379-4ad4-84bf-d1e8f00dfae3 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:30.279605 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1116/2229] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:53:30.284699 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c35eb4-b2c4-4d56-b2b9-4bb8c288c018 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:30.294116 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c35eb4-b2c4-4d56-b2b9-4bb8c288c018 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:30.300213 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de201267-1274-480f-aa69-e86d4b3b23a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:30.300957 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de201267-1274-480f-aa69-e86d4b3b23a8 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:30.301281 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de201267-1274-480f-aa69-e86d4b3b23a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:30.301538 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de201267-1274-480f-aa69-e86d4b3b23a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:30.302162 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de201267-1274-480f-aa69-e86d4b3b23a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:30.304209 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de201267-1274-480f-aa69-e86d4b3b23a8 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:30.553907 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1114/2230] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:53:30 2022] POST /identity/v3/projects => generated 383 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:53:30.558025 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3ce03-5379-4ad4-84bf-d1e8f00dfae3 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:30.581976 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3ce03-5379-4ad4-84bf-d1e8f00dfae3 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:30.648357 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898ebd5-8096-4c64-a060-3b11ef94ad6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:30.649154 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898ebd5-8096-4c64-a060-3b11ef94ad6b admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:30.649440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898ebd5-8096-4c64-a060-3b11ef94ad6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:30.649715 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898ebd5-8096-4c64-a060-3b11ef94ad6b admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:30.650363 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0898ebd5-8096-4c64-a060-3b11ef94ad6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:30.652294 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0898ebd5-8096-4c64-a060-3b11ef94ad6b admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:30.663972 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:53:30.787925 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1117/2231] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:53:30 2022] POST /identity/v3/users => generated 292 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:53:30.791955 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de201267-1274-480f-aa69-e86d4b3b23a8 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:30.803489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de201267-1274-480f-aa69-e86d4b3b23a8 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:30.808420 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ca8e2-87b3-4d8a-b51a-b263b065e7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:30.809189 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ca8e2-87b3-4d8a-b51a-b263b065e7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:30.809574 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ca8e2-87b3-4d8a-b51a-b263b065e7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:30.809909 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ca8e2-87b3-4d8a-b51a-b263b065e7b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:30.810807 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ca8e2-87b3-4d8a-b51a-b263b065e7b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:30.812540 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ca8e2-87b3-4d8a-b51a-b263b065e7b2 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:30.829249 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1115/2232] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:53:30.833618 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898ebd5-8096-4c64-a060-3b11ef94ad6b admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:30.844438 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898ebd5-8096-4c64-a060-3b11ef94ad6b admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:30.849219 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91bb47-9d44-46be-a978-15429a97b035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:30.849824 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91bb47-9d44-46be-a978-15429a97b035 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:30.854890 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91bb47-9d44-46be-a978-15429a97b035 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:30.854890 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91bb47-9d44-46be-a978-15429a97b035 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:30.854890 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91bb47-9d44-46be-a978-15429a97b035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:30.854890 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91bb47-9d44-46be-a978-15429a97b035 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:30.865855 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1118/2233] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:53:30.870047 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ca8e2-87b3-4d8a-b51a-b263b065e7b2 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:30.891617 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ca8e2-87b3-4d8a-b51a-b263b065e7b2 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:30.896288 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4a640-6222-4f7b-9289-f9b701e06e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:30.896953 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4a640-6222-4f7b-9289-f9b701e06e8f admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:30.897248 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4a640-6222-4f7b-9289-f9b701e06e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:30.897517 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4a640-6222-4f7b-9289-f9b701e06e8f admin admin] PATH_INFO: `/v3/projects/8840a21c7f2a41d394c0777e63d76478/users/f7302b734e88409a8d905eb8003fdbe3/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:30.913397 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4a640-6222-4f7b-9289-f9b701e06e8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8840a21c7f2a41d394c0777e63d76478, user_id=f7302b734e88409a8d905eb8003fdbe3, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:30.916465 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4a640-6222-4f7b-9289-f9b701e06e8f admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:31.027113 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1116/2234] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:53:30 2022] PUT /identity/v3/projects/8840a21c7f2a41d394c0777e63d76478/users/f7302b734e88409a8d905eb8003fdbe3/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:53:31.033106 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07b8a5-3b31-4b36-8995-4a6984216933 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:31.033396 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07b8a5-3b31-4b36-8995-4a6984216933 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:31.033673 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07b8a5-3b31-4b36-8995-4a6984216933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:31.058239 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-ed07b8a5-3b31-4b36-8995-4a6984216933 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:53:31.059512 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-ed07b8a5-3b31-4b36-8995-4a6984216933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:31.128628 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1119/2235] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:53:31.141773 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4a640-6222-4f7b-9289-f9b701e06e8f admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:31.144175 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-5fa4a640-6222-4f7b-9289-f9b701e06e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:31.233688 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4a640-6222-4f7b-9289-f9b701e06e8f admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:31.237776 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c03fe-da11-4f07-92f6-1149a7a21319 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:31.238391 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c03fe-da11-4f07-92f6-1149a7a21319 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:31.238673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c03fe-da11-4f07-92f6-1149a7a21319 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:31.238943 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c03fe-da11-4f07-92f6-1149a7a21319 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:31.248756 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c03fe-da11-4f07-92f6-1149a7a21319 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:31.250712 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c03fe-da11-4f07-92f6-1149a7a21319 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:31.261638 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1117/2236] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:53:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:53:33.300563 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f868557-b16d-471d-bc5a-6a17d9d2fb12 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:33.300563 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f868557-b16d-471d-bc5a-6a17d9d2fb12 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:33.300563 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f868557-b16d-471d-bc5a-6a17d9d2fb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:33.327265 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-7f868557-b16d-471d-bc5a-6a17d9d2fb12 None None] MFA Rules not processed for user `f7302b734e88409a8d905eb8003fdbe3`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:53:33.329307 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-7f868557-b16d-471d-bc5a-6a17d9d2fb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:33.428080 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1120/2237] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:53:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:53:33.439164 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c03fe-da11-4f07-92f6-1149a7a21319 service neutron] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:33.441497 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-359c03fe-da11-4f07-92f6-1149a7a21319 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:33.523890 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c03fe-da11-4f07-92f6-1149a7a21319 service neutron] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:33.531079 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4afd1-f10f-4aa9-9624-1707eedaa31d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:33.532519 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4afd1-f10f-4aa9-9624-1707eedaa31d service cinder] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:33.532998 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4afd1-f10f-4aa9-9624-1707eedaa31d service cinder] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:33.533491 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4afd1-f10f-4aa9-9624-1707eedaa31d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:33.545510 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4afd1-f10f-4aa9-9624-1707eedaa31d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:33.547638 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4afd1-f10f-4aa9-9624-1707eedaa31d service cinder] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:33.562930 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1118/2238] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:53:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:53:35.251402 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f868557-b16d-471d-bc5a-6a17d9d2fb12 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:35.252888 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-7f868557-b16d-471d-bc5a-6a17d9d2fb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:35.267849 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f868557-b16d-471d-bc5a-6a17d9d2fb12 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:35.272931 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122afa09-0287-4f53-9156-e16e15c8dff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:35.273609 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122afa09-0287-4f53-9156-e16e15c8dff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:35.273892 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122afa09-0287-4f53-9156-e16e15c8dff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:35.274225 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122afa09-0287-4f53-9156-e16e15c8dff9 admin admin] PATH_INFO: `/v3/users/4266569454a74cfe8218190ab351b7bb` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:35.275678 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122afa09-0287-4f53-9156-e16e15c8dff9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4266569454a74cfe8218190ab351b7bb)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:35.278062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122afa09-0287-4f53-9156-e16e15c8dff9 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:35.540904 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-122afa09-0287-4f53-9156-e16e15c8dff9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4266569454a74cfe8218190ab351b7bb'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:35.629112 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-122afa09-0287-4f53-9156-e16e15c8dff9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4266569454a74cfe8218190ab351b7bb'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:35.629752 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-122afa09-0287-4f53-9156-e16e15c8dff9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4266569454a74cfe8218190ab351b7bb'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:35.630400 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-122afa09-0287-4f53-9156-e16e15c8dff9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4266569454a74cfe8218190ab351b7bb'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:35.644067 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-122afa09-0287-4f53-9156-e16e15c8dff9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4266569454a74cfe8218190ab351b7bb'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:35.647106 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:INSERT=2,keystone:SELECT=90,keystone:DELETE=8 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:53:35.673146 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1121/2239] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:53:35 2022] DELETE /identity/v3/users/4266569454a74cfe8218190ab351b7bb => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:53:35.677697 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de684afb-86ea-48b3-8284-ab832ac741e3 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:35.685604 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de684afb-86ea-48b3-8284-ab832ac741e3 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:35.685604 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de684afb-86ea-48b3-8284-ab832ac741e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:35.704152 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-de684afb-86ea-48b3-8284-ab832ac741e3 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:53:35.705562 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-de684afb-86ea-48b3-8284-ab832ac741e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:35.742224 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ebb7f-37de-4e10-a0ce-6af39eb2e16f None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:35.742512 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ebb7f-37de-4e10-a0ce-6af39eb2e16f None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:35.742790 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ebb7f-37de-4e10-a0ce-6af39eb2e16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:35.756258 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:53:35.762936 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-1a9ebb7f-37de-4e10-a0ce-6af39eb2e16f None None] MFA Rules not processed for user `f7302b734e88409a8d905eb8003fdbe3`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:53:35.764170 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-1a9ebb7f-37de-4e10-a0ce-6af39eb2e16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:35.777159 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1119/2240] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:53:35.794444 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de684afb-86ea-48b3-8284-ab832ac741e3 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:35.797464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-de684afb-86ea-48b3-8284-ab832ac741e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:35.825152 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1122/2241] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:53:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:53:35.880182 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de684afb-86ea-48b3-8284-ab832ac741e3 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:35.884150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2ac0f-823a-4bbb-8ee2-3f1b7d30f885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:35.884803 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2ac0f-823a-4bbb-8ee2-3f1b7d30f885 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:35.885244 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2ac0f-823a-4bbb-8ee2-3f1b7d30f885 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:35.885547 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2ac0f-823a-4bbb-8ee2-3f1b7d30f885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:35.909982 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2ac0f-823a-4bbb-8ee2-3f1b7d30f885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:35.911641 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2ac0f-823a-4bbb-8ee2-3f1b7d30f885 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:35.923147 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1120/2242] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:53:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:53:36.797542 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ebb7f-37de-4e10-a0ce-6af39eb2e16f None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:36.802708 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-1a9ebb7f-37de-4e10-a0ce-6af39eb2e16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:36.841748 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ebb7f-37de-4e10-a0ce-6af39eb2e16f None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:36.847659 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8fc0de-fc3a-4fa8-b9c0-bb48dc3ad334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:36.848315 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fc0de-fc3a-4fa8-b9c0-bb48dc3ad334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:36.848594 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fc0de-fc3a-4fa8-b9c0-bb48dc3ad334 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:36.849486 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fc0de-fc3a-4fa8-b9c0-bb48dc3ad334 admin admin] PATH_INFO: `/v3/projects/86c5d317d1e34e129f0baebc382a41c8` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:36.851013 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8fc0de-fc3a-4fa8-b9c0-bb48dc3ad334 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86c5d317d1e34e129f0baebc382a41c8)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:36.854948 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8fc0de-fc3a-4fa8-b9c0-bb48dc3ad334 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:37.052948 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1a8fc0de-fc3a-4fa8-b9c0-bb48dc3ad334 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86c5d317d1e34e129f0baebc382a41c8', 'request_id': 'req-1a8fc0de-fc3a-4fa8-b9c0-bb48dc3ad334'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:37.059237 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1a8fc0de-fc3a-4fa8-b9c0-bb48dc3ad334 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86c5d317d1e34e129f0baebc382a41c8', 'request_id': 'req-1a8fc0de-fc3a-4fa8-b9c0-bb48dc3ad334'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:37.222017 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1a8fc0de-fc3a-4fa8-b9c0-bb48dc3ad334 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86c5d317d1e34e129f0baebc382a41c8', 'request_id': 'req-1a8fc0de-fc3a-4fa8-b9c0-bb48dc3ad334'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:37.236760 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1a8fc0de-fc3a-4fa8-b9c0-bb48dc3ad334 admin admin] The token cache is being invalidate because project 86c5d317d1e34e129f0baebc382a41c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:53:37.237322 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1a8fc0de-fc3a-4fa8-b9c0-bb48dc3ad334 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:37.237931 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1a8fc0de-fc3a-4fa8-b9c0-bb48dc3ad334 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:37.239444 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1123/2243] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:53:36 2022] DELETE /identity/v3/projects/86c5d317d1e34e129f0baebc382a41c8 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:53:37.251861 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b459c-1e01-4472-9079-c99d40bcb297 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:37.252445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b459c-1e01-4472-9079-c99d40bcb297 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:37.252445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b459c-1e01-4472-9079-c99d40bcb297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:37.274614 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-b64b459c-1e01-4472-9079-c99d40bcb297 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:53:37.275863 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-b64b459c-1e01-4472-9079-c99d40bcb297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:37.357189 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1121/2244] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:53:37.373833 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32b321-9497-475d-819b-2d38a0511ef0 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:37.376925 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32b321-9497-475d-819b-2d38a0511ef0 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:37.377358 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32b321-9497-475d-819b-2d38a0511ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:37.407984 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-1f32b321-9497-475d-819b-2d38a0511ef0 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:53:37.409281 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-1f32b321-9497-475d-819b-2d38a0511ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:37.418540 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1124/2245] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:53:37.423721 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b459c-1e01-4472-9079-c99d40bcb297 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:37.434440 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b459c-1e01-4472-9079-c99d40bcb297 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:37.440099 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737cfae-1697-4888-afcb-f7684efe75bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:37.440779 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737cfae-1697-4888-afcb-f7684efe75bd admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:37.441580 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737cfae-1697-4888-afcb-f7684efe75bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:37.441580 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737cfae-1697-4888-afcb-f7684efe75bd admin admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:37.442177 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737cfae-1697-4888-afcb-f7684efe75bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:53:37.442601 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737cfae-1697-4888-afcb-f7684efe75bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:37.444236 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737cfae-1697-4888-afcb-f7684efe75bd admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:37.479229 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1122/2246] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:53:37.484135 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32b321-9497-475d-819b-2d38a0511ef0 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:37.495202 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32b321-9497-475d-819b-2d38a0511ef0 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:37.501821 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e852b9-10f0-4d79-89d8-391a692f7e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:37.502391 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e852b9-10f0-4d79-89d8-391a692f7e67 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:37.502674 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e852b9-10f0-4d79-89d8-391a692f7e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:37.502944 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e852b9-10f0-4d79-89d8-391a692f7e67 admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:37.503572 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e852b9-10f0-4d79-89d8-391a692f7e67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:37.505600 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e852b9-10f0-4d79-89d8-391a692f7e67 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:37.611687 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737cfae-1697-4888-afcb-f7684efe75bd admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:37.618554 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1125/2247] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:53:37 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:53:37.624756 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737cfae-1697-4888-afcb-f7684efe75bd admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:37.711222 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48124c75-6620-4c46-82c8-99ed83215102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:37.712001 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48124c75-6620-4c46-82c8-99ed83215102 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:37.712352 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48124c75-6620-4c46-82c8-99ed83215102 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:37.712698 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48124c75-6620-4c46-82c8-99ed83215102 admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:37.713452 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48124c75-6620-4c46-82c8-99ed83215102 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:37.715775 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48124c75-6620-4c46-82c8-99ed83215102 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:37.815552 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1123/2248] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:53:37 2022] POST /identity/v3/users => generated 288 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:53:37.819806 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e852b9-10f0-4d79-89d8-391a692f7e67 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:37.832083 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e852b9-10f0-4d79-89d8-391a692f7e67 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:37.855183 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a684f5-471e-469a-a03a-69223589cf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:37.855815 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a684f5-471e-469a-a03a-69223589cf07 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:37.856102 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a684f5-471e-469a-a03a-69223589cf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:37.856386 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a684f5-471e-469a-a03a-69223589cf07 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:37.857132 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a684f5-471e-469a-a03a-69223589cf07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:37.859380 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a684f5-471e-469a-a03a-69223589cf07 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:37.873359 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1126/2249] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:53:37.875118 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48124c75-6620-4c46-82c8-99ed83215102 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:37.882856 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:53:37.886935 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48124c75-6620-4c46-82c8-99ed83215102 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:37.892144 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c407bb-bf8d-4501-adaa-0ba5030a5241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:37.892794 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c407bb-bf8d-4501-adaa-0ba5030a5241 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:37.893110 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c407bb-bf8d-4501-adaa-0ba5030a5241 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:37.893391 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c407bb-bf8d-4501-adaa-0ba5030a5241 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:37.894039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c407bb-bf8d-4501-adaa-0ba5030a5241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:37.895640 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c407bb-bf8d-4501-adaa-0ba5030a5241 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:37.910508 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1124/2250] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:53:37.914479 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a684f5-471e-469a-a03a-69223589cf07 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:37.926339 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a684f5-471e-469a-a03a-69223589cf07 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:37.936405 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bdc5d-c4df-451b-9954-f8323a722d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:37.937415 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bdc5d-c4df-451b-9954-f8323a722d8d admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:37.937749 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bdc5d-c4df-451b-9954-f8323a722d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:37.938025 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bdc5d-c4df-451b-9954-f8323a722d8d admin admin] PATH_INFO: `/v3/projects/30ff04ef90744ac3929b06eb85f1f117/users/28ff363c3dea4d9b81371ed9917b6bc3/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:37.955053 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7bdc5d-c4df-451b-9954-f8323a722d8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=30ff04ef90744ac3929b06eb85f1f117, user_id=28ff363c3dea4d9b81371ed9917b6bc3, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:37.957785 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7bdc5d-c4df-451b-9954-f8323a722d8d admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:38.075729 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1127/2251] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:53:37 2022] PUT /identity/v3/projects/30ff04ef90744ac3929b06eb85f1f117/users/28ff363c3dea4d9b81371ed9917b6bc3/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:53:38.078772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c407bb-bf8d-4501-adaa-0ba5030a5241 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:38.088955 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-57c407bb-bf8d-4501-adaa-0ba5030a5241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:38.091350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3ca58-545f-49f8-8e9c-5e3019888980 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:38.092555 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3ca58-545f-49f8-8e9c-5e3019888980 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:38.093667 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3ca58-545f-49f8-8e9c-5e3019888980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:38.097369 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c407bb-bf8d-4501-adaa-0ba5030a5241 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:38.123420 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:53:38.133426 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-ffa3ca58-545f-49f8-8e9c-5e3019888980 None None] MFA Rules not processed for user `28ff363c3dea4d9b81371ed9917b6bc3`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:53:38.134657 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-ffa3ca58-545f-49f8-8e9c-5e3019888980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:38.169683 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6415cf-187a-4f62-bf2d-890885d84e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:38.170727 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6415cf-187a-4f62-bf2d-890885d84e4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:38.171282 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6415cf-187a-4f62-bf2d-890885d84e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:38.171840 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6415cf-187a-4f62-bf2d-890885d84e4c admin admin] PATH_INFO: `/v3/users/15c409b22d5f42afbde8d5dab8e01a0f` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:38.173584 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6415cf-187a-4f62-bf2d-890885d84e4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=15c409b22d5f42afbde8d5dab8e01a0f)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:38.175916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6415cf-187a-4f62-bf2d-890885d84e4c admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:38.207453 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1128/2252] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:53:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:53:38.219355 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3ca58-545f-49f8-8e9c-5e3019888980 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:38.226329 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-ffa3ca58-545f-49f8-8e9c-5e3019888980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:38.282603 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3ca58-545f-49f8-8e9c-5e3019888980 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:38.286433 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c4b96-9d11-4d9d-bd1d-f67ffe492f1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:38.287045 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c4b96-9d11-4d9d-bd1d-f67ffe492f1f service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:38.287331 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c4b96-9d11-4d9d-bd1d-f67ffe492f1f service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:38.287611 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c4b96-9d11-4d9d-bd1d-f67ffe492f1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:38.296955 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c4b96-9d11-4d9d-bd1d-f67ffe492f1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:38.298618 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c4b96-9d11-4d9d-bd1d-f67ffe492f1f service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:38.309603 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1129/2253] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:53:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:53:38.438724 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-8e6415cf-187a-4f62-bf2d-890885d84e4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15c409b22d5f42afbde8d5dab8e01a0f'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:38.539866 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-8e6415cf-187a-4f62-bf2d-890885d84e4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15c409b22d5f42afbde8d5dab8e01a0f'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:38.540688 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-8e6415cf-187a-4f62-bf2d-890885d84e4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15c409b22d5f42afbde8d5dab8e01a0f'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:38.541449 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-8e6415cf-187a-4f62-bf2d-890885d84e4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15c409b22d5f42afbde8d5dab8e01a0f'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:38.549986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-8e6415cf-187a-4f62-bf2d-890885d84e4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15c409b22d5f42afbde8d5dab8e01a0f'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:38.594533 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1125/2254] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:53:38 2022] DELETE /identity/v3/users/15c409b22d5f42afbde8d5dab8e01a0f => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:53:38.596407 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d709d8d-cadc-4372-a0e5-f5b83e27c65a None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:38.596974 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d709d8d-cadc-4372-a0e5-f5b83e27c65a None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:38.597488 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d709d8d-cadc-4372-a0e5-f5b83e27c65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:38.634262 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-1d709d8d-cadc-4372-a0e5-f5b83e27c65a None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:53:38.635930 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-1d709d8d-cadc-4372-a0e5-f5b83e27c65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:38.724807 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1130/2255] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:53:38.736159 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6415cf-187a-4f62-bf2d-890885d84e4c admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:38.737864 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-8e6415cf-187a-4f62-bf2d-890885d84e4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:38.819663 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6415cf-187a-4f62-bf2d-890885d84e4c admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:38.824031 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71edc0-5003-454d-9901-cba6583e0d2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:38.824912 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71edc0-5003-454d-9901-cba6583e0d2e service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:38.825419 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71edc0-5003-454d-9901-cba6583e0d2e service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:38.825863 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71edc0-5003-454d-9901-cba6583e0d2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:38.836924 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71edc0-5003-454d-9901-cba6583e0d2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:38.838683 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71edc0-5003-454d-9901-cba6583e0d2e service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:38.852497 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1126/2256] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:53:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:53:39.413676 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d709d8d-cadc-4372-a0e5-f5b83e27c65a None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:39.413676 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-1d709d8d-cadc-4372-a0e5-f5b83e27c65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:39.426948 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d709d8d-cadc-4372-a0e5-f5b83e27c65a None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:39.432078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a6cc7-09f1-4ecd-8eea-fbc45d9abc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:39.432854 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a6cc7-09f1-4ecd-8eea-fbc45d9abc66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:39.433010 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a6cc7-09f1-4ecd-8eea-fbc45d9abc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:39.438353 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a6cc7-09f1-4ecd-8eea-fbc45d9abc66 admin admin] PATH_INFO: `/v3/projects/9abc03229fd84a60a6a3c892775fcc39` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:39.438353 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a6cc7-09f1-4ecd-8eea-fbc45d9abc66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9abc03229fd84a60a6a3c892775fcc39)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:39.438353 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a6cc7-09f1-4ecd-8eea-fbc45d9abc66 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:39.548426 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:53:39.557218 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-da1a6cc7-09f1-4ecd-8eea-fbc45d9abc66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9abc03229fd84a60a6a3c892775fcc39', 'request_id': 'req-da1a6cc7-09f1-4ecd-8eea-fbc45d9abc66'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:39.564108 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-da1a6cc7-09f1-4ecd-8eea-fbc45d9abc66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9abc03229fd84a60a6a3c892775fcc39', 'request_id': 'req-da1a6cc7-09f1-4ecd-8eea-fbc45d9abc66'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:39.642753 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-da1a6cc7-09f1-4ecd-8eea-fbc45d9abc66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9abc03229fd84a60a6a3c892775fcc39', 'request_id': 'req-da1a6cc7-09f1-4ecd-8eea-fbc45d9abc66'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:39.654400 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-da1a6cc7-09f1-4ecd-8eea-fbc45d9abc66 admin admin] The token cache is being invalidate because project 9abc03229fd84a60a6a3c892775fcc39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:53:39.654692 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-da1a6cc7-09f1-4ecd-8eea-fbc45d9abc66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:39.656437 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-da1a6cc7-09f1-4ecd-8eea-fbc45d9abc66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:53:39.658065 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1131/2257] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:53:39 2022] DELETE /identity/v3/projects/9abc03229fd84a60a6a3c892775fcc39 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:53:40.230875 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b26b0-0aca-4a5c-94a0-c1a3f74cdd0b None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:40.231323 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b26b0-0aca-4a5c-94a0-c1a3f74cdd0b None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:40.231457 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b26b0-0aca-4a5c-94a0-c1a3f74cdd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:40.253271 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-9e6b26b0-0aca-4a5c-94a0-c1a3f74cdd0b None None] MFA Rules not processed for user `28ff363c3dea4d9b81371ed9917b6bc3`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:53:40.254501 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-9e6b26b0-0aca-4a5c-94a0-c1a3f74cdd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:40.265311 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:53:40.310756 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1127/2258] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:53:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:53:41.829427 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a6cc7-09f1-4ecd-8eea-fbc45d9abc66 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:41.830872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-da1a6cc7-09f1-4ecd-8eea-fbc45d9abc66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:41.905237 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a6cc7-09f1-4ecd-8eea-fbc45d9abc66 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:41.910347 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304290f-7385-4958-8e6b-bf01ccc22ba2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68717c19e74e434da825d9b1d6ca202a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:41.910920 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304290f-7385-4958-8e6b-bf01ccc22ba2 service placement] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:41.911199 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304290f-7385-4958-8e6b-bf01ccc22ba2 service placement] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:41.911473 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304290f-7385-4958-8e6b-bf01ccc22ba2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:41.913242 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-0304290f-7385-4958-8e6b-bf01ccc22ba2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:41.925401 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304290f-7385-4958-8e6b-bf01ccc22ba2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:41.926979 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304290f-7385-4958-8e6b-bf01ccc22ba2 service placement] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:41.937366 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1132/2259] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:53:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:53:50.642890 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=18 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:53:51.495545 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e69ca-ff16-41bf-8aa0-b11e55b63f06 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:51.496282 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e69ca-ff16-41bf-8aa0-b11e55b63f06 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:51.496753 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e69ca-ff16-41bf-8aa0-b11e55b63f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:51.521891 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-f83e69ca-ff16-41bf-8aa0-b11e55b63f06 None None] MFA Rules not processed for user `c880ab908c114c5897d11aad7fb48607`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:53:51.523675 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-f83e69ca-ff16-41bf-8aa0-b11e55b63f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:51.596582 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1128/2260] 10.222.0.70 () {58 vars in 967 bytes} [Mon Aug 8 17:53:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:53:51.606349 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304290f-7385-4958-8e6b-bf01ccc22ba2 service placement] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:53:51.607456 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-0304290f-7385-4958-8e6b-bf01ccc22ba2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:51.736325 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304290f-7385-4958-8e6b-bf01ccc22ba2 service placement] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:53:51.741805 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67ba50-e156-4102-a8aa-f2f6ef0910f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b83ff95ed44f35af2e412a700ca567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:53:51.742420 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67ba50-e156-4102-a8aa-f2f6ef0910f6 service swift] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:51.742706 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67ba50-e156-4102-a8aa-f2f6ef0910f6 service swift] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:51.743073 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67ba50-e156-4102-a8aa-f2f6ef0910f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:51.774040 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d67ba50-e156-4102-a8aa-f2f6ef0910f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:53:51.775845 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d67ba50-e156-4102-a8aa-f2f6ef0910f6 service swift] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:53:51.790888 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1133/2261] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Aug 8 17:53:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 17:53:58.922295 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0354b-0c00-41e7-bdf3-156f7a4fcbe8 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:53:58.922805 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0354b-0c00-41e7-bdf3-156f7a4fcbe8 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:53:58.922904 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0354b-0c00-41e7-bdf3-156f7a4fcbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:53:58.942604 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-63b0354b-0c00-41e7-bdf3-156f7a4fcbe8 None None] MFA Rules not processed for user `81e69ba7717f4956bf327292fdf98cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:53:58.943746 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-63b0354b-0c00-41e7-bdf3-156f7a4fcbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:53:59.026351 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1129/2262] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:53:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:54:01.784972 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=75,keystone:DELETE=4,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:54:09.017257 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=50 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:54:09.258614 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987f6e5-363d-447b-9764-0194fd4df79d None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:54:09.259161 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987f6e5-363d-447b-9764-0194fd4df79d None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:54:09.259161 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987f6e5-363d-447b-9764-0194fd4df79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:54:09.279457 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-5987f6e5-363d-447b-9764-0194fd4df79d None None] MFA Rules not processed for user `7d84d1d6d0ab469f905d01d8a1276dec`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:54:09.280722 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-5987f6e5-363d-447b-9764-0194fd4df79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:54:09.344834 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1134/2263] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:54:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:54:12.410049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae269371-0fd8-4d18-b4e6-360d8daf1cb3 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:54:12.410876 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae269371-0fd8-4d18-b4e6-360d8daf1cb3 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:54:12.411313 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae269371-0fd8-4d18-b4e6-360d8daf1cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:54:12.435982 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-ae269371-0fd8-4d18-b4e6-360d8daf1cb3 None None] MFA Rules not processed for user `c880ab908c114c5897d11aad7fb48607`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:54:12.437513 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-ae269371-0fd8-4d18-b4e6-360d8daf1cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:54:12.445267 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1130/2264] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Aug 8 17:54:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:54:12.460875 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987f6e5-363d-447b-9764-0194fd4df79d None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:54:12.474517 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987f6e5-363d-447b-9764-0194fd4df79d None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:54:12.480458 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a018c3-ccda-4aef-b348-403789e58b09 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b83ff95ed44f35af2e412a700ca567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:54:12.481257 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a018c3-ccda-4aef-b348-403789e58b09 service swift] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:54:12.481543 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a018c3-ccda-4aef-b348-403789e58b09 service swift] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:54:12.481889 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a018c3-ccda-4aef-b348-403789e58b09 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:54:12.490368 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a018c3-ccda-4aef-b348-403789e58b09 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:54:12.491986 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a018c3-ccda-4aef-b348-403789e58b09 service swift] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:54:12.500332 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1135/2265] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Aug 8 17:54:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 17:54:13.508439 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b9204-5797-4087-b5d2-975bb3014a72 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:54:13.509455 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b9204-5797-4087-b5d2-975bb3014a72 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:54:13.509738 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b9204-5797-4087-b5d2-975bb3014a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:54:13.533554 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-777b9204-5797-4087-b5d2-975bb3014a72 None None] MFA Rules not processed for user `c880ab908c114c5897d11aad7fb48607`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:54:13.534934 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-777b9204-5797-4087-b5d2-975bb3014a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:54:13.543369 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1131/2266] 10.222.0.70 () {58 vars in 967 bytes} [Mon Aug 8 17:54:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:54:13.572710 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a018c3-ccda-4aef-b348-403789e58b09 service swift] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:54:13.581628 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a018c3-ccda-4aef-b348-403789e58b09 service swift] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:54:13.592755 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cb337-1a05-4b22-b0f1-4bba5e89e80e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b83ff95ed44f35af2e412a700ca567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:54:13.594138 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cb337-1a05-4b22-b0f1-4bba5e89e80e service swift] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:54:13.594673 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cb337-1a05-4b22-b0f1-4bba5e89e80e service swift] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:54:13.594997 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cb337-1a05-4b22-b0f1-4bba5e89e80e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:54:13.608880 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468cb337-1a05-4b22-b0f1-4bba5e89e80e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:54:13.610987 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468cb337-1a05-4b22-b0f1-4bba5e89e80e service swift] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:54:13.627647 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1136/2267] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Aug 8 17:54:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 17:54:14.314433 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342ba27-1b55-45dc-ac47-777ba2ae9e02 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:54:14.314793 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342ba27-1b55-45dc-ac47-777ba2ae9e02 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:54:14.315135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342ba27-1b55-45dc-ac47-777ba2ae9e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:54:14.336080 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-0342ba27-1b55-45dc-ac47-777ba2ae9e02 None None] MFA Rules not processed for user `c880ab908c114c5897d11aad7fb48607`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:54:14.337915 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-0342ba27-1b55-45dc-ac47-777ba2ae9e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:54:14.347872 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1132/2268] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Aug 8 17:54:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:54:14.361017 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cb337-1a05-4b22-b0f1-4bba5e89e80e service swift] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:54:14.376454 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cb337-1a05-4b22-b0f1-4bba5e89e80e service swift] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:54:14.382173 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78fe5bc-ddee-44bb-962c-ecd4120e69c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b83ff95ed44f35af2e412a700ca567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:54:14.382784 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78fe5bc-ddee-44bb-962c-ecd4120e69c1 service swift] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:54:14.383067 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78fe5bc-ddee-44bb-962c-ecd4120e69c1 service swift] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:54:14.383337 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78fe5bc-ddee-44bb-962c-ecd4120e69c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:54:14.392514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78fe5bc-ddee-44bb-962c-ecd4120e69c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:54:14.394535 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78fe5bc-ddee-44bb-962c-ecd4120e69c1 service swift] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:54:14.404607 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1137/2269] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Aug 8 17:54:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 17:54:14.969643 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4f17c-6814-4fc0-8815-c0df34cf1fed None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:54:14.970172 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4f17c-6814-4fc0-8815-c0df34cf1fed None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:54:14.970172 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4f17c-6814-4fc0-8815-c0df34cf1fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:54:14.991318 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-a5d4f17c-6814-4fc0-8815-c0df34cf1fed None None] MFA Rules not processed for user `c880ab908c114c5897d11aad7fb48607`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:54:14.992446 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-a5d4f17c-6814-4fc0-8815-c0df34cf1fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:54:15.000458 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1133/2270] 10.222.0.70 () {58 vars in 967 bytes} [Mon Aug 8 17:54:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:54:15.012895 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78fe5bc-ddee-44bb-962c-ecd4120e69c1 service swift] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:54:15.024139 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78fe5bc-ddee-44bb-962c-ecd4120e69c1 service swift] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:54:15.031468 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab4d73-2cd8-48b6-9768-7c964b910459 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b83ff95ed44f35af2e412a700ca567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:54:15.032372 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab4d73-2cd8-48b6-9768-7c964b910459 service swift] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:54:15.039660 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab4d73-2cd8-48b6-9768-7c964b910459 service swift] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:54:15.039660 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab4d73-2cd8-48b6-9768-7c964b910459 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:54:15.043509 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab4d73-2cd8-48b6-9768-7c964b910459 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:54:15.045142 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab4d73-2cd8-48b6-9768-7c964b910459 service swift] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:54:15.053748 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1138/2271] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Aug 8 17:54:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 17:54:17.860004 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4f17c-6814-4fc0-8815-c0df34cf1fed None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:54:17.861464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-a5d4f17c-6814-4fc0-8815-c0df34cf1fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:54:17.938097 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4f17c-6814-4fc0-8815-c0df34cf1fed None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:54:17.943017 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc98e07-9195-4d9d-bd98-38b5619e3396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:54:17.943585 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc98e07-9195-4d9d-bd98-38b5619e3396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:54:17.943865 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc98e07-9195-4d9d-bd98-38b5619e3396 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:54:17.944139 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc98e07-9195-4d9d-bd98-38b5619e3396 admin admin] PATH_INFO: `/v3/users/28ff363c3dea4d9b81371ed9917b6bc3` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:54:17.945337 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc98e07-9195-4d9d-bd98-38b5619e3396 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28ff363c3dea4d9b81371ed9917b6bc3)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:54:17.947259 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc98e07-9195-4d9d-bd98-38b5619e3396 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:54:18.176391 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-ffc98e07-9195-4d9d-bd98-38b5619e3396 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28ff363c3dea4d9b81371ed9917b6bc3'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:54:18.258121 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-ffc98e07-9195-4d9d-bd98-38b5619e3396 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28ff363c3dea4d9b81371ed9917b6bc3'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:54:18.259073 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-ffc98e07-9195-4d9d-bd98-38b5619e3396 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28ff363c3dea4d9b81371ed9917b6bc3'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:54:18.259859 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-ffc98e07-9195-4d9d-bd98-38b5619e3396 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28ff363c3dea4d9b81371ed9917b6bc3'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:54:18.270823 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-ffc98e07-9195-4d9d-bd98-38b5619e3396 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28ff363c3dea4d9b81371ed9917b6bc3'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:54:18.303370 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1134/2272] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:54:17 2022] DELETE /identity/v3/users/28ff363c3dea4d9b81371ed9917b6bc3 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:54:18.304616 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e6d63-99e5-481e-9897-77c31af2719c None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:54:18.305123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e6d63-99e5-481e-9897-77c31af2719c None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:54:18.305210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e6d63-99e5-481e-9897-77c31af2719c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:54:18.327880 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-cb4e6d63-99e5-481e-9897-77c31af2719c None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:54:18.329225 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-cb4e6d63-99e5-481e-9897-77c31af2719c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:54:18.418215 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1139/2273] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:54:18.430480 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc98e07-9195-4d9d-bd98-38b5619e3396 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:54:18.431936 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-ffc98e07-9195-4d9d-bd98-38b5619e3396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:54:18.502501 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc98e07-9195-4d9d-bd98-38b5619e3396 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:54:18.506198 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a20da-8f33-4e5a-bf6a-61c1149dbf6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:54:18.506872 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a20da-8f33-4e5a-bf6a-61c1149dbf6f service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:54:18.507161 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a20da-8f33-4e5a-bf6a-61c1149dbf6f service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:54:18.507434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a20da-8f33-4e5a-bf6a-61c1149dbf6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:54:18.516491 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:54:18.519639 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a20da-8f33-4e5a-bf6a-61c1149dbf6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:54:18.521380 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a20da-8f33-4e5a-bf6a-61c1149dbf6f service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:54:18.533245 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1135/2274] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:54:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:54:18.991137 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e6d63-99e5-481e-9897-77c31af2719c None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:54:18.993556 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-cb4e6d63-99e5-481e-9897-77c31af2719c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:54:19.021345 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e6d63-99e5-481e-9897-77c31af2719c None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:54:19.026132 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c83f29-f0e4-458c-940b-b1c337c65ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:54:19.026544 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c83f29-f0e4-458c-940b-b1c337c65ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:54:19.026823 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c83f29-f0e4-458c-940b-b1c337c65ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:54:19.027267 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c83f29-f0e4-458c-940b-b1c337c65ce9 admin admin] PATH_INFO: `/v3/projects/30ff04ef90744ac3929b06eb85f1f117` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:54:19.028636 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c83f29-f0e4-458c-940b-b1c337c65ce9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30ff04ef90744ac3929b06eb85f1f117)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:54:19.030774 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c83f29-f0e4-458c-940b-b1c337c65ce9 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:54:19.156945 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:54:19.158415 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a9c83f29-f0e4-458c-940b-b1c337c65ce9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30ff04ef90744ac3929b06eb85f1f117', 'request_id': 'req-a9c83f29-f0e4-458c-940b-b1c337c65ce9'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:54:19.168424 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a9c83f29-f0e4-458c-940b-b1c337c65ce9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30ff04ef90744ac3929b06eb85f1f117', 'request_id': 'req-a9c83f29-f0e4-458c-940b-b1c337c65ce9'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:54:19.249183 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a9c83f29-f0e4-458c-940b-b1c337c65ce9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30ff04ef90744ac3929b06eb85f1f117', 'request_id': 'req-a9c83f29-f0e4-458c-940b-b1c337c65ce9'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:54:19.267365 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a9c83f29-f0e4-458c-940b-b1c337c65ce9 admin admin] The token cache is being invalidate because project 30ff04ef90744ac3929b06eb85f1f117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:54:19.267793 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a9c83f29-f0e4-458c-940b-b1c337c65ce9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:54:19.268505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-a9c83f29-f0e4-458c-940b-b1c337c65ce9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:54:19.270059 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1140/2275] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:54:18 2022] DELETE /identity/v3/projects/30ff04ef90744ac3929b06eb85f1f117 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:54:28.635140 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=2 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:54:29.262184 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=7,keystone:DELETE=3,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:54:29.700530 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb2665-6b74-45af-8979-cb68db43c94c None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:54:29.701095 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb2665-6b74-45af-8979-cb68db43c94c None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:54:29.701230 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb2665-6b74-45af-8979-cb68db43c94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:54:29.721163 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-e2eb2665-6b74-45af-8979-cb68db43c94c None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:54:29.722606 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-e2eb2665-6b74-45af-8979-cb68db43c94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:54:29.781573 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1136/2276] 10.222.0.75 () {58 vars in 1016 bytes} [Mon Aug 8 17:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:54:29.809606 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c83f29-f0e4-458c-940b-b1c337c65ce9 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:54:29.811053 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-a9c83f29-f0e4-458c-940b-b1c337c65ce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:54:29.883212 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c83f29-f0e4-458c-940b-b1c337c65ce9 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:54:29.889064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7022c3-505e-4335-a9fe-46b60f0d2723 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:54:29.889671 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7022c3-505e-4335-a9fe-46b60f0d2723 service nova] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:54:29.889954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7022c3-505e-4335-a9fe-46b60f0d2723 service nova] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:54:29.890233 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7022c3-505e-4335-a9fe-46b60f0d2723 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:54:29.898305 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7022c3-505e-4335-a9fe-46b60f0d2723 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:54:29.899899 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7022c3-505e-4335-a9fe-46b60f0d2723 service nova] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:54:29.909951 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1141/2277] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:54:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:54:34.849531 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25deb1a-235e-45c9-a579-c6715172b738 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:54:34.850063 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25deb1a-235e-45c9-a579-c6715172b738 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:54:34.850063 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25deb1a-235e-45c9-a579-c6715172b738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:54:34.869304 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-b25deb1a-235e-45c9-a579-c6715172b738 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:54:34.871008 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-b25deb1a-235e-45c9-a579-c6715172b738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:54:34.878979 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1137/2278] 10.222.0.75 () {58 vars in 1016 bytes} [Mon Aug 8 17:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:54:34.897383 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7022c3-505e-4335-a9fe-46b60f0d2723 service nova] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:54:34.909268 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7022c3-505e-4335-a9fe-46b60f0d2723 service nova] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:54:34.914566 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87dab71-2684-42c0-829c-68fb71f2cc67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:54:34.915254 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87dab71-2684-42c0-829c-68fb71f2cc67 service nova] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:54:34.915533 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87dab71-2684-42c0-829c-68fb71f2cc67 service nova] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:54:34.915802 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87dab71-2684-42c0-829c-68fb71f2cc67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:54:34.924254 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87dab71-2684-42c0-829c-68fb71f2cc67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:54:34.925849 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87dab71-2684-42c0-829c-68fb71f2cc67 service nova] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:54:34.936023 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1142/2279] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:54:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:54:39.349308 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ad740-babc-4f3a-9879-51901a6f6bd3 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:54:39.349911 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ad740-babc-4f3a-9879-51901a6f6bd3 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:54:39.349911 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ad740-babc-4f3a-9879-51901a6f6bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:54:39.369696 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-861ad740-babc-4f3a-9879-51901a6f6bd3 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:54:39.371535 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-861ad740-babc-4f3a-9879-51901a6f6bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:54:39.379290 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1138/2280] 10.222.0.75 () {58 vars in 1016 bytes} [Mon Aug 8 17:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:54:39.393874 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87dab71-2684-42c0-829c-68fb71f2cc67 service nova] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:54:39.395329 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-a87dab71-2684-42c0-829c-68fb71f2cc67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:54:39.411503 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87dab71-2684-42c0-829c-68fb71f2cc67 service nova] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:54:39.417712 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58becd35-c21b-425a-9fa8-71a96f3a593a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:54:39.418309 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58becd35-c21b-425a-9fa8-71a96f3a593a service nova] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:54:39.418592 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58becd35-c21b-425a-9fa8-71a96f3a593a service nova] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:54:39.418873 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58becd35-c21b-425a-9fa8-71a96f3a593a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:54:39.427201 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58becd35-c21b-425a-9fa8-71a96f3a593a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:54:39.430169 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58becd35-c21b-425a-9fa8-71a96f3a593a service nova] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:54:39.438446 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1143/2281] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:54:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:54:43.198243 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6cf36-dc7d-4114-8ad6-a7bddc92afd9 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:54:43.198742 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6cf36-dc7d-4114-8ad6-a7bddc92afd9 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:54:43.198846 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6cf36-dc7d-4114-8ad6-a7bddc92afd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:54:43.218712 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-e5c6cf36-dc7d-4114-8ad6-a7bddc92afd9 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:54:43.219941 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-e5c6cf36-dc7d-4114-8ad6-a7bddc92afd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:54:43.228109 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1139/2282] 10.222.0.75 () {58 vars in 1016 bytes} [Mon Aug 8 17:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:54:43.249221 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58becd35-c21b-425a-9fa8-71a96f3a593a service nova] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:54:43.260067 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58becd35-c21b-425a-9fa8-71a96f3a593a service nova] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:54:43.265718 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c9da5-f665-4433-acd5-7daea260ab1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:54:43.266309 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c9da5-f665-4433-acd5-7daea260ab1c service nova] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:54:43.266591 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c9da5-f665-4433-acd5-7daea260ab1c service nova] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:54:43.266868 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c9da5-f665-4433-acd5-7daea260ab1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:54:43.275180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c9da5-f665-4433-acd5-7daea260ab1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:54:43.278035 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c9da5-f665-4433-acd5-7daea260ab1c service nova] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:54:43.288475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1144/2283] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:54:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:54:47.465171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769eacc3-2617-4d08-8cac-aaff66c2f084 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:54:47.465668 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769eacc3-2617-4d08-8cac-aaff66c2f084 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:54:47.465780 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769eacc3-2617-4d08-8cac-aaff66c2f084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:54:47.485316 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-769eacc3-2617-4d08-8cac-aaff66c2f084 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:54:47.486522 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-769eacc3-2617-4d08-8cac-aaff66c2f084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:54:47.494778 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1140/2284] 10.222.0.75 () {58 vars in 1016 bytes} [Mon Aug 8 17:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:54:47.509323 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c9da5-f665-4433-acd5-7daea260ab1c service nova] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:54:47.520843 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c9da5-f665-4433-acd5-7daea260ab1c service nova] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:54:47.526256 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ed2d9-573c-4cd9-b2d8-a7864918fa6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:54:47.527562 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ed2d9-573c-4cd9-b2d8-a7864918fa6b service nova] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:54:47.527854 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ed2d9-573c-4cd9-b2d8-a7864918fa6b service nova] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:54:47.528130 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ed2d9-573c-4cd9-b2d8-a7864918fa6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:54:47.536138 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62ed2d9-573c-4cd9-b2d8-a7864918fa6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:54:47.537703 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62ed2d9-573c-4cd9-b2d8-a7864918fa6b service nova] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:54:47.547112 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1145/2285] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:54:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:54:52.794957 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c95156-e221-4fc5-9658-de9da4111b9d None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:54:52.795443 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c95156-e221-4fc5-9658-de9da4111b9d None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:54:52.795611 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c95156-e221-4fc5-9658-de9da4111b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:54:52.815463 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-25c95156-e221-4fc5-9658-de9da4111b9d None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:54:52.816725 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-25c95156-e221-4fc5-9658-de9da4111b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:54:52.825323 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1141/2286] 10.222.0.75 () {58 vars in 1016 bytes} [Mon Aug 8 17:54:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:54:52.845820 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ed2d9-573c-4cd9-b2d8-a7864918fa6b service nova] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:54:52.856615 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ed2d9-573c-4cd9-b2d8-a7864918fa6b service nova] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:54:52.862653 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6aa535-3eca-428b-991d-9efcb43ba2f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:54:52.863246 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6aa535-3eca-428b-991d-9efcb43ba2f9 service nova] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:54:52.863522 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6aa535-3eca-428b-991d-9efcb43ba2f9 service nova] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:54:52.863938 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6aa535-3eca-428b-991d-9efcb43ba2f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:54:52.873436 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6aa535-3eca-428b-991d-9efcb43ba2f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:54:52.875059 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6aa535-3eca-428b-991d-9efcb43ba2f9 service nova] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:54:52.885431 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1146/2287] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:54:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:54:55.930954 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27251f5-e073-48f0-bdf0-bc38bc369790 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:54:55.931441 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27251f5-e073-48f0-bdf0-bc38bc369790 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:54:55.931717 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27251f5-e073-48f0-bdf0-bc38bc369790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:54:55.952973 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-a27251f5-e073-48f0-bdf0-bc38bc369790 None None] MFA Rules not processed for user `56427a32e1044299a1098c911849e601`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:54:55.954225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-a27251f5-e073-48f0-bdf0-bc38bc369790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:54:56.020299 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1142/2288] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:54:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:55:02.880579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=64 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:55:06.011392 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=67 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:55:10.237213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d5646-21f5-4545-bb94-90d1f5c66baf None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:10.237749 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d5646-21f5-4545-bb94-90d1f5c66baf None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:10.237931 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d5646-21f5-4545-bb94-90d1f5c66baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:10.257552 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-258d5646-21f5-4545-bb94-90d1f5c66baf None None] MFA Rules not processed for user `f7302b734e88409a8d905eb8003fdbe3`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:55:10.258761 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-258d5646-21f5-4545-bb94-90d1f5c66baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:55:10.316418 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1147/2289] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:55:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:55:20.308582 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=25 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:55:25.511099 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d8542-9c63-429c-8dbc-fbbf677ef1fe None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:25.511587 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d8542-9c63-429c-8dbc-fbbf677ef1fe None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:25.511685 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d8542-9c63-429c-8dbc-fbbf677ef1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:25.532000 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-bd9d8542-9c63-429c-8dbc-fbbf677ef1fe None None] MFA Rules not processed for user `d26e7b888a914f93a69b179f9e7ad14e`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:55:25.533276 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-bd9d8542-9c63-429c-8dbc-fbbf677ef1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:55:25.588319 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1143/2290] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:55:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:55:34.603264 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d5646-21f5-4545-bb94-90d1f5c66baf None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:55:34.606335 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-258d5646-21f5-4545-bb94-90d1f5c66baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:55:34.688526 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d5646-21f5-4545-bb94-90d1f5c66baf None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:55:34.694455 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa55fde-6734-4f79-8a03-5e4d9d30acca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:55:34.695449 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa55fde-6734-4f79-8a03-5e4d9d30acca service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:34.695912 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa55fde-6734-4f79-8a03-5e4d9d30acca service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:34.696876 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa55fde-6734-4f79-8a03-5e4d9d30acca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:34.704027 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-bfa55fde-6734-4f79-8a03-5e4d9d30acca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:55:34.727696 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa55fde-6734-4f79-8a03-5e4d9d30acca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:55:34.729403 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa55fde-6734-4f79-8a03-5e4d9d30acca service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:55:34.743501 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1148/2291] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:55:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:55:34.756474 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d8542-9c63-429c-8dbc-fbbf677ef1fe None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:55:34.758045 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-bd9d8542-9c63-429c-8dbc-fbbf677ef1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:55:34.773464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d8542-9c63-429c-8dbc-fbbf677ef1fe None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:55:34.778135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a31d30-2dcb-4499-9bb3-7ef46a30194b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:55:34.778832 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a31d30-2dcb-4499-9bb3-7ef46a30194b service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:34.779287 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a31d30-2dcb-4499-9bb3-7ef46a30194b service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:34.779865 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a31d30-2dcb-4499-9bb3-7ef46a30194b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:34.781815 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-e8a31d30-2dcb-4499-9bb3-7ef46a30194b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:55:34.798807 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a31d30-2dcb-4499-9bb3-7ef46a30194b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:55:34.800248 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a31d30-2dcb-4499-9bb3-7ef46a30194b service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:55:34.812748 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1144/2292] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:55:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:55:35.499431 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3058b-b527-43e5-b053-946062ebf47c None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:35.499720 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3058b-b527-43e5-b053-946062ebf47c None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:35.499997 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3058b-b527-43e5-b053-946062ebf47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:35.519251 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-c8e3058b-b527-43e5-b053-946062ebf47c None None] MFA Rules not processed for user `c880ab908c114c5897d11aad7fb48607`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:55:35.520465 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-c8e3058b-b527-43e5-b053-946062ebf47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:55:35.583145 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1149/2293] 10.222.0.70 () {58 vars in 967 bytes} [Mon Aug 8 17:55:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:55:35.759824 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a31d30-2dcb-4499-9bb3-7ef46a30194b service neutron] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:55:35.762867 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-e8a31d30-2dcb-4499-9bb3-7ef46a30194b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:55:35.838611 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a31d30-2dcb-4499-9bb3-7ef46a30194b service neutron] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:55:35.846784 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b59036-b2c0-44fe-8a62-bfd7e54fa2e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b83ff95ed44f35af2e412a700ca567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:55:35.847408 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b59036-b2c0-44fe-8a62-bfd7e54fa2e2 service swift] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:35.847692 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b59036-b2c0-44fe-8a62-bfd7e54fa2e2 service swift] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:35.847959 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b59036-b2c0-44fe-8a62-bfd7e54fa2e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:35.857469 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b59036-b2c0-44fe-8a62-bfd7e54fa2e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:55:35.859075 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b59036-b2c0-44fe-8a62-bfd7e54fa2e2 service swift] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:55:35.867734 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1145/2294] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Aug 8 17:55:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 17:55:36.380563 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ee702-1b60-46a5-8715-295b10396384 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:36.381134 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ee702-1b60-46a5-8715-295b10396384 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:36.381355 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ee702-1b60-46a5-8715-295b10396384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:36.403214 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-bc2ee702-1b60-46a5-8715-295b10396384 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:55:36.404464 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-bc2ee702-1b60-46a5-8715-295b10396384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:55:36.416639 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1150/2295] 10.222.0.75 () {58 vars in 1016 bytes} [Mon Aug 8 17:55:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:55:36.432273 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b59036-b2c0-44fe-8a62-bfd7e54fa2e2 service swift] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:55:36.444721 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b59036-b2c0-44fe-8a62-bfd7e54fa2e2 service swift] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:55:36.456551 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84d54c-b956-4ad1-ba0d-47100993f25d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:55:36.457430 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84d54c-b956-4ad1-ba0d-47100993f25d service nova] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:36.457709 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84d54c-b956-4ad1-ba0d-47100993f25d service nova] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:36.457980 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84d54c-b956-4ad1-ba0d-47100993f25d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:36.468056 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84d54c-b956-4ad1-ba0d-47100993f25d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:55:36.469686 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84d54c-b956-4ad1-ba0d-47100993f25d service nova] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:55:36.479519 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1146/2296] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:55:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:55:40.912165 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793d984-6911-4d0a-8270-09cd5070ced8 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:40.912165 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793d984-6911-4d0a-8270-09cd5070ced8 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:40.912165 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793d984-6911-4d0a-8270-09cd5070ced8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:40.931517 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-f793d984-6911-4d0a-8270-09cd5070ced8 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:55:40.934138 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-f793d984-6911-4d0a-8270-09cd5070ced8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:55:40.982558 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1151/2297] 10.222.0.75 () {58 vars in 1016 bytes} [Mon Aug 8 17:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:55:40.997849 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84d54c-b956-4ad1-ba0d-47100993f25d service nova] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:55:41.017358 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84d54c-b956-4ad1-ba0d-47100993f25d service nova] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:55:41.053302 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b2e4e-8755-4f65-9097-4171f546f599 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:55:41.054539 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b2e4e-8755-4f65-9097-4171f546f599 service nova] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:41.054989 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b2e4e-8755-4f65-9097-4171f546f599 service nova] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:41.055413 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b2e4e-8755-4f65-9097-4171f546f599 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:41.071007 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b2e4e-8755-4f65-9097-4171f546f599 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:55:41.077267 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b2e4e-8755-4f65-9097-4171f546f599 service nova] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:55:41.155373 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1147/2298] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:55:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:55:42.582761 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1097b21-0af8-4c00-8f5c-c8e47dcc665e None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:42.583696 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1097b21-0af8-4c00-8f5c-c8e47dcc665e None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:42.583975 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1097b21-0af8-4c00-8f5c-c8e47dcc665e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:42.603563 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-d1097b21-0af8-4c00-8f5c-c8e47dcc665e None None] MFA Rules not processed for user `81e69ba7717f4956bf327292fdf98cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:55:42.605307 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-d1097b21-0af8-4c00-8f5c-c8e47dcc665e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:55:42.670980 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1152/2299] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:55:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:55:44.817940 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b2e4e-8755-4f65-9097-4171f546f599 service nova] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:55:44.823168 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb03dc6-942f-4537-ac07-72d428a1ef52 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:44.824247 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb03dc6-942f-4537-ac07-72d428a1ef52 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:44.824962 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb03dc6-942f-4537-ac07-72d428a1ef52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:44.852417 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b2e4e-8755-4f65-9097-4171f546f599 service nova] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:55:44.866025 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1240220-7cb3-42e3-8ee9-dee16d9c6ff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:55:44.866708 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1240220-7cb3-42e3-8ee9-dee16d9c6ff1 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:44.867071 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1240220-7cb3-42e3-8ee9-dee16d9c6ff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:44.874316 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1240220-7cb3-42e3-8ee9-dee16d9c6ff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:44.881329 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-ebb03dc6-942f-4537-ac07-72d428a1ef52 None None] MFA Rules not processed for user `7d84d1d6d0ab469f905d01d8a1276dec`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:55:44.883052 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-ebb03dc6-942f-4537-ac07-72d428a1ef52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:55:44.887333 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-e1240220-7cb3-42e3-8ee9-dee16d9c6ff1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:55:44.930004 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1240220-7cb3-42e3-8ee9-dee16d9c6ff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:55:44.930463 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:55:44.931441 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1240220-7cb3-42e3-8ee9-dee16d9c6ff1 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:55:44.955240 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1148/2300] 10.222.0.70 () {60 vars in 1396 bytes} [Mon Aug 8 17:55:44 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:55:44.956538 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62d81b-338b-49ad-856a-3c2d178883eb None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:44.956823 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62d81b-338b-49ad-856a-3c2d178883eb None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:44.964070 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62d81b-338b-49ad-856a-3c2d178883eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:44.964491 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1153/2301] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:55:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:55:44.990387 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-5d62d81b-338b-49ad-856a-3c2d178883eb None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:55:44.991513 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-5d62d81b-338b-49ad-856a-3c2d178883eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:55:45.000565 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1149/2302] 10.222.0.75 () {58 vars in 1016 bytes} [Mon Aug 8 17:55:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:55:45.250442 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb03dc6-942f-4537-ac07-72d428a1ef52 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:55:45.265791 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb03dc6-942f-4537-ac07-72d428a1ef52 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:55:45.273002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4de7f2-b2fc-4a16-a6c6-44ce2dba0636 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:55:45.274188 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4de7f2-b2fc-4a16-a6c6-44ce2dba0636 service nova] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:45.274692 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4de7f2-b2fc-4a16-a6c6-44ce2dba0636 service nova] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:45.275172 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4de7f2-b2fc-4a16-a6c6-44ce2dba0636 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:45.286659 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4de7f2-b2fc-4a16-a6c6-44ce2dba0636 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:55:45.288913 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4de7f2-b2fc-4a16-a6c6-44ce2dba0636 service nova] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:55:45.307910 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1154/2303] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:55:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:55:46.780789 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62d81b-338b-49ad-856a-3c2d178883eb None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:55:46.782874 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-5d62d81b-338b-49ad-856a-3c2d178883eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:55:46.793924 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=85 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:55:46.801452 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62d81b-338b-49ad-856a-3c2d178883eb None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:55:46.808760 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbcba70-6b7d-4191-8f14-556bb4a5cb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:55:46.809533 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcba70-6b7d-4191-8f14-556bb4a5cb32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:46.810024 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcba70-6b7d-4191-8f14-556bb4a5cb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:46.810523 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcba70-6b7d-4191-8f14-556bb4a5cb32 admin admin] PATH_INFO: `/v3/users/a3b26e0fa6fe44fe9240106ee5445527` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:46.812206 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbcba70-6b7d-4191-8f14-556bb4a5cb32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3b26e0fa6fe44fe9240106ee5445527)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:55:46.814311 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbcba70-6b7d-4191-8f14-556bb4a5cb32 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:55:47.029927 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-7bbcba70-6b7d-4191-8f14-556bb4a5cb32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3b26e0fa6fe44fe9240106ee5445527'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:55:47.118618 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-7bbcba70-6b7d-4191-8f14-556bb4a5cb32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3b26e0fa6fe44fe9240106ee5445527'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:55:47.119398 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-7bbcba70-6b7d-4191-8f14-556bb4a5cb32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3b26e0fa6fe44fe9240106ee5445527'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:55:47.120073 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-7bbcba70-6b7d-4191-8f14-556bb4a5cb32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3b26e0fa6fe44fe9240106ee5445527'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:55:47.127733 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-7bbcba70-6b7d-4191-8f14-556bb4a5cb32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3b26e0fa6fe44fe9240106ee5445527'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:55:47.146226 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1150/2304] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:55:46 2022] DELETE /identity/v3/users/a3b26e0fa6fe44fe9240106ee5445527 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:55:47.389072 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4de7f2-b2fc-4a16-a6c6-44ce2dba0636 service nova] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:55:47.401917 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4de7f2-b2fc-4a16-a6c6-44ce2dba0636 service nova] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:55:47.462707 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504dbef1-cc13-48a6-8956-21a97a43496a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:55:47.463438 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504dbef1-cc13-48a6-8956-21a97a43496a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:47.463784 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504dbef1-cc13-48a6-8956-21a97a43496a admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:47.464066 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504dbef1-cc13-48a6-8956-21a97a43496a admin admin] PATH_INFO: `/v3/projects/e228efa1fb8648a7b9eb6c11a0518a54` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:47.465399 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504dbef1-cc13-48a6-8956-21a97a43496a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e228efa1fb8648a7b9eb6c11a0518a54)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:55:47.467659 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504dbef1-cc13-48a6-8956-21a97a43496a admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:55:47.603240 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-504dbef1-cc13-48a6-8956-21a97a43496a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e228efa1fb8648a7b9eb6c11a0518a54', 'request_id': 'req-504dbef1-cc13-48a6-8956-21a97a43496a'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:55:47.609252 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-504dbef1-cc13-48a6-8956-21a97a43496a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e228efa1fb8648a7b9eb6c11a0518a54', 'request_id': 'req-504dbef1-cc13-48a6-8956-21a97a43496a'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:55:47.693749 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-504dbef1-cc13-48a6-8956-21a97a43496a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e228efa1fb8648a7b9eb6c11a0518a54', 'request_id': 'req-504dbef1-cc13-48a6-8956-21a97a43496a'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:55:47.706574 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-504dbef1-cc13-48a6-8956-21a97a43496a admin admin] The token cache is being invalidate because project e228efa1fb8648a7b9eb6c11a0518a54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:55:47.706895 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-504dbef1-cc13-48a6-8956-21a97a43496a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:55:47.707567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-504dbef1-cc13-48a6-8956-21a97a43496a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:55:47.709156 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1155/2305] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:55:47 2022] DELETE /identity/v3/projects/e228efa1fb8648a7b9eb6c11a0518a54 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:55:47.713235 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbcba70-6b7d-4191-8f14-556bb4a5cb32 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:55:47.714697 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-7bbcba70-6b7d-4191-8f14-556bb4a5cb32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:55:47.728494 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbcba70-6b7d-4191-8f14-556bb4a5cb32 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:55:47.787561 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873723f-1e72-4e0a-896f-7eb5c819cb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:55:47.788180 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873723f-1e72-4e0a-896f-7eb5c819cb60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:47.788557 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873723f-1e72-4e0a-896f-7eb5c819cb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:47.788836 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873723f-1e72-4e0a-896f-7eb5c819cb60 admin admin] PATH_INFO: `/v3/users/cfdccb06ca1643e4965766bab25bf1f1` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:47.789987 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873723f-1e72-4e0a-896f-7eb5c819cb60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfdccb06ca1643e4965766bab25bf1f1)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:55:47.792591 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873723f-1e72-4e0a-896f-7eb5c819cb60 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:55:48.005483 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-1873723f-1e72-4e0a-896f-7eb5c819cb60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfdccb06ca1643e4965766bab25bf1f1'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:55:48.106476 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-1873723f-1e72-4e0a-896f-7eb5c819cb60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfdccb06ca1643e4965766bab25bf1f1'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:55:48.107112 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-1873723f-1e72-4e0a-896f-7eb5c819cb60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfdccb06ca1643e4965766bab25bf1f1'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:55:48.107723 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-1873723f-1e72-4e0a-896f-7eb5c819cb60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfdccb06ca1643e4965766bab25bf1f1'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:55:48.116895 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-1873723f-1e72-4e0a-896f-7eb5c819cb60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfdccb06ca1643e4965766bab25bf1f1'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:55:48.136914 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:55:48.148329 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1151/2306] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:55:47 2022] DELETE /identity/v3/users/cfdccb06ca1643e4965766bab25bf1f1 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:55:48.415460 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504dbef1-cc13-48a6-8956-21a97a43496a admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:55:48.417601 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-504dbef1-cc13-48a6-8956-21a97a43496a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:55:48.433239 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504dbef1-cc13-48a6-8956-21a97a43496a admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:55:48.492059 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533466b-e8e2-4245-b225-0c887c9fcbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:55:48.492601 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533466b-e8e2-4245-b225-0c887c9fcbaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:48.492881 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533466b-e8e2-4245-b225-0c887c9fcbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:48.493201 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533466b-e8e2-4245-b225-0c887c9fcbaf admin admin] PATH_INFO: `/v3/projects/7d051f5d761341fa9a4179922c0f5f8d` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:48.494428 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4533466b-e8e2-4245-b225-0c887c9fcbaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d051f5d761341fa9a4179922c0f5f8d)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:55:48.496913 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4533466b-e8e2-4245-b225-0c887c9fcbaf admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:55:48.499230 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:55:48.639425 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-4533466b-e8e2-4245-b225-0c887c9fcbaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d051f5d761341fa9a4179922c0f5f8d', 'request_id': 'req-4533466b-e8e2-4245-b225-0c887c9fcbaf'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:55:48.645159 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-4533466b-e8e2-4245-b225-0c887c9fcbaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d051f5d761341fa9a4179922c0f5f8d', 'request_id': 'req-4533466b-e8e2-4245-b225-0c887c9fcbaf'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:55:48.719008 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-4533466b-e8e2-4245-b225-0c887c9fcbaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d051f5d761341fa9a4179922c0f5f8d', 'request_id': 'req-4533466b-e8e2-4245-b225-0c887c9fcbaf'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:55:48.734555 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-4533466b-e8e2-4245-b225-0c887c9fcbaf admin admin] The token cache is being invalidate because project 7d051f5d761341fa9a4179922c0f5f8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:55:48.734855 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-4533466b-e8e2-4245-b225-0c887c9fcbaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:55:48.735541 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-4533466b-e8e2-4245-b225-0c887c9fcbaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:55:48.737146 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1156/2307] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:55:48 2022] DELETE /identity/v3/projects/7d051f5d761341fa9a4179922c0f5f8d => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:55:48.742055 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f383703-fe4e-43cd-b5f2-42a5134f1a54 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:48.742403 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f383703-fe4e-43cd-b5f2-42a5134f1a54 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:48.742625 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f383703-fe4e-43cd-b5f2-42a5134f1a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:48.767775 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-3f383703-fe4e-43cd-b5f2-42a5134f1a54 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:55:48.769005 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-3f383703-fe4e-43cd-b5f2-42a5134f1a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:55:48.839126 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1152/2308] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:55:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:55:48.848174 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984dbe58-5d83-4469-846d-810b38d7823f None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:48.848174 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984dbe58-5d83-4469-846d-810b38d7823f None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:48.848460 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984dbe58-5d83-4469-846d-810b38d7823f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:48.870108 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-984dbe58-5d83-4469-846d-810b38d7823f None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:55:48.871324 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-984dbe58-5d83-4469-846d-810b38d7823f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:55:48.879384 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1157/2309] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:55:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:55:48.883675 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f383703-fe4e-43cd-b5f2-42a5134f1a54 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:55:48.893624 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f383703-fe4e-43cd-b5f2-42a5134f1a54 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:55:48.898202 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0912dd-68fa-476a-9e01-12a7ed37a792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:55:48.898820 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0912dd-68fa-476a-9e01-12a7ed37a792 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:48.899173 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0912dd-68fa-476a-9e01-12a7ed37a792 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:48.899386 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0912dd-68fa-476a-9e01-12a7ed37a792 admin admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:48.900024 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0912dd-68fa-476a-9e01-12a7ed37a792 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:55:48.900321 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0912dd-68fa-476a-9e01-12a7ed37a792 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:55:48.902432 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0912dd-68fa-476a-9e01-12a7ed37a792 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:55:48.914064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1153/2310] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:55:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:55:48.919154 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984dbe58-5d83-4469-846d-810b38d7823f None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:55:48.928658 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984dbe58-5d83-4469-846d-810b38d7823f None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:55:48.933593 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0559eb-9c31-4a34-a5c4-91e440b6a953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:55:48.934212 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0559eb-9c31-4a34-a5c4-91e440b6a953 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:48.934484 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0559eb-9c31-4a34-a5c4-91e440b6a953 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:48.934756 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0559eb-9c31-4a34-a5c4-91e440b6a953 admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:48.935379 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0559eb-9c31-4a34-a5c4-91e440b6a953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:55:48.937385 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0559eb-9c31-4a34-a5c4-91e440b6a953 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:55:49.015314 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1158/2311] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:55:48 2022] POST /identity/v3/projects => generated 369 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:55:49.020434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0912dd-68fa-476a-9e01-12a7ed37a792 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:55:49.031248 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0912dd-68fa-476a-9e01-12a7ed37a792 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:55:49.087595 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96e0c4-56cb-4fd2-8c78-d08f23e231a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:55:49.088739 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96e0c4-56cb-4fd2-8c78-d08f23e231a9 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:49.089023 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96e0c4-56cb-4fd2-8c78-d08f23e231a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:49.089325 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96e0c4-56cb-4fd2-8c78-d08f23e231a9 admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:49.090011 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96e0c4-56cb-4fd2-8c78-d08f23e231a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:55:49.092270 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96e0c4-56cb-4fd2-8c78-d08f23e231a9 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:55:49.200376 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1154/2312] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:55:49 2022] POST /identity/v3/users => generated 285 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:55:49.201633 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0559eb-9c31-4a34-a5c4-91e440b6a953 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:55:49.211918 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0559eb-9c31-4a34-a5c4-91e440b6a953 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:55:49.217978 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0634124-3f84-4ac7-bdc9-021b519fd504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:55:49.218576 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0634124-3f84-4ac7-bdc9-021b519fd504 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:49.218859 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0634124-3f84-4ac7-bdc9-021b519fd504 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:49.219127 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0634124-3f84-4ac7-bdc9-021b519fd504 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:49.219772 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0634124-3f84-4ac7-bdc9-021b519fd504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:55:49.221448 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0634124-3f84-4ac7-bdc9-021b519fd504 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:55:49.232817 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1159/2313] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:55:49.236777 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96e0c4-56cb-4fd2-8c78-d08f23e231a9 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:55:49.247069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96e0c4-56cb-4fd2-8c78-d08f23e231a9 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:55:49.251705 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096988a5-8821-4d07-897a-294a7114b70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:55:49.252301 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096988a5-8821-4d07-897a-294a7114b70e admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:49.252585 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096988a5-8821-4d07-897a-294a7114b70e admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:49.252853 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096988a5-8821-4d07-897a-294a7114b70e admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:49.253544 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096988a5-8821-4d07-897a-294a7114b70e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:55:49.255151 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096988a5-8821-4d07-897a-294a7114b70e admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:55:49.267129 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1155/2314] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:55:49.271446 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0634124-3f84-4ac7-bdc9-021b519fd504 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:55:49.282387 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0634124-3f84-4ac7-bdc9-021b519fd504 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:55:49.287609 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6ebd8-24fe-47fd-b144-e4aa17ec1f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:55:49.288434 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6ebd8-24fe-47fd-b144-e4aa17ec1f8e admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:49.288663 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6ebd8-24fe-47fd-b144-e4aa17ec1f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:49.288942 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6ebd8-24fe-47fd-b144-e4aa17ec1f8e admin admin] PATH_INFO: `/v3/projects/d837ee9c5edb438c88b870a4945fac0a/users/3195fa3ae35a463da7bebb512dc0d817/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:49.304015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6ebd8-24fe-47fd-b144-e4aa17ec1f8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d837ee9c5edb438c88b870a4945fac0a, user_id=3195fa3ae35a463da7bebb512dc0d817, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:55:49.306720 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6ebd8-24fe-47fd-b144-e4aa17ec1f8e admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:55:49.394878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1160/2315] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:55:49 2022] PUT /identity/v3/projects/d837ee9c5edb438c88b870a4945fac0a/users/3195fa3ae35a463da7bebb512dc0d817/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:55:49.403291 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ea795-92a1-419e-8272-c3a65ce18c37 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:49.405989 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ea795-92a1-419e-8272-c3a65ce18c37 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:49.405989 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ea795-92a1-419e-8272-c3a65ce18c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:49.434554 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-f86ea795-92a1-419e-8272-c3a65ce18c37 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:55:49.436489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-f86ea795-92a1-419e-8272-c3a65ce18c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:55:49.498900 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:55:49.507267 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1156/2316] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:55:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:55:49.517591 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6ebd8-24fe-47fd-b144-e4aa17ec1f8e admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:55:49.519368 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-bdf6ebd8-24fe-47fd-b144-e4aa17ec1f8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:55:49.577046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6ebd8-24fe-47fd-b144-e4aa17ec1f8e admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:55:49.580780 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d1a72-bc9a-4083-9d28-676f1e042e49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:55:49.581413 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d1a72-bc9a-4083-9d28-676f1e042e49 service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:49.581695 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d1a72-bc9a-4083-9d28-676f1e042e49 service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:49.581968 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d1a72-bc9a-4083-9d28-676f1e042e49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:49.591036 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d1a72-bc9a-4083-9d28-676f1e042e49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:55:49.592723 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d1a72-bc9a-4083-9d28-676f1e042e49 service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:55:49.602082 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1161/2317] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:55:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:55:50.182689 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd9bde-4e22-4bf8-8a53-00814403e099 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:50.183228 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd9bde-4e22-4bf8-8a53-00814403e099 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:50.184429 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd9bde-4e22-4bf8-8a53-00814403e099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:50.204146 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-37cd9bde-4e22-4bf8-8a53-00814403e099 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:55:50.209570 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-37cd9bde-4e22-4bf8-8a53-00814403e099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:55:50.213202 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1157/2318] 10.222.0.75 () {58 vars in 1016 bytes} [Mon Aug 8 17:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:55:50.233458 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d1a72-bc9a-4083-9d28-676f1e042e49 service neutron] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:55:50.238085 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-cc9d1a72-bc9a-4083-9d28-676f1e042e49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:55:50.272666 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:55:50.353921 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d1a72-bc9a-4083-9d28-676f1e042e49 service neutron] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:55:50.360184 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b016b65-7152-4cb1-bdd0-a2eed85efa7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:55:50.360805 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b016b65-7152-4cb1-bdd0-a2eed85efa7e service nova] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:50.361122 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b016b65-7152-4cb1-bdd0-a2eed85efa7e service nova] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:50.361402 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b016b65-7152-4cb1-bdd0-a2eed85efa7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:50.370466 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b016b65-7152-4cb1-bdd0-a2eed85efa7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:55:50.372717 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b016b65-7152-4cb1-bdd0-a2eed85efa7e service nova] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:55:50.382836 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1162/2319] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:55:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:55:51.267780 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd9bde-4e22-4bf8-8a53-00814403e099 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:55:51.280024 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd9bde-4e22-4bf8-8a53-00814403e099 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:55:51.285440 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99143d95-7e0b-4b90-9107-65b4d1c13809 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:55:51.286431 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99143d95-7e0b-4b90-9107-65b4d1c13809 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:51.287210 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99143d95-7e0b-4b90-9107-65b4d1c13809 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:51.287678 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99143d95-7e0b-4b90-9107-65b4d1c13809 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:51.290000 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-99143d95-7e0b-4b90-9107-65b4d1c13809 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:55:51.378113 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99143d95-7e0b-4b90-9107-65b4d1c13809 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:55:51.381686 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99143d95-7e0b-4b90-9107-65b4d1c13809 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:55:51.401079 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1158/2320] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:55:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:55:53.477197 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931108a-dfeb-47e3-b7ea-ec3a170e13c8 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:53.477656 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931108a-dfeb-47e3-b7ea-ec3a170e13c8 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:53.477769 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931108a-dfeb-47e3-b7ea-ec3a170e13c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:53.521303 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-3931108a-dfeb-47e3-b7ea-ec3a170e13c8 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:55:53.525910 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-3931108a-dfeb-47e3-b7ea-ec3a170e13c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:55:53.535790 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1163/2321] 10.222.0.75 () {58 vars in 1016 bytes} [Mon Aug 8 17:55:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:55:53.559501 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99143d95-7e0b-4b90-9107-65b4d1c13809 service neutron] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:55:53.576179 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99143d95-7e0b-4b90-9107-65b4d1c13809 service neutron] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:55:53.586134 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246ec2a-7d18-4e09-afd7-5a18b7996b49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:55:53.586919 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246ec2a-7d18-4e09-afd7-5a18b7996b49 service nova] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:53.587287 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246ec2a-7d18-4e09-afd7-5a18b7996b49 service nova] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:53.587564 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246ec2a-7d18-4e09-afd7-5a18b7996b49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:53.611030 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246ec2a-7d18-4e09-afd7-5a18b7996b49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:55:53.615366 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246ec2a-7d18-4e09-afd7-5a18b7996b49 service nova] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:55:53.627722 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1159/2322] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:55:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:55:58.251432 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2012f-b400-4ade-84e0-f276880d4a02 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:58.251998 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2012f-b400-4ade-84e0-f276880d4a02 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:58.251998 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2012f-b400-4ade-84e0-f276880d4a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:58.282737 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-f9d2012f-b400-4ade-84e0-f276880d4a02 None None] MFA Rules not processed for user `3195fa3ae35a463da7bebb512dc0d817`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:55:58.283915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-f9d2012f-b400-4ade-84e0-f276880d4a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:55:58.350947 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1164/2323] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:55:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:55:58.355483 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246ec2a-7d18-4e09-afd7-5a18b7996b49 service nova] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:55:58.365780 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246ec2a-7d18-4e09-afd7-5a18b7996b49 service nova] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:55:58.371199 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372cde5-a2ad-4a7b-817c-61ae5d5e99c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:55:58.371976 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372cde5-a2ad-4a7b-817c-61ae5d5e99c9 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:58.372367 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372cde5-a2ad-4a7b-817c-61ae5d5e99c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:58.372749 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372cde5-a2ad-4a7b-817c-61ae5d5e99c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:58.373532 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372cde5-a2ad-4a7b-817c-61ae5d5e99c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:55:58.375559 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372cde5-a2ad-4a7b-817c-61ae5d5e99c9 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:55:58.447758 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1160/2324] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:55:58 2022] POST /identity/v3/projects => generated 373 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:55:58.449578 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d2012f-b400-4ade-84e0-f276880d4a02 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:55:58.461124 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d2012f-b400-4ade-84e0-f276880d4a02 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:55:58.530969 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94eedf8-ac21-443e-bcc7-69662f51e901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:55:58.531764 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94eedf8-ac21-443e-bcc7-69662f51e901 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:58.532152 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94eedf8-ac21-443e-bcc7-69662f51e901 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:58.532885 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94eedf8-ac21-443e-bcc7-69662f51e901 admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:58.533319 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94eedf8-ac21-443e-bcc7-69662f51e901 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:55:58.535341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94eedf8-ac21-443e-bcc7-69662f51e901 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:55:58.610687 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1165/2325] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:55:58 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:55:58.614690 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372cde5-a2ad-4a7b-817c-61ae5d5e99c9 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:55:58.627404 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372cde5-a2ad-4a7b-817c-61ae5d5e99c9 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:55:58.634190 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90615c06-d051-4393-8f99-d646b0117aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:55:58.635171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90615c06-d051-4393-8f99-d646b0117aaf admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:58.635602 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90615c06-d051-4393-8f99-d646b0117aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:58.636762 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90615c06-d051-4393-8f99-d646b0117aaf admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:58.637895 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90615c06-d051-4393-8f99-d646b0117aaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:55:58.639889 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90615c06-d051-4393-8f99-d646b0117aaf admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:55:58.671074 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1161/2326] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:55:58.672843 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94eedf8-ac21-443e-bcc7-69662f51e901 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:55:58.683490 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94eedf8-ac21-443e-bcc7-69662f51e901 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:55:58.688322 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507d009-6fe9-4cda-8a24-219d70e4fd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:55:58.688978 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507d009-6fe9-4cda-8a24-219d70e4fd8c admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:58.689292 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507d009-6fe9-4cda-8a24-219d70e4fd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:58.689595 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507d009-6fe9-4cda-8a24-219d70e4fd8c admin admin] PATH_INFO: `/v3/projects/19a534e77d64404cbdc8ef85d8f428b4/users/7bc10122aa9444dfa5bb6067a9b46ae3/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:58.705149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507d009-6fe9-4cda-8a24-219d70e4fd8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=19a534e77d64404cbdc8ef85d8f428b4, user_id=7bc10122aa9444dfa5bb6067a9b46ae3, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:55:58.708392 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507d009-6fe9-4cda-8a24-219d70e4fd8c admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:55:58.782046 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1166/2327] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:55:58 2022] PUT /identity/v3/projects/19a534e77d64404cbdc8ef85d8f428b4/users/7bc10122aa9444dfa5bb6067a9b46ae3/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:55:58.785708 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90615c06-d051-4393-8f99-d646b0117aaf admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:55:58.796745 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90615c06-d051-4393-8f99-d646b0117aaf admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:55:58.860990 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffceac-4b31-401a-b2c4-a3e60d5f2b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:55:58.861638 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffceac-4b31-401a-b2c4-a3e60d5f2b04 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:58.861923 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffceac-4b31-401a-b2c4-a3e60d5f2b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:58.862200 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffceac-4b31-401a-b2c4-a3e60d5f2b04 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:58.862850 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dffceac-4b31-401a-b2c4-a3e60d5f2b04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:55:58.864457 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dffceac-4b31-401a-b2c4-a3e60d5f2b04 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:55:58.875844 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1162/2328] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:55:58.880068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507d009-6fe9-4cda-8a24-219d70e4fd8c admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:55:58.887436 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:55:58.891688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507d009-6fe9-4cda-8a24-219d70e4fd8c admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:55:58.897251 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5835840-75d3-4277-aca6-c2d5fabdb00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:55:58.898011 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5835840-75d3-4277-aca6-c2d5fabdb00a admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:58.898365 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5835840-75d3-4277-aca6-c2d5fabdb00a admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:58.898741 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5835840-75d3-4277-aca6-c2d5fabdb00a admin admin] PATH_INFO: `/v3/projects/19a534e77d64404cbdc8ef85d8f428b4/users/7bc10122aa9444dfa5bb6067a9b46ae3/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:58.900893 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5835840-75d3-4277-aca6-c2d5fabdb00a admin admin] RBAC: Authorizing `identity:create_grant(project_id=19a534e77d64404cbdc8ef85d8f428b4, user_id=7bc10122aa9444dfa5bb6067a9b46ae3, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:55:58.904507 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5835840-75d3-4277-aca6-c2d5fabdb00a admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:55:58.918263 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1167/2329] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:55:58 2022] PUT /identity/v3/projects/19a534e77d64404cbdc8ef85d8f428b4/users/7bc10122aa9444dfa5bb6067a9b46ae3/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:55:59.232276 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffceac-4b31-401a-b2c4-a3e60d5f2b04 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:55:59.288716 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:55:59.323914 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffceac-4b31-401a-b2c4-a3e60d5f2b04 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:55:59.415553 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44828d30-fa6f-4ba3-893e-454c339d6380 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:55:59.421200 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44828d30-fa6f-4ba3-893e-454c339d6380 service nova] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:55:59.421200 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44828d30-fa6f-4ba3-893e-454c339d6380 service nova] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:55:59.421200 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44828d30-fa6f-4ba3-893e-454c339d6380 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:55:59.421200 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-44828d30-fa6f-4ba3-893e-454c339d6380 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:55:59.482621 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44828d30-fa6f-4ba3-893e-454c339d6380 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:55:59.484287 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44828d30-fa6f-4ba3-893e-454c339d6380 service nova] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:55:59.494325 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1163/2330] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:55:59 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:56:04.499733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5835840-75d3-4277-aca6-c2d5fabdb00a admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:56:04.577565 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5835840-75d3-4277-aca6-c2d5fabdb00a admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:56:04.581986 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423864f2-e96e-401f-a0a5-b6296b18f20b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:56:04.582870 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423864f2-e96e-401f-a0a5-b6296b18f20b service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:56:04.583223 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423864f2-e96e-401f-a0a5-b6296b18f20b service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:56:04.583668 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423864f2-e96e-401f-a0a5-b6296b18f20b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:56:04.585662 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-423864f2-e96e-401f-a0a5-b6296b18f20b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:56:04.599127 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423864f2-e96e-401f-a0a5-b6296b18f20b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:56:04.600588 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423864f2-e96e-401f-a0a5-b6296b18f20b service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:56:04.609993 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1168/2331] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:56:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:56:05.461259 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f872561-626c-428a-b369-c8ab70da62ad None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:56:05.461810 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f872561-626c-428a-b369-c8ab70da62ad None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:56:05.461935 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f872561-626c-428a-b369-c8ab70da62ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:56:05.491256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-5f872561-626c-428a-b369-c8ab70da62ad None None] MFA Rules not processed for user `7bc10122aa9444dfa5bb6067a9b46ae3`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:56:05.492504 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-5f872561-626c-428a-b369-c8ab70da62ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:56:05.570270 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1164/2332] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:56:05 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:56:05.583503 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423864f2-e96e-401f-a0a5-b6296b18f20b service neutron] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:56:05.584972 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-423864f2-e96e-401f-a0a5-b6296b18f20b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:56:05.603234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423864f2-e96e-401f-a0a5-b6296b18f20b service neutron] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:56:05.610380 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75057e1d-5bbc-4738-a933-9ab4b5b862f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:56:05.610982 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75057e1d-5bbc-4738-a933-9ab4b5b862f5 service nova] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:56:05.611257 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75057e1d-5bbc-4738-a933-9ab4b5b862f5 service nova] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:56:05.611527 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75057e1d-5bbc-4738-a933-9ab4b5b862f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:56:05.677660 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75057e1d-5bbc-4738-a933-9ab4b5b862f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:56:05.679573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75057e1d-5bbc-4738-a933-9ab4b5b862f5 service nova] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:56:05.689692 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1169/2333] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:56:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:56:08.592411 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f872561-626c-428a-b369-c8ab70da62ad None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:56:08.600551 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:56:08.608300 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f872561-626c-428a-b369-c8ab70da62ad None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:56:08.614709 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff79abf-6a46-4166-8c50-f345a696ff1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:56:08.615603 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff79abf-6a46-4166-8c50-f345a696ff1b service nova] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:56:08.615963 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff79abf-6a46-4166-8c50-f345a696ff1b service nova] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:56:08.616428 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff79abf-6a46-4166-8c50-f345a696ff1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:56:08.618797 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-1ff79abf-6a46-4166-8c50-f345a696ff1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:56:08.633885 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff79abf-6a46-4166-8c50-f345a696ff1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:56:08.636794 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff79abf-6a46-4166-8c50-f345a696ff1b service nova] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:56:08.650757 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1165/2334] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:56:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:56:08.737812 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7b9ac-4e42-4e36-8fa5-768c4dd0fbac None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:56:08.738586 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7b9ac-4e42-4e36-8fa5-768c4dd0fbac None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:56:08.738586 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7b9ac-4e42-4e36-8fa5-768c4dd0fbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:56:08.801019 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-cea7b9ac-4e42-4e36-8fa5-768c4dd0fbac None None] MFA Rules not processed for user `3195fa3ae35a463da7bebb512dc0d817`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:56:08.802888 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-cea7b9ac-4e42-4e36-8fa5-768c4dd0fbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:56:08.818326 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1170/2335] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:56:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:56:18.121357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ff047-3eea-41e3-a73c-d141d7b30a06 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:56:18.121357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ff047-3eea-41e3-a73c-d141d7b30a06 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:56:18.121357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ff047-3eea-41e3-a73c-d141d7b30a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:56:18.141712 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-981ff047-3eea-41e3-a73c-d141d7b30a06 None None] MFA Rules not processed for user `c880ab908c114c5897d11aad7fb48607`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:56:18.142933 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-981ff047-3eea-41e3-a73c-d141d7b30a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:56:18.204454 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1166/2336] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Aug 8 17:56:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:56:18.217551 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7b9ac-4e42-4e36-8fa5-768c4dd0fbac None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:56:18.219794 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-cea7b9ac-4e42-4e36-8fa5-768c4dd0fbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:56:18.289273 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7b9ac-4e42-4e36-8fa5-768c4dd0fbac None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:56:18.294548 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019d987-c20e-416c-8233-69a3543d1b1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b83ff95ed44f35af2e412a700ca567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:56:18.295157 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019d987-c20e-416c-8233-69a3543d1b1b service swift] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:56:18.296526 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019d987-c20e-416c-8233-69a3543d1b1b service swift] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:56:18.296526 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019d987-c20e-416c-8233-69a3543d1b1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:56:18.305804 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019d987-c20e-416c-8233-69a3543d1b1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:56:18.307444 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019d987-c20e-416c-8233-69a3543d1b1b service swift] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:56:18.318494 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1171/2337] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Aug 8 17:56:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 17:56:28.196468 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=30 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:56:28.313725 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=92,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:56:28.614238 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ff047-3eea-41e3-a73c-d141d7b30a06 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:56:28.624623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ff047-3eea-41e3-a73c-d141d7b30a06 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:56:28.628678 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0bc12-b53b-47ac-8e7d-34fdafc2af29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:56:28.629501 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0bc12-b53b-47ac-8e7d-34fdafc2af29 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:56:28.629963 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0bc12-b53b-47ac-8e7d-34fdafc2af29 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:56:28.630441 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0bc12-b53b-47ac-8e7d-34fdafc2af29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:56:28.632435 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-70a0bc12-b53b-47ac-8e7d-34fdafc2af29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:56:28.658137 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0bc12-b53b-47ac-8e7d-34fdafc2af29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:56:28.659597 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0bc12-b53b-47ac-8e7d-34fdafc2af29 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:56:28.668437 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1167/2338] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:56:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:56:28.884224 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019d987-c20e-416c-8233-69a3543d1b1b service swift] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:56:28.885810 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-c019d987-c20e-416c-8233-69a3543d1b1b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:56:28.966021 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019d987-c20e-416c-8233-69a3543d1b1b service swift] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:56:28.971693 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e734957-b534-4491-a0cb-dce2b3bb3c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:56:28.972435 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e734957-b534-4491-a0cb-dce2b3bb3c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:56:28.972723 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e734957-b534-4491-a0cb-dce2b3bb3c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:56:28.973001 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e734957-b534-4491-a0cb-dce2b3bb3c4f admin admin] PATH_INFO: `/v3/users/f7302b734e88409a8d905eb8003fdbe3` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:56:28.974168 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e734957-b534-4491-a0cb-dce2b3bb3c4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7302b734e88409a8d905eb8003fdbe3)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:56:28.976102 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e734957-b534-4491-a0cb-dce2b3bb3c4f admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:56:29.178796 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-4e734957-b534-4491-a0cb-dce2b3bb3c4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7302b734e88409a8d905eb8003fdbe3'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:56:29.279975 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-4e734957-b534-4491-a0cb-dce2b3bb3c4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7302b734e88409a8d905eb8003fdbe3'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:56:29.280566 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-4e734957-b534-4491-a0cb-dce2b3bb3c4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7302b734e88409a8d905eb8003fdbe3'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:56:29.281212 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-4e734957-b534-4491-a0cb-dce2b3bb3c4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7302b734e88409a8d905eb8003fdbe3'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:56:29.288991 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-4e734957-b534-4491-a0cb-dce2b3bb3c4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7302b734e88409a8d905eb8003fdbe3'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:56:29.307538 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1172/2339] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:56:28 2022] DELETE /identity/v3/users/f7302b734e88409a8d905eb8003fdbe3 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:56:29.439868 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0bc12-b53b-47ac-8e7d-34fdafc2af29 service neutron] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:56:29.441370 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-70a0bc12-b53b-47ac-8e7d-34fdafc2af29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:56:29.514954 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0bc12-b53b-47ac-8e7d-34fdafc2af29 service neutron] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:56:29.578691 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a0752-87ed-45dd-b6da-e472af5ec439 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68717c19e74e434da825d9b1d6ca202a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:56:29.579291 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a0752-87ed-45dd-b6da-e472af5ec439 service placement] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:56:29.579568 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a0752-87ed-45dd-b6da-e472af5ec439 service placement] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:56:29.579836 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a0752-87ed-45dd-b6da-e472af5ec439 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:56:29.581578 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-4d9a0752-87ed-45dd-b6da-e472af5ec439 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:56:29.593496 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a0752-87ed-45dd-b6da-e472af5ec439 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:56:29.595090 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a0752-87ed-45dd-b6da-e472af5ec439 service placement] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:56:29.602635 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e734957-b534-4491-a0cb-dce2b3bb3c4f admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:56:29.604199 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-4e734957-b534-4491-a0cb-dce2b3bb3c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:56:29.606712 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1168/2340] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:56:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:56:29.687478 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e734957-b534-4491-a0cb-dce2b3bb3c4f admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:56:29.692195 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c376163-7000-4bcd-805f-490cdabbccda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:56:29.692858 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c376163-7000-4bcd-805f-490cdabbccda admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:56:29.693180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c376163-7000-4bcd-805f-490cdabbccda admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:56:29.693457 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c376163-7000-4bcd-805f-490cdabbccda admin admin] PATH_INFO: `/v3/projects/8840a21c7f2a41d394c0777e63d76478` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:56:29.694711 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c376163-7000-4bcd-805f-490cdabbccda admin admin] RBAC: Authorizing `identity:delete_project(project_id=8840a21c7f2a41d394c0777e63d76478)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:56:29.697019 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c376163-7000-4bcd-805f-490cdabbccda admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:56:29.727070 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:56:29.832053 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-2c376163-7000-4bcd-805f-490cdabbccda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8840a21c7f2a41d394c0777e63d76478', 'request_id': 'req-2c376163-7000-4bcd-805f-490cdabbccda'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:56:29.842016 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-2c376163-7000-4bcd-805f-490cdabbccda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8840a21c7f2a41d394c0777e63d76478', 'request_id': 'req-2c376163-7000-4bcd-805f-490cdabbccda'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:56:29.903756 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-2c376163-7000-4bcd-805f-490cdabbccda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8840a21c7f2a41d394c0777e63d76478', 'request_id': 'req-2c376163-7000-4bcd-805f-490cdabbccda'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:56:29.918318 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-2c376163-7000-4bcd-805f-490cdabbccda admin admin] The token cache is being invalidate because project 8840a21c7f2a41d394c0777e63d76478 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:56:29.918546 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-2c376163-7000-4bcd-805f-490cdabbccda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:56:29.919208 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-2c376163-7000-4bcd-805f-490cdabbccda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:56:29.925685 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1173/2341] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:56:29 2022] DELETE /identity/v3/projects/8840a21c7f2a41d394c0777e63d76478 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:56:34.559944 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a0752-87ed-45dd-b6da-e472af5ec439 service placement] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:56:34.562736 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-4d9a0752-87ed-45dd-b6da-e472af5ec439 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:56:34.646492 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a0752-87ed-45dd-b6da-e472af5ec439 service placement] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:56:34.660151 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:56:34.711165 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90134886-8ba0-4c06-a1e0-e1eaea34c313 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:56:34.711699 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90134886-8ba0-4c06-a1e0-e1eaea34c313 service nova] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:56:34.711986 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90134886-8ba0-4c06-a1e0-e1eaea34c313 service nova] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:56:34.712265 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90134886-8ba0-4c06-a1e0-e1eaea34c313 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:56:34.714075 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-90134886-8ba0-4c06-a1e0-e1eaea34c313 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:56:34.729054 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90134886-8ba0-4c06-a1e0-e1eaea34c313 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:56:34.730778 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90134886-8ba0-4c06-a1e0-e1eaea34c313 service nova] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:56:34.743293 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1169/2342] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:56:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:56:35.803210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c376163-7000-4bcd-805f-490cdabbccda admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:56:35.805436 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-2c376163-7000-4bcd-805f-490cdabbccda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:56:35.822306 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90134886-8ba0-4c06-a1e0-e1eaea34c313 service nova] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:56:35.829348 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-90134886-8ba0-4c06-a1e0-e1eaea34c313 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:56:35.829472 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c376163-7000-4bcd-805f-490cdabbccda admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:56:35.833644 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494636a-a690-4e6c-aff3-fcf0c2400dd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:56:35.834259 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494636a-a690-4e6c-aff3-fcf0c2400dd2 service nova] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:56:35.834541 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494636a-a690-4e6c-aff3-fcf0c2400dd2 service nova] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:56:35.834816 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494636a-a690-4e6c-aff3-fcf0c2400dd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:56:35.836645 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-0494636a-a690-4e6c-aff3-fcf0c2400dd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:56:35.853861 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494636a-a690-4e6c-aff3-fcf0c2400dd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:56:35.855302 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494636a-a690-4e6c-aff3-fcf0c2400dd2 service nova] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:56:35.866326 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1174/2343] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:56:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:56:35.891762 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90134886-8ba0-4c06-a1e0-e1eaea34c313 service nova] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:56:35.895517 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fbf10-7446-40c2-8050-2da852486ac1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:56:35.896216 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fbf10-7446-40c2-8050-2da852486ac1 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:56:35.896516 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fbf10-7446-40c2-8050-2da852486ac1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:56:35.896975 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fbf10-7446-40c2-8050-2da852486ac1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:56:35.899061 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-d05fbf10-7446-40c2-8050-2da852486ac1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:56:35.909597 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05fbf10-7446-40c2-8050-2da852486ac1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:56:35.911056 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05fbf10-7446-40c2-8050-2da852486ac1 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:56:35.919294 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1170/2344] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:56:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:56:42.552465 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1564c-35ba-4f95-8bdf-8c39df32f2be None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:56:42.561377 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1564c-35ba-4f95-8bdf-8c39df32f2be None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:56:42.561377 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1564c-35ba-4f95-8bdf-8c39df32f2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:56:42.572829 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-5aa1564c-35ba-4f95-8bdf-8c39df32f2be None None] MFA Rules not processed for user `c880ab908c114c5897d11aad7fb48607`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:56:42.574066 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-5aa1564c-35ba-4f95-8bdf-8c39df32f2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:56:42.637841 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1175/2345] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Aug 8 17:56:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:56:42.673411 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fbf10-7446-40c2-8050-2da852486ac1 service neutron] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:56:42.675834 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-d05fbf10-7446-40c2-8050-2da852486ac1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:56:42.782443 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fbf10-7446-40c2-8050-2da852486ac1 service neutron] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:56:42.787403 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb866df-92a5-420b-9a3b-30bb47cfdd9f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b83ff95ed44f35af2e412a700ca567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:56:42.788012 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb866df-92a5-420b-9a3b-30bb47cfdd9f service swift] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:56:42.788323 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb866df-92a5-420b-9a3b-30bb47cfdd9f service swift] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:56:42.788582 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb866df-92a5-420b-9a3b-30bb47cfdd9f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:56:42.796944 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb866df-92a5-420b-9a3b-30bb47cfdd9f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:56:42.798610 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb866df-92a5-420b-9a3b-30bb47cfdd9f service swift] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:56:42.807001 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1171/2346] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Aug 8 17:56:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 17:56:52.629290 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:DELETE=7,keystone:SELECT=46,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:56:52.803331 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=84 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:56:55.230272 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1564c-35ba-4f95-8bdf-8c39df32f2be None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:56:55.243433 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1564c-35ba-4f95-8bdf-8c39df32f2be None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:56:55.249606 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ca904-bea3-4903-92e6-f5d4a2bfd80a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:56:55.250205 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ca904-bea3-4903-92e6-f5d4a2bfd80a service nova] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:56:55.250488 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ca904-bea3-4903-92e6-f5d4a2bfd80a service nova] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:56:55.250764 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ca904-bea3-4903-92e6-f5d4a2bfd80a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:56:55.252498 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-279ca904-bea3-4903-92e6-f5d4a2bfd80a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:56:55.313348 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ca904-bea3-4903-92e6-f5d4a2bfd80a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:56:55.313617 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ca904-bea3-4903-92e6-f5d4a2bfd80a service nova] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:56:55.322747 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1176/2347] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:56:55 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:56:58.081200 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb866df-92a5-420b-9a3b-30bb47cfdd9f service swift] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:56:58.091128 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb866df-92a5-420b-9a3b-30bb47cfdd9f service swift] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:56:58.094919 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41036a8f-5fd2-49e7-acd3-42f825bd313a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:56:58.095618 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41036a8f-5fd2-49e7-acd3-42f825bd313a service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:56:58.095901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41036a8f-5fd2-49e7-acd3-42f825bd313a service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:56:58.096170 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41036a8f-5fd2-49e7-acd3-42f825bd313a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:56:58.097992 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-41036a8f-5fd2-49e7-acd3-42f825bd313a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:56:58.174821 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41036a8f-5fd2-49e7-acd3-42f825bd313a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:56:58.174821 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41036a8f-5fd2-49e7-acd3-42f825bd313a service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:56:58.187598 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1172/2348] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:56:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:56:58.645021 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4ba7b-5aaa-4fe7-bc18-384b1fd16f8b None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:56:58.645976 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4ba7b-5aaa-4fe7-bc18-384b1fd16f8b None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:56:58.646408 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4ba7b-5aaa-4fe7-bc18-384b1fd16f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:56:58.668763 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-9cb4ba7b-5aaa-4fe7-bc18-384b1fd16f8b None None] MFA Rules not processed for user `c880ab908c114c5897d11aad7fb48607`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:56:58.670338 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-9cb4ba7b-5aaa-4fe7-bc18-384b1fd16f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:56:58.678628 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1177/2349] 10.222.0.70 () {58 vars in 967 bytes} [Mon Aug 8 17:56:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:56:58.699794 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41036a8f-5fd2-49e7-acd3-42f825bd313a service neutron] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:56:58.713552 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41036a8f-5fd2-49e7-acd3-42f825bd313a service neutron] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:56:58.720277 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9aa901-393e-4773-8ca6-3bec3a29c565 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67b83ff95ed44f35af2e412a700ca567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:56:58.721822 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9aa901-393e-4773-8ca6-3bec3a29c565 service swift] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:56:58.729698 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9aa901-393e-4773-8ca6-3bec3a29c565 service swift] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:56:58.729698 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9aa901-393e-4773-8ca6-3bec3a29c565 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:56:58.731385 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9aa901-393e-4773-8ca6-3bec3a29c565 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:56:58.733569 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9aa901-393e-4773-8ca6-3bec3a29c565 service swift] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:56:58.742135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1173/2350] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Aug 8 17:56:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 17:57:05.401542 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4ba7b-5aaa-4fe7-bc18-384b1fd16f8b None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:05.412516 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4ba7b-5aaa-4fe7-bc18-384b1fd16f8b None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:05.417357 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123f426-e020-439e-acbc-c33fc59af739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:05.417987 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123f426-e020-439e-acbc-c33fc59af739 service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:05.418263 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123f426-e020-439e-acbc-c33fc59af739 service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:05.418532 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123f426-e020-439e-acbc-c33fc59af739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:05.421289 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-f123f426-e020-439e-acbc-c33fc59af739 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:05.490323 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f123f426-e020-439e-acbc-c33fc59af739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:05.491768 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f123f426-e020-439e-acbc-c33fc59af739 service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:05.502142 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1178/2351] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:57:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:57:08.738842 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=36 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:09.230786 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9aa901-393e-4773-8ca6-3bec3a29c565 service swift] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:09.232663 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-ad9aa901-393e-4773-8ca6-3bec3a29c565 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:09.328253 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9aa901-393e-4773-8ca6-3bec3a29c565 service swift] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:09.333347 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5480450-687b-411d-bee9-7495d9509759 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68717c19e74e434da825d9b1d6ca202a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:09.333954 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5480450-687b-411d-bee9-7495d9509759 service placement] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:09.340680 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5480450-687b-411d-bee9-7495d9509759 service placement] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:09.340680 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5480450-687b-411d-bee9-7495d9509759 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:09.340680 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-d5480450-687b-411d-bee9-7495d9509759 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:09.348024 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5480450-687b-411d-bee9-7495d9509759 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:09.349662 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5480450-687b-411d-bee9-7495d9509759 service placement] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:09.359951 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1174/2352] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:57:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:57:09.372460 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123f426-e020-439e-acbc-c33fc59af739 service neutron] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:09.375760 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-f123f426-e020-439e-acbc-c33fc59af739 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:09.391450 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123f426-e020-439e-acbc-c33fc59af739 service neutron] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:09.399219 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9921b7b-f83c-45fb-aa31-63d87e128547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:09.399852 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9921b7b-f83c-45fb-aa31-63d87e128547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:09.400128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9921b7b-f83c-45fb-aa31-63d87e128547 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:09.400434 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9921b7b-f83c-45fb-aa31-63d87e128547 admin admin] PATH_INFO: `/v3/users/81e69ba7717f4956bf327292fdf98cb5` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:09.401666 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9921b7b-f83c-45fb-aa31-63d87e128547 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81e69ba7717f4956bf327292fdf98cb5)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:09.403826 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9921b7b-f83c-45fb-aa31-63d87e128547 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:09.586822 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-d9921b7b-f83c-45fb-aa31-63d87e128547 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81e69ba7717f4956bf327292fdf98cb5'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:09.661473 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-d9921b7b-f83c-45fb-aa31-63d87e128547 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81e69ba7717f4956bf327292fdf98cb5'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:09.662152 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-d9921b7b-f83c-45fb-aa31-63d87e128547 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81e69ba7717f4956bf327292fdf98cb5'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:09.663042 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-d9921b7b-f83c-45fb-aa31-63d87e128547 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81e69ba7717f4956bf327292fdf98cb5'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:09.681227 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-d9921b7b-f83c-45fb-aa31-63d87e128547 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81e69ba7717f4956bf327292fdf98cb5'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:09.699764 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:09.710560 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1179/2353] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:57:09 2022] DELETE /identity/v3/users/81e69ba7717f4956bf327292fdf98cb5 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:10.215523 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5480450-687b-411d-bee9-7495d9509759 service placement] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:10.230236 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5480450-687b-411d-bee9-7495d9509759 service placement] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:10.341776 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bc8ae-782b-4760-9921-338627d840d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:10.342609 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bc8ae-782b-4760-9921-338627d840d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:10.343153 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bc8ae-782b-4760-9921-338627d840d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:10.346501 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bc8ae-782b-4760-9921-338627d840d0 admin admin] PATH_INFO: `/v3/projects/847f631fd84f47cfbce86a3d59b27da4` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:10.346501 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94bc8ae-782b-4760-9921-338627d840d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=847f631fd84f47cfbce86a3d59b27da4)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:10.347343 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94bc8ae-782b-4760-9921-338627d840d0 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:10.464362 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e94bc8ae-782b-4760-9921-338627d840d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '847f631fd84f47cfbce86a3d59b27da4', 'request_id': 'req-e94bc8ae-782b-4760-9921-338627d840d0'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:10.473484 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e94bc8ae-782b-4760-9921-338627d840d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '847f631fd84f47cfbce86a3d59b27da4', 'request_id': 'req-e94bc8ae-782b-4760-9921-338627d840d0'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:10.536634 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e94bc8ae-782b-4760-9921-338627d840d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '847f631fd84f47cfbce86a3d59b27da4', 'request_id': 'req-e94bc8ae-782b-4760-9921-338627d840d0'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:10.549475 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e94bc8ae-782b-4760-9921-338627d840d0 admin admin] The token cache is being invalidate because project 847f631fd84f47cfbce86a3d59b27da4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:57:10.549852 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e94bc8ae-782b-4760-9921-338627d840d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:10.550567 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e94bc8ae-782b-4760-9921-338627d840d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:10.552188 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1175/2354] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:57:10 2022] DELETE /identity/v3/projects/847f631fd84f47cfbce86a3d59b27da4 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:10.557270 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5cf13-9a9c-4b80-9de6-9a614886696f None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:10.557789 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5cf13-9a9c-4b80-9de6-9a614886696f None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:10.557921 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5cf13-9a9c-4b80-9de6-9a614886696f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:10.579757 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-12a5cf13-9a9c-4b80-9de6-9a614886696f None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:10.580918 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-12a5cf13-9a9c-4b80-9de6-9a614886696f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:10.687696 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1180/2355] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:10.695885 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701af7b-bea7-45a7-8d5b-61a86a7cabec None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:10.696176 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701af7b-bea7-45a7-8d5b-61a86a7cabec None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:10.696458 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701af7b-bea7-45a7-8d5b-61a86a7cabec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:10.729714 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-4701af7b-bea7-45a7-8d5b-61a86a7cabec None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:10.732433 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-4701af7b-bea7-45a7-8d5b-61a86a7cabec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:10.746370 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1176/2356] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:10.751451 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5cf13-9a9c-4b80-9de6-9a614886696f None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:10.761992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5cf13-9a9c-4b80-9de6-9a614886696f None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:10.770619 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03942e4c-81bf-45d7-9e06-5ad7ea4414cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:10.771485 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03942e4c-81bf-45d7-9e06-5ad7ea4414cf admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:10.771941 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03942e4c-81bf-45d7-9e06-5ad7ea4414cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:10.772401 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03942e4c-81bf-45d7-9e06-5ad7ea4414cf admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:10.773471 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03942e4c-81bf-45d7-9e06-5ad7ea4414cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:57:10.773931 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03942e4c-81bf-45d7-9e06-5ad7ea4414cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:10.776296 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03942e4c-81bf-45d7-9e06-5ad7ea4414cf admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:10.803504 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1181/2357] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:57:10.808053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701af7b-bea7-45a7-8d5b-61a86a7cabec None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:10.822984 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701af7b-bea7-45a7-8d5b-61a86a7cabec None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:10.840285 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daee1c8-e342-4cdc-bff4-89466ee1b0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:10.841365 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daee1c8-e342-4cdc-bff4-89466ee1b0c2 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:10.841803 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daee1c8-e342-4cdc-bff4-89466ee1b0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:10.843208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daee1c8-e342-4cdc-bff4-89466ee1b0c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:10.844233 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daee1c8-e342-4cdc-bff4-89466ee1b0c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:10.846863 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daee1c8-e342-4cdc-bff4-89466ee1b0c2 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:10.872069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:10.976254 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1177/2358] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:57:10 2022] POST /identity/v3/projects => generated 365 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:57:10.980608 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03942e4c-81bf-45d7-9e06-5ad7ea4414cf admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:10.991853 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03942e4c-81bf-45d7-9e06-5ad7ea4414cf admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:11.123254 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d8853-6eb2-4932-882b-bc95fd8f2f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:11.124780 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d8853-6eb2-4932-882b-bc95fd8f2f58 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:11.125100 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d8853-6eb2-4932-882b-bc95fd8f2f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:11.125430 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d8853-6eb2-4932-882b-bc95fd8f2f58 admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:11.126241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d8853-6eb2-4932-882b-bc95fd8f2f58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:11.128558 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d8853-6eb2-4932-882b-bc95fd8f2f58 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:11.248144 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1182/2359] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:57:10 2022] POST /identity/v3/users => generated 283 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:57:11.253415 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daee1c8-e342-4cdc-bff4-89466ee1b0c2 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:11.264484 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daee1c8-e342-4cdc-bff4-89466ee1b0c2 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:11.270140 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5f7a9-a56c-47af-8175-6ac833746d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:11.271401 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5f7a9-a56c-47af-8175-6ac833746d23 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:11.271997 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5f7a9-a56c-47af-8175-6ac833746d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:11.272277 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5f7a9-a56c-47af-8175-6ac833746d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:11.272931 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5f7a9-a56c-47af-8175-6ac833746d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:11.274776 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5f7a9-a56c-47af-8175-6ac833746d23 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:11.287088 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1178/2360] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:57:11.291507 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d8853-6eb2-4932-882b-bc95fd8f2f58 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:11.304239 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d8853-6eb2-4932-882b-bc95fd8f2f58 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:11.313316 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf4424-2b5c-4db4-b49b-7bef303eda50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:11.313947 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf4424-2b5c-4db4-b49b-7bef303eda50 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:11.314239 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf4424-2b5c-4db4-b49b-7bef303eda50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:11.314516 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf4424-2b5c-4db4-b49b-7bef303eda50 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:11.315171 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf4424-2b5c-4db4-b49b-7bef303eda50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:11.316870 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf4424-2b5c-4db4-b49b-7bef303eda50 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:11.329587 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1183/2361] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:57:11.333553 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5f7a9-a56c-47af-8175-6ac833746d23 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:11.346861 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5f7a9-a56c-47af-8175-6ac833746d23 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:11.353153 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0540058-d423-49b1-8e41-3ca6b3718598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:11.354283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0540058-d423-49b1-8e41-3ca6b3718598 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:11.354648 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0540058-d423-49b1-8e41-3ca6b3718598 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:11.354829 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0540058-d423-49b1-8e41-3ca6b3718598 admin admin] PATH_INFO: `/v3/projects/8aa51ff77f23425fadf268ec9ee9da0d/users/56b3584ab37a4f83b9defff06c4462e3/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:11.383762 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0540058-d423-49b1-8e41-3ca6b3718598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aa51ff77f23425fadf268ec9ee9da0d, user_id=56b3584ab37a4f83b9defff06c4462e3, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:11.387574 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0540058-d423-49b1-8e41-3ca6b3718598 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:11.485807 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1179/2362] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:57:11 2022] PUT /identity/v3/projects/8aa51ff77f23425fadf268ec9ee9da0d/users/56b3584ab37a4f83b9defff06c4462e3/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:11.497360 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a69e8-006f-4a93-bd9e-c4162133a91a None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:11.497640 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a69e8-006f-4a93-bd9e-c4162133a91a None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:11.497920 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a69e8-006f-4a93-bd9e-c4162133a91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:11.544958 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-c34a69e8-006f-4a93-bd9e-c4162133a91a None None] MFA Rules not processed for user `56b3584ab37a4f83b9defff06c4462e3`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:11.547649 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-c34a69e8-006f-4a93-bd9e-c4162133a91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:11.629688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:11.642869 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1184/2363] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:11.647334 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0540058-d423-49b1-8e41-3ca6b3718598 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:11.726590 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0540058-d423-49b1-8e41-3ca6b3718598 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:11.731715 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d18eb-1e81-437d-9c70-c778529123fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:11.732338 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d18eb-1e81-437d-9c70-c778529123fe admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:11.732620 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d18eb-1e81-437d-9c70-c778529123fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:11.733286 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d18eb-1e81-437d-9c70-c778529123fe admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:11.734477 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d18eb-1e81-437d-9c70-c778529123fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:11.736395 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d18eb-1e81-437d-9c70-c778529123fe admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:11.805863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a69e8-006f-4a93-bd9e-c4162133a91a None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:11.807447 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1180/2364] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:57:11 2022] POST /identity/v3/projects => generated 365 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:57:11.819800 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a69e8-006f-4a93-bd9e-c4162133a91a None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:11.894088 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08850a1f-65e1-4a61-b7f1-922cbce9a253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:11.895038 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08850a1f-65e1-4a61-b7f1-922cbce9a253 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:11.895328 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08850a1f-65e1-4a61-b7f1-922cbce9a253 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:11.895595 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08850a1f-65e1-4a61-b7f1-922cbce9a253 admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:11.896323 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08850a1f-65e1-4a61-b7f1-922cbce9a253 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:11.898262 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08850a1f-65e1-4a61-b7f1-922cbce9a253 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:11.968952 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1185/2365] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:57:11 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:57:11.972629 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d18eb-1e81-437d-9c70-c778529123fe admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:11.989617 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d18eb-1e81-437d-9c70-c778529123fe admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:11.995762 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe3b3e-4c7e-492e-a583-4d25f175e4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:11.996388 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe3b3e-4c7e-492e-a583-4d25f175e4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:11.999381 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe3b3e-4c7e-492e-a583-4d25f175e4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:11.999381 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe3b3e-4c7e-492e-a583-4d25f175e4c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:11.999381 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe3b3e-4c7e-492e-a583-4d25f175e4c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:11.999905 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe3b3e-4c7e-492e-a583-4d25f175e4c1 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:12.011340 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1181/2366] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:57:12.016665 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08850a1f-65e1-4a61-b7f1-922cbce9a253 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:12.027610 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08850a1f-65e1-4a61-b7f1-922cbce9a253 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:12.032729 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ce995-e41c-4c0f-941a-f0009573e257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:12.033916 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ce995-e41c-4c0f-941a-f0009573e257 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:12.034200 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ce995-e41c-4c0f-941a-f0009573e257 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:12.034481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ce995-e41c-4c0f-941a-f0009573e257 admin admin] PATH_INFO: `/v3/projects/f43c8defff264448b22bb3c9e316d291/users/1473fc1b07a74017b416524ee70bc196/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:12.057764 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ce995-e41c-4c0f-941a-f0009573e257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f43c8defff264448b22bb3c9e316d291, user_id=1473fc1b07a74017b416524ee70bc196, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:12.057764 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ce995-e41c-4c0f-941a-f0009573e257 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:12.127131 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1186/2367] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:57:12 2022] PUT /identity/v3/projects/f43c8defff264448b22bb3c9e316d291/users/1473fc1b07a74017b416524ee70bc196/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:12.131846 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe3b3e-4c7e-492e-a583-4d25f175e4c1 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:12.144945 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe3b3e-4c7e-492e-a583-4d25f175e4c1 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:12.211905 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d32256-4536-4cfa-ba8f-3b1d88bc22ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:12.212768 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d32256-4536-4cfa-ba8f-3b1d88bc22ba admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:12.213149 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d32256-4536-4cfa-ba8f-3b1d88bc22ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:12.213516 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d32256-4536-4cfa-ba8f-3b1d88bc22ba admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:12.214291 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d32256-4536-4cfa-ba8f-3b1d88bc22ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:12.216235 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d32256-4536-4cfa-ba8f-3b1d88bc22ba admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:12.230126 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1182/2368] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:57:12.235595 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ce995-e41c-4c0f-941a-f0009573e257 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:12.248791 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ce995-e41c-4c0f-941a-f0009573e257 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:12.254340 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c2f55-9d68-4d86-ace1-e0164ffb7880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:12.256291 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c2f55-9d68-4d86-ace1-e0164ffb7880 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:12.256574 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c2f55-9d68-4d86-ace1-e0164ffb7880 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:12.256847 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c2f55-9d68-4d86-ace1-e0164ffb7880 admin admin] PATH_INFO: `/v3/projects/f43c8defff264448b22bb3c9e316d291/users/1473fc1b07a74017b416524ee70bc196/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:12.258878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c2f55-9d68-4d86-ace1-e0164ffb7880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f43c8defff264448b22bb3c9e316d291, user_id=1473fc1b07a74017b416524ee70bc196, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:12.261556 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c2f55-9d68-4d86-ace1-e0164ffb7880 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:12.273365 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1187/2369] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:57:12 2022] PUT /identity/v3/projects/f43c8defff264448b22bb3c9e316d291/users/1473fc1b07a74017b416524ee70bc196/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:12.285067 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4fbb6-b7ba-4240-b859-39d1565f77ac None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:12.285611 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4fbb6-b7ba-4240-b859-39d1565f77ac None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:12.285708 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4fbb6-b7ba-4240-b859-39d1565f77ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:12.313807 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-b3b4fbb6-b7ba-4240-b859-39d1565f77ac None None] MFA Rules not processed for user `1473fc1b07a74017b416524ee70bc196`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:12.315016 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-b3b4fbb6-b7ba-4240-b859-39d1565f77ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:12.328336 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:12.387244 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1183/2370] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:57:12.399564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c2f55-9d68-4d86-ace1-e0164ffb7880 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:12.401249 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-b85c2f55-9d68-4d86-ace1-e0164ffb7880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:12.461851 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c2f55-9d68-4d86-ace1-e0164ffb7880 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:12.465909 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9f48a-3381-4709-98f6-d445e317d7e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:12.466528 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9f48a-3381-4709-98f6-d445e317d7e7 service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:12.466809 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9f48a-3381-4709-98f6-d445e317d7e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:12.467083 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9f48a-3381-4709-98f6-d445e317d7e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:12.476939 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9f48a-3381-4709-98f6-d445e317d7e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:12.478484 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9f48a-3381-4709-98f6-d445e317d7e7 service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:12.488118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1188/2371] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:57:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:57:13.513750 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4fbb6-b7ba-4240-b859-39d1565f77ac None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:13.604462 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4fbb6-b7ba-4240-b859-39d1565f77ac None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:13.606285 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db907469-9b5a-4375-89f1-6f9729af3632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:13.606923 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db907469-9b5a-4375-89f1-6f9729af3632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:13.607211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db907469-9b5a-4375-89f1-6f9729af3632 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:13.607486 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db907469-9b5a-4375-89f1-6f9729af3632 admin admin] PATH_INFO: `/v3/users/56b3584ab37a4f83b9defff06c4462e3` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:13.608901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db907469-9b5a-4375-89f1-6f9729af3632 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56b3584ab37a4f83b9defff06c4462e3)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:13.610923 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db907469-9b5a-4375-89f1-6f9729af3632 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:13.832904 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-db907469-9b5a-4375-89f1-6f9729af3632 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56b3584ab37a4f83b9defff06c4462e3'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:13.912435 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-db907469-9b5a-4375-89f1-6f9729af3632 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56b3584ab37a4f83b9defff06c4462e3'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:13.913160 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-db907469-9b5a-4375-89f1-6f9729af3632 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56b3584ab37a4f83b9defff06c4462e3'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:13.913785 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-db907469-9b5a-4375-89f1-6f9729af3632 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56b3584ab37a4f83b9defff06c4462e3'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:13.922637 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-db907469-9b5a-4375-89f1-6f9729af3632 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56b3584ab37a4f83b9defff06c4462e3'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:13.940695 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1184/2372] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:57:13 2022] DELETE /identity/v3/users/56b3584ab37a4f83b9defff06c4462e3 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:13.945339 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92098c5-15db-4560-b2fa-34c5c5fbf782 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:13.945916 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92098c5-15db-4560-b2fa-34c5c5fbf782 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:13.945916 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92098c5-15db-4560-b2fa-34c5c5fbf782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:13.964193 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-a92098c5-15db-4560-b2fa-34c5c5fbf782 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:13.965671 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-a92098c5-15db-4560-b2fa-34c5c5fbf782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:14.012808 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:14.028041 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1189/2373] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:14.038064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db907469-9b5a-4375-89f1-6f9729af3632 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:14.039404 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-db907469-9b5a-4375-89f1-6f9729af3632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:14.074812 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:14.097940 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db907469-9b5a-4375-89f1-6f9729af3632 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:14.102036 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d59ef-6706-49ee-b67d-da796b41104a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:14.102642 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d59ef-6706-49ee-b67d-da796b41104a service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:14.102927 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d59ef-6706-49ee-b67d-da796b41104a service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:14.103203 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d59ef-6706-49ee-b67d-da796b41104a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:14.113100 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d59ef-6706-49ee-b67d-da796b41104a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:14.114536 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d59ef-6706-49ee-b67d-da796b41104a service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:14.124603 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1185/2374] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:57:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:57:14.795078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92098c5-15db-4560-b2fa-34c5c5fbf782 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:14.796485 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-a92098c5-15db-4560-b2fa-34c5c5fbf782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:14.809639 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92098c5-15db-4560-b2fa-34c5c5fbf782 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:14.815336 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a34285-9ab2-4985-80f8-63e2fa51f7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:14.816655 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a34285-9ab2-4985-80f8-63e2fa51f7a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:14.816943 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a34285-9ab2-4985-80f8-63e2fa51f7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:14.817252 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a34285-9ab2-4985-80f8-63e2fa51f7a8 admin admin] PATH_INFO: `/v3/projects/8aa51ff77f23425fadf268ec9ee9da0d` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:14.818523 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a34285-9ab2-4985-80f8-63e2fa51f7a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aa51ff77f23425fadf268ec9ee9da0d)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:14.820506 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a34285-9ab2-4985-80f8-63e2fa51f7a8 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:14.923789 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-06a34285-9ab2-4985-80f8-63e2fa51f7a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aa51ff77f23425fadf268ec9ee9da0d', 'request_id': 'req-06a34285-9ab2-4985-80f8-63e2fa51f7a8'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:14.929862 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-06a34285-9ab2-4985-80f8-63e2fa51f7a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aa51ff77f23425fadf268ec9ee9da0d', 'request_id': 'req-06a34285-9ab2-4985-80f8-63e2fa51f7a8'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:14.975877 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-06a34285-9ab2-4985-80f8-63e2fa51f7a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aa51ff77f23425fadf268ec9ee9da0d', 'request_id': 'req-06a34285-9ab2-4985-80f8-63e2fa51f7a8'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:14.988584 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-06a34285-9ab2-4985-80f8-63e2fa51f7a8 admin admin] The token cache is being invalidate because project 8aa51ff77f23425fadf268ec9ee9da0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:57:14.988895 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-06a34285-9ab2-4985-80f8-63e2fa51f7a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:14.989590 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-06a34285-9ab2-4985-80f8-63e2fa51f7a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:14.991076 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1190/2375] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:57:14 2022] DELETE /identity/v3/projects/8aa51ff77f23425fadf268ec9ee9da0d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:14.995871 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d59ef-6706-49ee-b67d-da796b41104a service neutron] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:15.006173 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d59ef-6706-49ee-b67d-da796b41104a service neutron] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:15.064554 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db87ac1-904e-4c4c-8327-74973292380c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:15.065324 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db87ac1-904e-4c4c-8327-74973292380c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:15.065696 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db87ac1-904e-4c4c-8327-74973292380c admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:15.068740 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db87ac1-904e-4c4c-8327-74973292380c admin admin] PATH_INFO: `/v3/users/1473fc1b07a74017b416524ee70bc196` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:15.070298 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db87ac1-904e-4c4c-8327-74973292380c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1473fc1b07a74017b416524ee70bc196)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:15.072198 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db87ac1-904e-4c4c-8327-74973292380c admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:15.255036 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-8db87ac1-904e-4c4c-8327-74973292380c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1473fc1b07a74017b416524ee70bc196'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:15.369408 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-8db87ac1-904e-4c4c-8327-74973292380c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1473fc1b07a74017b416524ee70bc196'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:15.370023 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-8db87ac1-904e-4c4c-8327-74973292380c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1473fc1b07a74017b416524ee70bc196'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:15.370623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-8db87ac1-904e-4c4c-8327-74973292380c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1473fc1b07a74017b416524ee70bc196'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:15.379209 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-8db87ac1-904e-4c4c-8327-74973292380c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1473fc1b07a74017b416524ee70bc196'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:15.397347 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1186/2376] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:57:14 2022] DELETE /identity/v3/users/1473fc1b07a74017b416524ee70bc196 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:15.875024 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a34285-9ab2-4985-80f8-63e2fa51f7a8 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:15.877266 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-06a34285-9ab2-4985-80f8-63e2fa51f7a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:15.891199 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a34285-9ab2-4985-80f8-63e2fa51f7a8 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:15.950081 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ae05d-4b27-4c16-8219-1322672214de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:15.950692 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ae05d-4b27-4c16-8219-1322672214de admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:15.950995 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ae05d-4b27-4c16-8219-1322672214de admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:15.951243 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ae05d-4b27-4c16-8219-1322672214de admin admin] PATH_INFO: `/v3/projects/f43c8defff264448b22bb3c9e316d291` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:15.952348 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ae05d-4b27-4c16-8219-1322672214de admin admin] RBAC: Authorizing `identity:delete_project(project_id=f43c8defff264448b22bb3c9e316d291)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:15.954897 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ae05d-4b27-4c16-8219-1322672214de admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:16.086051 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-619ae05d-4b27-4c16-8219-1322672214de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f43c8defff264448b22bb3c9e316d291', 'request_id': 'req-619ae05d-4b27-4c16-8219-1322672214de'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:16.091911 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-619ae05d-4b27-4c16-8219-1322672214de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f43c8defff264448b22bb3c9e316d291', 'request_id': 'req-619ae05d-4b27-4c16-8219-1322672214de'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:16.147608 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-619ae05d-4b27-4c16-8219-1322672214de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f43c8defff264448b22bb3c9e316d291', 'request_id': 'req-619ae05d-4b27-4c16-8219-1322672214de'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:16.164024 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-619ae05d-4b27-4c16-8219-1322672214de admin admin] The token cache is being invalidate because project f43c8defff264448b22bb3c9e316d291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:57:16.164024 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-619ae05d-4b27-4c16-8219-1322672214de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:16.164024 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-619ae05d-4b27-4c16-8219-1322672214de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:16.164354 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1191/2377] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:57:15 2022] DELETE /identity/v3/projects/f43c8defff264448b22bb3c9e316d291 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:16.169479 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e61e3c-5a19-4fe5-991f-d56c27faa446 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:16.169941 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e61e3c-5a19-4fe5-991f-d56c27faa446 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:16.170035 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e61e3c-5a19-4fe5-991f-d56c27faa446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:16.192947 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-18e61e3c-5a19-4fe5-991f-d56c27faa446 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:16.194176 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-18e61e3c-5a19-4fe5-991f-d56c27faa446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:16.256468 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:16.272950 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1187/2378] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:57:16.279406 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26392657-659a-4428-94f2-7d0b4651ece4 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:16.279694 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26392657-659a-4428-94f2-7d0b4651ece4 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:16.279973 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26392657-659a-4428-94f2-7d0b4651ece4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:16.288085 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:16.300690 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-26392657-659a-4428-94f2-7d0b4651ece4 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:16.302069 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-26392657-659a-4428-94f2-7d0b4651ece4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:16.314826 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1192/2379] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:16.319312 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e61e3c-5a19-4fe5-991f-d56c27faa446 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:16.329671 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e61e3c-5a19-4fe5-991f-d56c27faa446 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:16.334474 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0a9c0-0206-453c-a932-736b8d88aecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:16.337120 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0a9c0-0206-453c-a932-736b8d88aecd admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:16.337120 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0a9c0-0206-453c-a932-736b8d88aecd admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:16.337120 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0a9c0-0206-453c-a932-736b8d88aecd admin admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:16.337120 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c0a9c0-0206-453c-a932-736b8d88aecd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:57:16.337120 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c0a9c0-0206-453c-a932-736b8d88aecd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:16.338237 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c0a9c0-0206-453c-a932-736b8d88aecd admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:16.350685 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1188/2380] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:57:16.355109 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26392657-659a-4428-94f2-7d0b4651ece4 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:16.366105 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26392657-659a-4428-94f2-7d0b4651ece4 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:16.371305 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f2361-9d94-4876-87e0-8d3a25ce34b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:16.372109 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f2361-9d94-4876-87e0-8d3a25ce34b7 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:16.372392 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f2361-9d94-4876-87e0-8d3a25ce34b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:16.372665 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f2361-9d94-4876-87e0-8d3a25ce34b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:16.373467 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f2361-9d94-4876-87e0-8d3a25ce34b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:16.375367 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f2361-9d94-4876-87e0-8d3a25ce34b7 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:16.509786 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1193/2381] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:57:16 2022] POST /identity/v3/projects => generated 377 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:57:16.513742 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0a9c0-0206-453c-a932-736b8d88aecd admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:16.525482 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0a9c0-0206-453c-a932-736b8d88aecd admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:16.582205 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7956b8-7704-4741-8989-eb7ac91b5290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:16.583300 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7956b8-7704-4741-8989-eb7ac91b5290 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:16.583570 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7956b8-7704-4741-8989-eb7ac91b5290 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:16.583847 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7956b8-7704-4741-8989-eb7ac91b5290 admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:16.584488 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7956b8-7704-4741-8989-eb7ac91b5290 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:16.586475 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7956b8-7704-4741-8989-eb7ac91b5290 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:16.690980 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1189/2382] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:57:16 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:57:16.695184 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f2361-9d94-4876-87e0-8d3a25ce34b7 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:16.705820 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f2361-9d94-4876-87e0-8d3a25ce34b7 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:16.710719 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5eb210-246e-4efc-8505-f44ae3ea296a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:16.711320 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5eb210-246e-4efc-8505-f44ae3ea296a admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:16.711603 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5eb210-246e-4efc-8505-f44ae3ea296a admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:16.711883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5eb210-246e-4efc-8505-f44ae3ea296a admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:16.712680 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5eb210-246e-4efc-8505-f44ae3ea296a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:16.714377 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5eb210-246e-4efc-8505-f44ae3ea296a admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:16.725326 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1194/2383] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:57:16.729412 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7956b8-7704-4741-8989-eb7ac91b5290 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:16.740334 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7956b8-7704-4741-8989-eb7ac91b5290 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:16.747087 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6519f6d-a9b3-45ae-a979-d9e8583977a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:16.747695 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6519f6d-a9b3-45ae-a979-d9e8583977a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:16.748021 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6519f6d-a9b3-45ae-a979-d9e8583977a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:16.748296 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6519f6d-a9b3-45ae-a979-d9e8583977a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:16.748945 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6519f6d-a9b3-45ae-a979-d9e8583977a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:16.750602 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6519f6d-a9b3-45ae-a979-d9e8583977a9 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:16.762702 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1190/2384] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:57:16.767041 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5eb210-246e-4efc-8505-f44ae3ea296a admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:16.777117 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5eb210-246e-4efc-8505-f44ae3ea296a admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:16.782209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae2523-e977-40e9-a9cd-af38242c6b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:16.788504 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae2523-e977-40e9-a9cd-af38242c6b72 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:16.788504 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae2523-e977-40e9-a9cd-af38242c6b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:16.788504 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae2523-e977-40e9-a9cd-af38242c6b72 admin admin] PATH_INFO: `/v3/projects/ba688337094c4ff6a779b69db679b721/users/b0bd75ee998d49dab7aaa335bba1aa10/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:16.800422 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae2523-e977-40e9-a9cd-af38242c6b72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba688337094c4ff6a779b69db679b721, user_id=b0bd75ee998d49dab7aaa335bba1aa10, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:16.803193 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae2523-e977-40e9-a9cd-af38242c6b72 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:16.896478 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1195/2385] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:57:16 2022] PUT /identity/v3/projects/ba688337094c4ff6a779b69db679b721/users/b0bd75ee998d49dab7aaa335bba1aa10/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:57:16.908422 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2939e-0522-4621-a38b-e65c9e9d5a7c None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:16.908708 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2939e-0522-4621-a38b-e65c9e9d5a7c None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:16.908983 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2939e-0522-4621-a38b-e65c9e9d5a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:16.936401 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-f2f2939e-0522-4621-a38b-e65c9e9d5a7c None None] MFA Rules not processed for user `b0bd75ee998d49dab7aaa335bba1aa10`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:16.937638 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-f2f2939e-0522-4621-a38b-e65c9e9d5a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:17.005669 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1191/2386] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:17.010403 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae2523-e977-40e9-a9cd-af38242c6b72 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:17.073120 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae2523-e977-40e9-a9cd-af38242c6b72 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:17.077855 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f35944-05a3-4e12-9151-c9b9975c00fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:17.078447 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f35944-05a3-4e12-9151-c9b9975c00fd admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:17.078726 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f35944-05a3-4e12-9151-c9b9975c00fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:17.079007 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f35944-05a3-4e12-9151-c9b9975c00fd admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:17.079711 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f35944-05a3-4e12-9151-c9b9975c00fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:17.081682 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f35944-05a3-4e12-9151-c9b9975c00fd admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:17.211289 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1196/2387] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:57:17 2022] POST /identity/v3/projects => generated 379 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:57:17.215629 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2939e-0522-4621-a38b-e65c9e9d5a7c None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:17.226929 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2939e-0522-4621-a38b-e65c9e9d5a7c None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:17.272851 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:17.285044 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504e69b-5002-4977-8164-40711ace4929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:17.285728 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504e69b-5002-4977-8164-40711ace4929 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:17.286009 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504e69b-5002-4977-8164-40711ace4929 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:17.286283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504e69b-5002-4977-8164-40711ace4929 admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:17.286911 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504e69b-5002-4977-8164-40711ace4929 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:17.288822 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504e69b-5002-4977-8164-40711ace4929 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:17.444695 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1192/2388] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:57:17 2022] POST /identity/v3/users => generated 296 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:57:17.450165 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f35944-05a3-4e12-9151-c9b9975c00fd admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:17.458837 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f35944-05a3-4e12-9151-c9b9975c00fd admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:17.463769 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c64d36-bab8-4f10-95f2-3a608f026cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:17.464355 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c64d36-bab8-4f10-95f2-3a608f026cce admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:17.464695 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c64d36-bab8-4f10-95f2-3a608f026cce admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:17.465254 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c64d36-bab8-4f10-95f2-3a608f026cce admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:17.465940 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c64d36-bab8-4f10-95f2-3a608f026cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:17.467628 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c64d36-bab8-4f10-95f2-3a608f026cce admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:17.478749 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1197/2389] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:57:17.483458 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504e69b-5002-4977-8164-40711ace4929 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:17.494548 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504e69b-5002-4977-8164-40711ace4929 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:17.499495 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dee3c9-4e21-454a-b1d6-dd1d9e94e534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:17.500157 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dee3c9-4e21-454a-b1d6-dd1d9e94e534 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:17.507287 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dee3c9-4e21-454a-b1d6-dd1d9e94e534 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:17.507287 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dee3c9-4e21-454a-b1d6-dd1d9e94e534 admin admin] PATH_INFO: `/v3/projects/71a0d5b5397b484186ea5c7e007f8789/users/381d0511c41a4da0853157cf59d1fcfa/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:17.517925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dee3c9-4e21-454a-b1d6-dd1d9e94e534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71a0d5b5397b484186ea5c7e007f8789, user_id=381d0511c41a4da0853157cf59d1fcfa, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:17.520549 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dee3c9-4e21-454a-b1d6-dd1d9e94e534 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:17.566286 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1193/2390] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:57:17 2022] PUT /identity/v3/projects/71a0d5b5397b484186ea5c7e007f8789/users/381d0511c41a4da0853157cf59d1fcfa/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:17.570375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c64d36-bab8-4f10-95f2-3a608f026cce admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:17.585084 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c64d36-bab8-4f10-95f2-3a608f026cce admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:17.588033 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dee3c9-4e21-454a-b1d6-dd1d9e94e534 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:17.589726 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-57dee3c9-4e21-454a-b1d6-dd1d9e94e534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:17.644950 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7b4c7-31ce-4422-890f-2eb01e0273d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:17.645614 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7b4c7-31ce-4422-890f-2eb01e0273d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:17.645895 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7b4c7-31ce-4422-890f-2eb01e0273d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:17.646175 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7b4c7-31ce-4422-890f-2eb01e0273d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:17.646819 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b7b4c7-31ce-4422-890f-2eb01e0273d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:17.647400 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dee3c9-4e21-454a-b1d6-dd1d9e94e534 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:17.648434 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b7b4c7-31ce-4422-890f-2eb01e0273d4 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:17.651207 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f049d-d66f-408f-831f-3d4618548fbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:17.651814 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f049d-d66f-408f-831f-3d4618548fbe service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:17.652098 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f049d-d66f-408f-831f-3d4618548fbe service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:17.652374 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f049d-d66f-408f-831f-3d4618548fbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:17.654199 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-973f049d-d66f-408f-831f-3d4618548fbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:17.658319 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1198/2391] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:57:17.662484 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7b4c7-31ce-4422-890f-2eb01e0273d4 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:17.666620 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f049d-d66f-408f-831f-3d4618548fbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:17.668068 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f049d-d66f-408f-831f-3d4618548fbe service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:17.672155 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7b4c7-31ce-4422-890f-2eb01e0273d4 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:17.677757 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f23d11-6535-41fd-872e-9603ca962711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:17.678404 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f23d11-6535-41fd-872e-9603ca962711 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:17.678687 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f23d11-6535-41fd-872e-9603ca962711 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:17.679093 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f23d11-6535-41fd-872e-9603ca962711 admin admin] PATH_INFO: `/v3/projects/71a0d5b5397b484186ea5c7e007f8789/users/381d0511c41a4da0853157cf59d1fcfa/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:17.681807 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f23d11-6535-41fd-872e-9603ca962711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71a0d5b5397b484186ea5c7e007f8789, user_id=381d0511c41a4da0853157cf59d1fcfa, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:17.681954 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1194/2392] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:57:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:57:17.687178 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f23d11-6535-41fd-872e-9603ca962711 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:17.690887 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:17.699266 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1199/2393] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:57:17 2022] PUT /identity/v3/projects/71a0d5b5397b484186ea5c7e007f8789/users/381d0511c41a4da0853157cf59d1fcfa/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:17.713267 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0835af0-effa-4e44-b4ec-6ee5f3075635 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:17.713555 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0835af0-effa-4e44-b4ec-6ee5f3075635 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:17.713893 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0835af0-effa-4e44-b4ec-6ee5f3075635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:17.745479 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-f0835af0-effa-4e44-b4ec-6ee5f3075635 None None] MFA Rules not processed for user `381d0511c41a4da0853157cf59d1fcfa`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:17.746672 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-f0835af0-effa-4e44-b4ec-6ee5f3075635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:17.782751 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f23d11-6535-41fd-872e-9603ca962711 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:17.784684 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-29f23d11-6535-41fd-872e-9603ca962711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:17.825632 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1195/2394] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:17 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:17.841273 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0835af0-effa-4e44-b4ec-6ee5f3075635 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:17.843368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-f0835af0-effa-4e44-b4ec-6ee5f3075635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:17.851882 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f23d11-6535-41fd-872e-9603ca962711 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:17.855878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12b59a-fcd6-4746-9d99-1c7f0f5e80f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:17.856410 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12b59a-fcd6-4746-9d99-1c7f0f5e80f2 service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:17.856690 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12b59a-fcd6-4746-9d99-1c7f0f5e80f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:17.856968 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12b59a-fcd6-4746-9d99-1c7f0f5e80f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:17.858892 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-9e12b59a-fcd6-4746-9d99-1c7f0f5e80f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:17.896150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:17.908994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0835af0-effa-4e44-b4ec-6ee5f3075635 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:17.916404 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf4e89-6412-4e1c-b381-6823ed661915 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:17.916404 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf4e89-6412-4e1c-b381-6823ed661915 service cinder] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:17.916404 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf4e89-6412-4e1c-b381-6823ed661915 service cinder] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:17.916404 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf4e89-6412-4e1c-b381-6823ed661915 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:17.931874 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12b59a-fcd6-4746-9d99-1c7f0f5e80f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:17.933350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12b59a-fcd6-4746-9d99-1c7f0f5e80f2 service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:17.949225 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1200/2395] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:57:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:57:17.980336 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf4e89-6412-4e1c-b381-6823ed661915 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:17.982676 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf4e89-6412-4e1c-b381-6823ed661915 service cinder] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:17.998843 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1196/2396] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:57:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:57:19.896103 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12b59a-fcd6-4746-9d99-1c7f0f5e80f2 service neutron] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:19.897812 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-9e12b59a-fcd6-4746-9d99-1c7f0f5e80f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:19.915730 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12b59a-fcd6-4746-9d99-1c7f0f5e80f2 service neutron] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:19.927213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683cd797-86f0-49ee-91c4-9d4ab392ec87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:19.927931 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cd797-86f0-49ee-91c4-9d4ab392ec87 service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:19.928213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cd797-86f0-49ee-91c4-9d4ab392ec87 service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:19.928483 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cd797-86f0-49ee-91c4-9d4ab392ec87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:19.956721 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683cd797-86f0-49ee-91c4-9d4ab392ec87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:19.958528 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683cd797-86f0-49ee-91c4-9d4ab392ec87 service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:19.971671 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1201/2397] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:57:19 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:57:22.550578 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf4e89-6412-4e1c-b381-6823ed661915 service cinder] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:22.552003 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-dadf4e89-6412-4e1c-b381-6823ed661915 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:22.568233 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf4e89-6412-4e1c-b381-6823ed661915 service cinder] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:22.572805 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a3025-c276-4024-aef0-bfb5ead5c40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:22.573459 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a3025-c276-4024-aef0-bfb5ead5c40a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:22.573738 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a3025-c276-4024-aef0-bfb5ead5c40a admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:22.574007 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a3025-c276-4024-aef0-bfb5ead5c40a admin admin] PATH_INFO: `/v3/users/7d84d1d6d0ab469f905d01d8a1276dec` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:22.575993 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a3025-c276-4024-aef0-bfb5ead5c40a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d84d1d6d0ab469f905d01d8a1276dec)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:22.579428 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a3025-c276-4024-aef0-bfb5ead5c40a admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:22.589012 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683cd797-86f0-49ee-91c4-9d4ab392ec87 service cinder] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:22.590817 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-683cd797-86f0-49ee-91c4-9d4ab392ec87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:22.607478 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683cd797-86f0-49ee-91c4-9d4ab392ec87 service cinder] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:22.614261 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e95ba-70ee-462c-9475-a0f1b1d8d209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:22.615006 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e95ba-70ee-462c-9475-a0f1b1d8d209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:22.615356 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e95ba-70ee-462c-9475-a0f1b1d8d209 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:22.615707 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e95ba-70ee-462c-9475-a0f1b1d8d209 admin admin] PATH_INFO: `/v3/users/d26e7b888a914f93a69b179f9e7ad14e` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:22.616933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e95ba-70ee-462c-9475-a0f1b1d8d209 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d26e7b888a914f93a69b179f9e7ad14e)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:22.618916 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e95ba-70ee-462c-9475-a0f1b1d8d209 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:22.786202 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-862a3025-c276-4024-aef0-bfb5ead5c40a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d84d1d6d0ab469f905d01d8a1276dec'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:22.851497 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-c38e95ba-70ee-462c-9475-a0f1b1d8d209 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd26e7b888a914f93a69b179f9e7ad14e'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:22.856738 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-862a3025-c276-4024-aef0-bfb5ead5c40a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d84d1d6d0ab469f905d01d8a1276dec'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:22.857484 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-862a3025-c276-4024-aef0-bfb5ead5c40a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d84d1d6d0ab469f905d01d8a1276dec'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:22.858169 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-862a3025-c276-4024-aef0-bfb5ead5c40a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d84d1d6d0ab469f905d01d8a1276dec'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:22.866491 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-862a3025-c276-4024-aef0-bfb5ead5c40a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d84d1d6d0ab469f905d01d8a1276dec'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:22.885232 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1197/2398] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:57:22 2022] DELETE /identity/v3/users/7d84d1d6d0ab469f905d01d8a1276dec => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:22.970969 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-c38e95ba-70ee-462c-9475-a0f1b1d8d209 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd26e7b888a914f93a69b179f9e7ad14e'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:22.971675 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-c38e95ba-70ee-462c-9475-a0f1b1d8d209 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd26e7b888a914f93a69b179f9e7ad14e'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:22.972297 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-c38e95ba-70ee-462c-9475-a0f1b1d8d209 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd26e7b888a914f93a69b179f9e7ad14e'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:22.981783 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-c38e95ba-70ee-462c-9475-a0f1b1d8d209 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd26e7b888a914f93a69b179f9e7ad14e'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:23.000665 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1202/2399] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:57:22 2022] DELETE /identity/v3/users/d26e7b888a914f93a69b179f9e7ad14e => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:23.151013 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a3025-c276-4024-aef0-bfb5ead5c40a admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:23.151013 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-862a3025-c276-4024-aef0-bfb5ead5c40a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:23.243138 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a3025-c276-4024-aef0-bfb5ead5c40a admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:23.245963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e95ba-70ee-462c-9475-a0f1b1d8d209 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:23.247765 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-c38e95ba-70ee-462c-9475-a0f1b1d8d209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:23.255776 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:23.257885 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:23.309974 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47874ef1-c379-4f5f-8e7b-fbb947349b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:23.310535 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47874ef1-c379-4f5f-8e7b-fbb947349b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:23.310857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47874ef1-c379-4f5f-8e7b-fbb947349b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:23.311141 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47874ef1-c379-4f5f-8e7b-fbb947349b56 admin admin] PATH_INFO: `/v3/projects/2c03d39bb35345e69139ddfb4067b60a` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:23.312316 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47874ef1-c379-4f5f-8e7b-fbb947349b56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c03d39bb35345e69139ddfb4067b60a)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:23.315263 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47874ef1-c379-4f5f-8e7b-fbb947349b56 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:23.323496 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e95ba-70ee-462c-9475-a0f1b1d8d209 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:23.328879 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ff9ac-5fd9-4661-a8d9-72a8c1470da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:23.334741 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ff9ac-5fd9-4661-a8d9-72a8c1470da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:23.334741 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ff9ac-5fd9-4661-a8d9-72a8c1470da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:23.334741 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ff9ac-5fd9-4661-a8d9-72a8c1470da1 admin admin] PATH_INFO: `/v3/projects/1942367d28ba49ebab8e79e3c3b4b3ec` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:23.334741 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ff9ac-5fd9-4661-a8d9-72a8c1470da1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1942367d28ba49ebab8e79e3c3b4b3ec)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:23.335300 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ff9ac-5fd9-4661-a8d9-72a8c1470da1 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:23.464448 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-47874ef1-c379-4f5f-8e7b-fbb947349b56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c03d39bb35345e69139ddfb4067b60a', 'request_id': 'req-47874ef1-c379-4f5f-8e7b-fbb947349b56'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:23.474779 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-2a2ff9ac-5fd9-4661-a8d9-72a8c1470da1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1942367d28ba49ebab8e79e3c3b4b3ec', 'request_id': 'req-2a2ff9ac-5fd9-4661-a8d9-72a8c1470da1'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:23.480361 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-2a2ff9ac-5fd9-4661-a8d9-72a8c1470da1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1942367d28ba49ebab8e79e3c3b4b3ec', 'request_id': 'req-2a2ff9ac-5fd9-4661-a8d9-72a8c1470da1'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:23.484426 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-47874ef1-c379-4f5f-8e7b-fbb947349b56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c03d39bb35345e69139ddfb4067b60a', 'request_id': 'req-47874ef1-c379-4f5f-8e7b-fbb947349b56'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:23.609999 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-2a2ff9ac-5fd9-4661-a8d9-72a8c1470da1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1942367d28ba49ebab8e79e3c3b4b3ec', 'request_id': 'req-2a2ff9ac-5fd9-4661-a8d9-72a8c1470da1'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:23.622403 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-2a2ff9ac-5fd9-4661-a8d9-72a8c1470da1 admin admin] The token cache is being invalidate because project 1942367d28ba49ebab8e79e3c3b4b3ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:57:23.622697 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-2a2ff9ac-5fd9-4661-a8d9-72a8c1470da1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:23.623336 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-2a2ff9ac-5fd9-4661-a8d9-72a8c1470da1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:23.624828 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1203/2400] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:57:23 2022] DELETE /identity/v3/projects/1942367d28ba49ebab8e79e3c3b4b3ec => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:23.630362 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834ed4e-588a-43e5-b00c-59fbecc42b49 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:23.630653 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834ed4e-588a-43e5-b00c-59fbecc42b49 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:23.630972 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834ed4e-588a-43e5-b00c-59fbecc42b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:23.651479 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-c834ed4e-588a-43e5-b00c-59fbecc42b49 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:23.653364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-c834ed4e-588a-43e5-b00c-59fbecc42b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:23.701529 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-47874ef1-c379-4f5f-8e7b-fbb947349b56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c03d39bb35345e69139ddfb4067b60a', 'request_id': 'req-47874ef1-c379-4f5f-8e7b-fbb947349b56'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:23.713968 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-47874ef1-c379-4f5f-8e7b-fbb947349b56 admin admin] The token cache is being invalidate because project 2c03d39bb35345e69139ddfb4067b60a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:57:23.714255 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-47874ef1-c379-4f5f-8e7b-fbb947349b56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:23.715134 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-47874ef1-c379-4f5f-8e7b-fbb947349b56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:23.716659 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1198/2401] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:57:23 2022] DELETE /identity/v3/projects/2c03d39bb35345e69139ddfb4067b60a => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:23.717981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1204/2402] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:57:23.723000 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150cae7-9dee-4452-97b8-e0ab00cad0d8 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:23.723492 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150cae7-9dee-4452-97b8-e0ab00cad0d8 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:23.723768 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150cae7-9dee-4452-97b8-e0ab00cad0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:23.726293 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717ed60-00a5-4e5a-a1d4-cb91cc76aa0f None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:23.726584 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717ed60-00a5-4e5a-a1d4-cb91cc76aa0f None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:23.726863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717ed60-00a5-4e5a-a1d4-cb91cc76aa0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:23.746324 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-9150cae7-9dee-4452-97b8-e0ab00cad0d8 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:23.747551 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-9150cae7-9dee-4452-97b8-e0ab00cad0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:23.748061 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-1717ed60-00a5-4e5a-a1d4-cb91cc76aa0f None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:23.749313 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-1717ed60-00a5-4e5a-a1d4-cb91cc76aa0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:23.755768 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1199/2403] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:23.757990 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1205/2404] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:57:23.762141 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150cae7-9dee-4452-97b8-e0ab00cad0d8 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:23.768258 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2824da5-b375-47dc-a9b4-8d212c577eed None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:23.768258 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2824da5-b375-47dc-a9b4-8d212c577eed None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:23.768258 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2824da5-b375-47dc-a9b4-8d212c577eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:23.772067 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150cae7-9dee-4452-97b8-e0ab00cad0d8 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:23.777096 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fa795-f0ec-456d-9b4f-3ecbf6f649ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:23.777700 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fa795-f0ec-456d-9b4f-3ecbf6f649ec admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:23.777983 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fa795-f0ec-456d-9b4f-3ecbf6f649ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:23.778260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fa795-f0ec-456d-9b4f-3ecbf6f649ec admin admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:23.778959 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158fa795-f0ec-456d-9b4f-3ecbf6f649ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:57:23.779313 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158fa795-f0ec-456d-9b4f-3ecbf6f649ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:23.780915 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158fa795-f0ec-456d-9b4f-3ecbf6f649ec admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:23.785767 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-d2824da5-b375-47dc-a9b4-8d212c577eed None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:23.786970 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-d2824da5-b375-47dc-a9b4-8d212c577eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:23.794496 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1200/2405] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:57:23.796246 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1206/2406] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:57:23.799470 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2824da5-b375-47dc-a9b4-8d212c577eed None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:23.799862 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fa795-f0ec-456d-9b4f-3ecbf6f649ec admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:23.809449 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2824da5-b375-47dc-a9b4-8d212c577eed None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:23.809716 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fa795-f0ec-456d-9b4f-3ecbf6f649ec admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:23.814094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0adb5f-aee9-49e2-81b0-9ebb19baa914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:23.819221 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3d587-7329-46c8-ab79-133b31dcf122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:23.819368 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0adb5f-aee9-49e2-81b0-9ebb19baa914 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:23.819368 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0adb5f-aee9-49e2-81b0-9ebb19baa914 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:23.819540 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3d587-7329-46c8-ab79-133b31dcf122 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:23.819629 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0adb5f-aee9-49e2-81b0-9ebb19baa914 admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:23.819711 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3d587-7329-46c8-ab79-133b31dcf122 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:23.819711 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3d587-7329-46c8-ab79-133b31dcf122 admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:23.819889 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0adb5f-aee9-49e2-81b0-9ebb19baa914 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:57:23.819889 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0adb5f-aee9-49e2-81b0-9ebb19baa914 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:23.820085 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3d587-7329-46c8-ab79-133b31dcf122 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:23.820187 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0adb5f-aee9-49e2-81b0-9ebb19baa914 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:23.820281 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3d587-7329-46c8-ab79-133b31dcf122 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:23.830071 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1207/2407] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:57:23.834655 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0adb5f-aee9-49e2-81b0-9ebb19baa914 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:23.844926 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0adb5f-aee9-49e2-81b0-9ebb19baa914 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:23.850174 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516177d1-f035-4015-93db-d7493d4dd896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:23.850755 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516177d1-f035-4015-93db-d7493d4dd896 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:23.851037 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516177d1-f035-4015-93db-d7493d4dd896 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:23.851333 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516177d1-f035-4015-93db-d7493d4dd896 admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:23.851951 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516177d1-f035-4015-93db-d7493d4dd896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:23.853921 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516177d1-f035-4015-93db-d7493d4dd896 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:23.859137 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:23.912446 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1201/2408] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:57:23 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:57:23.913582 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3d587-7329-46c8-ab79-133b31dcf122 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:23.978085 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3d587-7329-46c8-ab79-133b31dcf122 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:23.985437 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670731cc-9b7d-4971-8ee4-4bb26cf101aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:23.986838 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670731cc-9b7d-4971-8ee4-4bb26cf101aa admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:23.987225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670731cc-9b7d-4971-8ee4-4bb26cf101aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:23.987505 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670731cc-9b7d-4971-8ee4-4bb26cf101aa admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:23.988141 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670731cc-9b7d-4971-8ee4-4bb26cf101aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:23.990160 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670731cc-9b7d-4971-8ee4-4bb26cf101aa admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:24.000145 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1208/2409] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:57:23 2022] POST /identity/v3/projects => generated 363 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:57:24.002429 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:24.004891 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516177d1-f035-4015-93db-d7493d4dd896 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:24.066774 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516177d1-f035-4015-93db-d7493d4dd896 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:24.071468 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec045cbb-c3f4-44c5-b708-6a2798024a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:24.072066 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec045cbb-c3f4-44c5-b708-6a2798024a09 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:24.072348 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec045cbb-c3f4-44c5-b708-6a2798024a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:24.072620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec045cbb-c3f4-44c5-b708-6a2798024a09 admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:24.073271 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec045cbb-c3f4-44c5-b708-6a2798024a09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:24.075230 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec045cbb-c3f4-44c5-b708-6a2798024a09 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:24.085510 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1202/2410] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:57:23 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:57:24.089326 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670731cc-9b7d-4971-8ee4-4bb26cf101aa admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:24.100130 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670731cc-9b7d-4971-8ee4-4bb26cf101aa admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:24.104761 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf2f7e-c5ca-4ae5-86c0-7dac69899ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:24.105520 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf2f7e-c5ca-4ae5-86c0-7dac69899ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:24.105748 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf2f7e-c5ca-4ae5-86c0-7dac69899ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:24.106376 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf2f7e-c5ca-4ae5-86c0-7dac69899ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:24.107210 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf2f7e-c5ca-4ae5-86c0-7dac69899ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:24.109345 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf2f7e-c5ca-4ae5-86c0-7dac69899ee9 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:24.119518 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1203/2411] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:57:24.123343 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf2f7e-c5ca-4ae5-86c0-7dac69899ee9 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:24.132997 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf2f7e-c5ca-4ae5-86c0-7dac69899ee9 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:24.137924 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8df0e-78cc-4322-a0d8-c33dcaa3f204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:24.138480 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8df0e-78cc-4322-a0d8-c33dcaa3f204 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:24.138765 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8df0e-78cc-4322-a0d8-c33dcaa3f204 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:24.139041 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8df0e-78cc-4322-a0d8-c33dcaa3f204 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:24.139710 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8df0e-78cc-4322-a0d8-c33dcaa3f204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:24.141471 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8df0e-78cc-4322-a0d8-c33dcaa3f204 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:24.152775 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1204/2412] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:57:24.156814 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8df0e-78cc-4322-a0d8-c33dcaa3f204 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:24.166971 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8df0e-78cc-4322-a0d8-c33dcaa3f204 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:24.172091 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1209/2413] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:57:24 2022] POST /identity/v3/users => generated 282 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:57:24.179254 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991ef15-c595-4c91-b3ad-c6e5cf330faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:24.179254 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991ef15-c595-4c91-b3ad-c6e5cf330faa admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:24.179254 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991ef15-c595-4c91-b3ad-c6e5cf330faa admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:24.179254 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991ef15-c595-4c91-b3ad-c6e5cf330faa admin admin] PATH_INFO: `/v3/projects/4775d4a9a26c49ba889faa8401589909/users/90d17781b19f423e86f7d5fc891eb272/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:24.181018 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec045cbb-c3f4-44c5-b708-6a2798024a09 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:24.191466 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec045cbb-c3f4-44c5-b708-6a2798024a09 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:24.193135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991ef15-c595-4c91-b3ad-c6e5cf330faa admin admin] RBAC: Authorizing `identity:create_grant(project_id=4775d4a9a26c49ba889faa8401589909, user_id=90d17781b19f423e86f7d5fc891eb272, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:24.195820 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991ef15-c595-4c91-b3ad-c6e5cf330faa admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:24.196521 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e93b41-de8a-4b1d-aa0b-a7b54af2b3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:24.197004 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e93b41-de8a-4b1d-aa0b-a7b54af2b3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:24.197780 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e93b41-de8a-4b1d-aa0b-a7b54af2b3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:24.198344 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e93b41-de8a-4b1d-aa0b-a7b54af2b3d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:24.199819 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e93b41-de8a-4b1d-aa0b-a7b54af2b3d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:24.201496 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e93b41-de8a-4b1d-aa0b-a7b54af2b3d3 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:24.212784 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1210/2414] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:57:24.217017 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e93b41-de8a-4b1d-aa0b-a7b54af2b3d3 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:24.227270 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e93b41-de8a-4b1d-aa0b-a7b54af2b3d3 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:24.231899 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93e23b-6c95-42e6-8623-f2bc59554c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:24.232465 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93e23b-6c95-42e6-8623-f2bc59554c37 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:24.232748 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93e23b-6c95-42e6-8623-f2bc59554c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:24.233024 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93e23b-6c95-42e6-8623-f2bc59554c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:24.233674 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93e23b-6c95-42e6-8623-f2bc59554c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:24.235252 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93e23b-6c95-42e6-8623-f2bc59554c37 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:24.245574 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1211/2415] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:57:24.249562 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93e23b-6c95-42e6-8623-f2bc59554c37 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:24.258939 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93e23b-6c95-42e6-8623-f2bc59554c37 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:24.263580 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c675d-e3a2-42fa-9927-1a147639081d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:24.264280 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c675d-e3a2-42fa-9927-1a147639081d admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:24.264454 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c675d-e3a2-42fa-9927-1a147639081d admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:24.264728 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c675d-e3a2-42fa-9927-1a147639081d admin admin] PATH_INFO: `/v3/projects/7a3f3ea76e3a4bcbbc0b1bf0b665cce2/users/77d109dccaf14053ab8fee2de7a3dd91/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:24.279748 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c675d-e3a2-42fa-9927-1a147639081d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a3f3ea76e3a4bcbbc0b1bf0b665cce2, user_id=77d109dccaf14053ab8fee2de7a3dd91, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:24.282388 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c675d-e3a2-42fa-9927-1a147639081d admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:24.301347 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1205/2416] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:57:24 2022] PUT /identity/v3/projects/4775d4a9a26c49ba889faa8401589909/users/90d17781b19f423e86f7d5fc891eb272/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:57:24.312774 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80811c9c-c34a-4ef4-a44a-63d783600556 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:24.313145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80811c9c-c34a-4ef4-a44a-63d783600556 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:24.313422 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80811c9c-c34a-4ef4-a44a-63d783600556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:24.345296 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-80811c9c-c34a-4ef4-a44a-63d783600556 None None] MFA Rules not processed for user `90d17781b19f423e86f7d5fc891eb272`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:24.347151 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-80811c9c-c34a-4ef4-a44a-63d783600556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:24.353315 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1212/2417] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:57:24 2022] PUT /identity/v3/projects/7a3f3ea76e3a4bcbbc0b1bf0b665cce2/users/77d109dccaf14053ab8fee2de7a3dd91/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:57:24.369509 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c492f-1588-49b9-94cf-8b7c8a198e80 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:24.369884 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c492f-1588-49b9-94cf-8b7c8a198e80 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:24.370163 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c492f-1588-49b9-94cf-8b7c8a198e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:24.403151 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-774c492f-1588-49b9-94cf-8b7c8a198e80 None None] MFA Rules not processed for user `77d109dccaf14053ab8fee2de7a3dd91`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:24.404417 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-774c492f-1588-49b9-94cf-8b7c8a198e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:24.416691 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1206/2418] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:57:24.428990 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80811c9c-c34a-4ef4-a44a-63d783600556 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:24.430642 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-80811c9c-c34a-4ef4-a44a-63d783600556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:24.474478 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1213/2419] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:24.475448 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c492f-1588-49b9-94cf-8b7c8a198e80 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:24.509453 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:24.512858 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80811c9c-c34a-4ef4-a44a-63d783600556 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:24.521710 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946e393-5e6b-4982-a281-d0969bf29fdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:24.522327 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946e393-5e6b-4982-a281-d0969bf29fdb service nova] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:24.522637 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946e393-5e6b-4982-a281-d0969bf29fdb service nova] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:24.522878 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946e393-5e6b-4982-a281-d0969bf29fdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:24.531904 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946e393-5e6b-4982-a281-d0969bf29fdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:24.533979 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946e393-5e6b-4982-a281-d0969bf29fdb service nova] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:24.543236 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1207/2420] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:57:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:57:24.544032 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946e393-5e6b-4982-a281-d0969bf29fdb service nova] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:24.545449 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-b946e393-5e6b-4982-a281-d0969bf29fdb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:24.560188 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946e393-5e6b-4982-a281-d0969bf29fdb service nova] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:24.566360 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c492f-1588-49b9-94cf-8b7c8a198e80 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:24.566863 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ca45d-a198-4503-bf8f-0fee58bfd867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:24.567084 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ca45d-a198-4503-bf8f-0fee58bfd867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:24.567366 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ca45d-a198-4503-bf8f-0fee58bfd867 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:24.567641 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ca45d-a198-4503-bf8f-0fee58bfd867 admin admin] PATH_INFO: `/v3/users/b0bd75ee998d49dab7aaa335bba1aa10` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:24.568812 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb8bf5-e63c-419b-8c4c-4759754d4037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:24.569228 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ca45d-a198-4503-bf8f-0fee58bfd867 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0bd75ee998d49dab7aaa335bba1aa10)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:24.569459 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb8bf5-e63c-419b-8c4c-4759754d4037 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:24.569745 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb8bf5-e63c-419b-8c4c-4759754d4037 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:24.570024 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb8bf5-e63c-419b-8c4c-4759754d4037 admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:24.570652 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb8bf5-e63c-419b-8c4c-4759754d4037 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:24.571132 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ca45d-a198-4503-bf8f-0fee58bfd867 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:24.572596 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb8bf5-e63c-419b-8c4c-4759754d4037 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:24.591519 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:INSERT=2,keystone:SELECT=97,keystone:DELETE=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:24.676485 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1214/2421] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:57:24 2022] POST /identity/v3/projects => generated 365 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:57:24.680860 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb8bf5-e63c-419b-8c4c-4759754d4037 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:24.747036 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb8bf5-e63c-419b-8c4c-4759754d4037 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:24.752647 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8346f-4678-4e66-a4a0-c158b1fdc2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:24.753308 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8346f-4678-4e66-a4a0-c158b1fdc2a8 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:24.753594 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8346f-4678-4e66-a4a0-c158b1fdc2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:24.753867 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8346f-4678-4e66-a4a0-c158b1fdc2a8 admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:24.754521 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8346f-4678-4e66-a4a0-c158b1fdc2a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:24.756513 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8346f-4678-4e66-a4a0-c158b1fdc2a8 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:24.784524 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-d31ca45d-a198-4503-bf8f-0fee58bfd867 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0bd75ee998d49dab7aaa335bba1aa10'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:24.850844 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1215/2422] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:57:24 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:57:24.854771 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8346f-4678-4e66-a4a0-c158b1fdc2a8 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:24.865370 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8346f-4678-4e66-a4a0-c158b1fdc2a8 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:24.867885 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-d31ca45d-a198-4503-bf8f-0fee58bfd867 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0bd75ee998d49dab7aaa335bba1aa10'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:24.869217 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-d31ca45d-a198-4503-bf8f-0fee58bfd867 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0bd75ee998d49dab7aaa335bba1aa10'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:24.869696 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-d31ca45d-a198-4503-bf8f-0fee58bfd867 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0bd75ee998d49dab7aaa335bba1aa10'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:24.871571 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6144960-1ad7-4245-a520-4d4e39808eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:24.872167 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6144960-1ad7-4245-a520-4d4e39808eae admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:24.872508 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6144960-1ad7-4245-a520-4d4e39808eae admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:24.872699 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6144960-1ad7-4245-a520-4d4e39808eae admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:24.873378 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6144960-1ad7-4245-a520-4d4e39808eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:24.874980 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6144960-1ad7-4245-a520-4d4e39808eae admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:24.878256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-d31ca45d-a198-4503-bf8f-0fee58bfd867 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0bd75ee998d49dab7aaa335bba1aa10'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:24.890312 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1216/2423] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:57:24.891852 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6144960-1ad7-4245-a520-4d4e39808eae admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:24.894159 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-c6144960-1ad7-4245-a520-4d4e39808eae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:24.897781 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1208/2424] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:57:24 2022] DELETE /identity/v3/users/b0bd75ee998d49dab7aaa335bba1aa10 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:24.907011 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70fa96-216c-4bf9-900a-f77fe795c397 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:24.907300 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70fa96-216c-4bf9-900a-f77fe795c397 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:24.907597 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70fa96-216c-4bf9-900a-f77fe795c397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:24.908002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6144960-1ad7-4245-a520-4d4e39808eae admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:24.927863 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-1f70fa96-216c-4bf9-900a-f77fe795c397 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:24.931770 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-1f70fa96-216c-4bf9-900a-f77fe795c397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:24.968790 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9efe8a-ef33-4a2f-8726-08125bf97fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:24.969772 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9efe8a-ef33-4a2f-8726-08125bf97fbd admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:24.970160 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9efe8a-ef33-4a2f-8726-08125bf97fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:24.970570 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9efe8a-ef33-4a2f-8726-08125bf97fbd admin admin] PATH_INFO: `/v3/projects/95f69d9b4b9344c0a5442bd3616a0491/users/bd62361e072242688c7478b269f147c6/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:24.989299 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9efe8a-ef33-4a2f-8726-08125bf97fbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=95f69d9b4b9344c0a5442bd3616a0491, user_id=bd62361e072242688c7478b269f147c6, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:24.992221 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9efe8a-ef33-4a2f-8726-08125bf97fbd admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:24.993459 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1209/2425] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:57:25.003805 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70fa96-216c-4bf9-900a-f77fe795c397 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:25.007203 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-1f70fa96-216c-4bf9-900a-f77fe795c397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:25.062846 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70fa96-216c-4bf9-900a-f77fe795c397 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:25.067413 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a69ea-d7ce-4065-9f68-c8e27f22b0fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:25.068021 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a69ea-d7ce-4065-9f68-c8e27f22b0fe service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:25.068304 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a69ea-d7ce-4065-9f68-c8e27f22b0fe service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:25.068580 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a69ea-d7ce-4065-9f68-c8e27f22b0fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:25.077741 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a69ea-d7ce-4065-9f68-c8e27f22b0fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:25.079161 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a69ea-d7ce-4065-9f68-c8e27f22b0fe service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:25.089061 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1210/2426] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:57:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:57:25.093107 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1217/2427] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:57:24 2022] PUT /identity/v3/projects/95f69d9b4b9344c0a5442bd3616a0491/users/bd62361e072242688c7478b269f147c6/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:57:25.094308 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a69ea-d7ce-4065-9f68-c8e27f22b0fe service neutron] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:25.104188 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a69ea-d7ce-4065-9f68-c8e27f22b0fe service neutron] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:25.144828 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:25.168814 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c0c5c-195f-444b-9145-a5fdfc199e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:25.169457 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c0c5c-195f-444b-9145-a5fdfc199e56 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:25.169744 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c0c5c-195f-444b-9145-a5fdfc199e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:25.170040 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c0c5c-195f-444b-9145-a5fdfc199e56 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:25.170681 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c0c5c-195f-444b-9145-a5fdfc199e56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:25.172291 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c0c5c-195f-444b-9145-a5fdfc199e56 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:25.186899 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1211/2428] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:57:25.188164 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9efe8a-ef33-4a2f-8726-08125bf97fbd admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:25.198749 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9efe8a-ef33-4a2f-8726-08125bf97fbd admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:25.203477 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8309c0-c583-4b0f-830c-b7b0e1e6dc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:25.204113 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8309c0-c583-4b0f-830c-b7b0e1e6dc77 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:25.207845 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8309c0-c583-4b0f-830c-b7b0e1e6dc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:25.207845 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8309c0-c583-4b0f-830c-b7b0e1e6dc77 admin admin] PATH_INFO: `/v3/projects/95f69d9b4b9344c0a5442bd3616a0491/users/bd62361e072242688c7478b269f147c6/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:25.207845 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8309c0-c583-4b0f-830c-b7b0e1e6dc77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95f69d9b4b9344c0a5442bd3616a0491, user_id=bd62361e072242688c7478b269f147c6, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:25.209483 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8309c0-c583-4b0f-830c-b7b0e1e6dc77 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:25.211701 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:25.220345 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1218/2429] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:57:25 2022] PUT /identity/v3/projects/95f69d9b4b9344c0a5442bd3616a0491/users/bd62361e072242688c7478b269f147c6/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:57:25.232828 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ce849-6e07-4dd8-a3b5-283e589f192c None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:25.236567 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ce849-6e07-4dd8-a3b5-283e589f192c None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:25.236567 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ce849-6e07-4dd8-a3b5-283e589f192c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:25.262169 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-442ce849-6e07-4dd8-a3b5-283e589f192c None None] MFA Rules not processed for user `bd62361e072242688c7478b269f147c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:25.265380 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-442ce849-6e07-4dd8-a3b5-283e589f192c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:25.340148 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1212/2430] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:25 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:25.360617 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8309c0-c583-4b0f-830c-b7b0e1e6dc77 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:25.365433 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-4f8309c0-c583-4b0f-830c-b7b0e1e6dc77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:25.460239 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8309c0-c583-4b0f-830c-b7b0e1e6dc77 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:25.464488 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca726a3-f77c-48f6-990a-62ee8634a663 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:25.465416 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca726a3-f77c-48f6-990a-62ee8634a663 service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:25.468839 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca726a3-f77c-48f6-990a-62ee8634a663 service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:25.468839 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca726a3-f77c-48f6-990a-62ee8634a663 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:25.476870 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca726a3-f77c-48f6-990a-62ee8634a663 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:25.478550 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca726a3-f77c-48f6-990a-62ee8634a663 service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:25.489645 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1219/2431] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:57:25 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:57:25.583987 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ce849-6e07-4dd8-a3b5-283e589f192c None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:25.584990 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-442ce849-6e07-4dd8-a3b5-283e589f192c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:25.664547 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ce849-6e07-4dd8-a3b5-283e589f192c None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:25.670410 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c0e5f1-d9cf-43d8-876b-7a3787ef9b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:25.671110 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0e5f1-d9cf-43d8-876b-7a3787ef9b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:25.671363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0e5f1-d9cf-43d8-876b-7a3787ef9b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:25.671638 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0e5f1-d9cf-43d8-876b-7a3787ef9b4b admin admin] PATH_INFO: `/v3/projects/ba688337094c4ff6a779b69db679b721` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:25.672797 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c0e5f1-d9cf-43d8-876b-7a3787ef9b4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba688337094c4ff6a779b69db679b721)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:25.678666 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c0e5f1-d9cf-43d8-876b-7a3787ef9b4b admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:25.686662 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca726a3-f77c-48f6-990a-62ee8634a663 service cinder] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:25.695719 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca726a3-f77c-48f6-990a-62ee8634a663 service cinder] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:25.699197 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4dbbb3-1517-402a-b986-c02d4450dd69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:25.699786 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4dbbb3-1517-402a-b986-c02d4450dd69 service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:25.700062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4dbbb3-1517-402a-b986-c02d4450dd69 service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:25.700331 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4dbbb3-1517-402a-b986-c02d4450dd69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:25.702067 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-5c4dbbb3-1517-402a-b986-c02d4450dd69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:25.761171 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4dbbb3-1517-402a-b986-c02d4450dd69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:25.762654 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4dbbb3-1517-402a-b986-c02d4450dd69 service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:25.772429 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1220/2432] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:57:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:57:25.811384 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-72c0e5f1-d9cf-43d8-876b-7a3787ef9b4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba688337094c4ff6a779b69db679b721', 'request_id': 'req-72c0e5f1-d9cf-43d8-876b-7a3787ef9b4b'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:25.817787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-72c0e5f1-d9cf-43d8-876b-7a3787ef9b4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba688337094c4ff6a779b69db679b721', 'request_id': 'req-72c0e5f1-d9cf-43d8-876b-7a3787ef9b4b'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:25.820339 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:25.935476 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-72c0e5f1-d9cf-43d8-876b-7a3787ef9b4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba688337094c4ff6a779b69db679b721', 'request_id': 'req-72c0e5f1-d9cf-43d8-876b-7a3787ef9b4b'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:25.947788 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-72c0e5f1-d9cf-43d8-876b-7a3787ef9b4b admin admin] The token cache is being invalidate because project ba688337094c4ff6a779b69db679b721 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:57:25.948309 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-72c0e5f1-d9cf-43d8-876b-7a3787ef9b4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:25.948998 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-72c0e5f1-d9cf-43d8-876b-7a3787ef9b4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:25.950905 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1213/2433] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:57:25 2022] DELETE /identity/v3/projects/ba688337094c4ff6a779b69db679b721 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:25.954903 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4dbbb3-1517-402a-b986-c02d4450dd69 service cinder] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:25.967234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4dbbb3-1517-402a-b986-c02d4450dd69 service cinder] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:26.025268 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20476d1-93ca-4c21-813c-3574f37a2c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:26.025902 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20476d1-93ca-4c21-813c-3574f37a2c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:26.026186 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20476d1-93ca-4c21-813c-3574f37a2c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:26.026463 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20476d1-93ca-4c21-813c-3574f37a2c10 admin admin] PATH_INFO: `/v3/users/381d0511c41a4da0853157cf59d1fcfa` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:26.027610 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20476d1-93ca-4c21-813c-3574f37a2c10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=381d0511c41a4da0853157cf59d1fcfa)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:26.029552 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20476d1-93ca-4c21-813c-3574f37a2c10 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:26.204759 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:INSERT=1,keystone:SELECT=94,keystone:DELETE=5 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:26.215288 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-f20476d1-93ca-4c21-813c-3574f37a2c10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '381d0511c41a4da0853157cf59d1fcfa'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:26.278344 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-f20476d1-93ca-4c21-813c-3574f37a2c10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '381d0511c41a4da0853157cf59d1fcfa'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:26.278963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-f20476d1-93ca-4c21-813c-3574f37a2c10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '381d0511c41a4da0853157cf59d1fcfa'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:26.279870 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-f20476d1-93ca-4c21-813c-3574f37a2c10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '381d0511c41a4da0853157cf59d1fcfa'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:26.287310 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-f20476d1-93ca-4c21-813c-3574f37a2c10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '381d0511c41a4da0853157cf59d1fcfa'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:26.305420 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1221/2434] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:57:25 2022] DELETE /identity/v3/users/381d0511c41a4da0853157cf59d1fcfa => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:26.703218 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c0e5f1-d9cf-43d8-876b-7a3787ef9b4b admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:26.708477 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-72c0e5f1-d9cf-43d8-876b-7a3787ef9b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:26.721429 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c0e5f1-d9cf-43d8-876b-7a3787ef9b4b admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:26.779843 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab15474-19d2-4f5a-bebf-0a52068e117a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:26.780528 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab15474-19d2-4f5a-bebf-0a52068e117a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:26.780811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab15474-19d2-4f5a-bebf-0a52068e117a admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:26.781128 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab15474-19d2-4f5a-bebf-0a52068e117a admin admin] PATH_INFO: `/v3/projects/71a0d5b5397b484186ea5c7e007f8789` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:26.782256 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab15474-19d2-4f5a-bebf-0a52068e117a admin admin] RBAC: Authorizing `identity:delete_project(project_id=71a0d5b5397b484186ea5c7e007f8789)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:26.784232 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab15474-19d2-4f5a-bebf-0a52068e117a admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:26.907018 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-cab15474-19d2-4f5a-bebf-0a52068e117a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71a0d5b5397b484186ea5c7e007f8789', 'request_id': 'req-cab15474-19d2-4f5a-bebf-0a52068e117a'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:26.913365 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-cab15474-19d2-4f5a-bebf-0a52068e117a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71a0d5b5397b484186ea5c7e007f8789', 'request_id': 'req-cab15474-19d2-4f5a-bebf-0a52068e117a'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:26.998346 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-cab15474-19d2-4f5a-bebf-0a52068e117a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71a0d5b5397b484186ea5c7e007f8789', 'request_id': 'req-cab15474-19d2-4f5a-bebf-0a52068e117a'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:27.011320 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-cab15474-19d2-4f5a-bebf-0a52068e117a admin admin] The token cache is being invalidate because project 71a0d5b5397b484186ea5c7e007f8789 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:57:27.011641 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-cab15474-19d2-4f5a-bebf-0a52068e117a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:27.012279 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-cab15474-19d2-4f5a-bebf-0a52068e117a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:27.013812 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1214/2435] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:57:26 2022] DELETE /identity/v3/projects/71a0d5b5397b484186ea5c7e007f8789 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:27.021726 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ec807-3b2b-4fc9-b301-a6f6c3dadcc8 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:27.022239 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ec807-3b2b-4fc9-b301-a6f6c3dadcc8 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:27.022342 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ec807-3b2b-4fc9-b301-a6f6c3dadcc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:27.041993 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-af2ec807-3b2b-4fc9-b301-a6f6c3dadcc8 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:27.043260 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-af2ec807-3b2b-4fc9-b301-a6f6c3dadcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:27.103119 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1222/2436] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:27.111979 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858cc8e-5fdf-4de9-82ae-d82a5557db40 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:27.112871 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858cc8e-5fdf-4de9-82ae-d82a5557db40 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:27.113192 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858cc8e-5fdf-4de9-82ae-d82a5557db40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:27.133775 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-6858cc8e-5fdf-4de9-82ae-d82a5557db40 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:27.134994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-6858cc8e-5fdf-4de9-82ae-d82a5557db40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:27.142940 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1215/2437] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:27.147315 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ec807-3b2b-4fc9-b301-a6f6c3dadcc8 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:27.160408 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ec807-3b2b-4fc9-b301-a6f6c3dadcc8 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:27.165089 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f52b38-dafe-43e8-95eb-8a03daa22d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:27.165700 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f52b38-dafe-43e8-95eb-8a03daa22d86 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:27.165980 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f52b38-dafe-43e8-95eb-8a03daa22d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:27.166252 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f52b38-dafe-43e8-95eb-8a03daa22d86 admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:27.167036 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f52b38-dafe-43e8-95eb-8a03daa22d86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:57:27.167344 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f52b38-dafe-43e8-95eb-8a03daa22d86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:27.168934 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f52b38-dafe-43e8-95eb-8a03daa22d86 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:27.182240 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1223/2438] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:57:27.201376 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858cc8e-5fdf-4de9-82ae-d82a5557db40 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:27.211526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858cc8e-5fdf-4de9-82ae-d82a5557db40 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:27.216963 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2fdfd-f109-4a4f-9232-51dbbc3ef9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:27.217639 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2fdfd-f109-4a4f-9232-51dbbc3ef9e8 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:27.217922 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2fdfd-f109-4a4f-9232-51dbbc3ef9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:27.218195 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2fdfd-f109-4a4f-9232-51dbbc3ef9e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:27.218863 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb2fdfd-f109-4a4f-9232-51dbbc3ef9e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:27.220881 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb2fdfd-f109-4a4f-9232-51dbbc3ef9e8 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:27.330064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1216/2439] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:57:27 2022] POST /identity/v3/projects => generated 393 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:57:27.332353 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f52b38-dafe-43e8-95eb-8a03daa22d86 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:27.343451 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f52b38-dafe-43e8-95eb-8a03daa22d86 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:27.406393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750bfba-ef5a-4b4f-b360-c8e8ebbf973e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:27.406997 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750bfba-ef5a-4b4f-b360-c8e8ebbf973e admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:27.407285 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750bfba-ef5a-4b4f-b360-c8e8ebbf973e admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:27.407562 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750bfba-ef5a-4b4f-b360-c8e8ebbf973e admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:27.408186 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750bfba-ef5a-4b4f-b360-c8e8ebbf973e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:27.410139 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750bfba-ef5a-4b4f-b360-c8e8ebbf973e admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:27.478947 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1224/2440] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:57:27 2022] POST /identity/v3/users => generated 297 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:57:27.483263 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2fdfd-f109-4a4f-9232-51dbbc3ef9e8 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:27.494493 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2fdfd-f109-4a4f-9232-51dbbc3ef9e8 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:27.500118 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f7878-a996-48a2-a4a7-f4733548225d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:27.500723 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f7878-a996-48a2-a4a7-f4733548225d admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:27.501490 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f7878-a996-48a2-a4a7-f4733548225d admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:27.501490 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f7878-a996-48a2-a4a7-f4733548225d admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:27.501954 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f7878-a996-48a2-a4a7-f4733548225d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:27.503609 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f7878-a996-48a2-a4a7-f4733548225d admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:27.516082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1217/2441] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:57:27.520898 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750bfba-ef5a-4b4f-b360-c8e8ebbf973e admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:27.538773 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750bfba-ef5a-4b4f-b360-c8e8ebbf973e admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:27.538773 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f1c55-3d56-4300-bf6c-d42f79ac4925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:27.538773 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f1c55-3d56-4300-bf6c-d42f79ac4925 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:27.538773 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f1c55-3d56-4300-bf6c-d42f79ac4925 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:27.539244 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f1c55-3d56-4300-bf6c-d42f79ac4925 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:27.539244 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f1c55-3d56-4300-bf6c-d42f79ac4925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:27.539420 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f1c55-3d56-4300-bf6c-d42f79ac4925 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:27.552104 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1225/2442] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:57:27.556328 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f7878-a996-48a2-a4a7-f4733548225d admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:27.568046 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f7878-a996-48a2-a4a7-f4733548225d admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:27.572923 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23676d39-5032-4b54-89ad-791a3ea96387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:27.573590 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23676d39-5032-4b54-89ad-791a3ea96387 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:27.573866 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23676d39-5032-4b54-89ad-791a3ea96387 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:27.574136 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23676d39-5032-4b54-89ad-791a3ea96387 admin admin] PATH_INFO: `/v3/projects/7cdbade4cd49405496fed5cc50df5b80/users/b12dc7c932104f1cbb4bbfcd4fb5ef1f/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:27.588741 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23676d39-5032-4b54-89ad-791a3ea96387 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cdbade4cd49405496fed5cc50df5b80, user_id=b12dc7c932104f1cbb4bbfcd4fb5ef1f, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:27.591705 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23676d39-5032-4b54-89ad-791a3ea96387 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:27.679673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1218/2443] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:57:27 2022] PUT /identity/v3/projects/7cdbade4cd49405496fed5cc50df5b80/users/b12dc7c932104f1cbb4bbfcd4fb5ef1f/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:27.691546 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c0d79-286d-4ed4-97e2-4c18a38fe2aa None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:27.691866 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c0d79-286d-4ed4-97e2-4c18a38fe2aa None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:27.692146 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c0d79-286d-4ed4-97e2-4c18a38fe2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:27.720221 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-f05c0d79-286d-4ed4-97e2-4c18a38fe2aa None None] MFA Rules not processed for user `b12dc7c932104f1cbb4bbfcd4fb5ef1f`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:27.721564 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-f05c0d79-286d-4ed4-97e2-4c18a38fe2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:27.730491 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:27.790153 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1226/2444] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:27.794477 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23676d39-5032-4b54-89ad-791a3ea96387 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:27.813626 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:27.857732 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23676d39-5032-4b54-89ad-791a3ea96387 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:27.863543 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854501c8-83f0-4172-bfd3-c73eec42bce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:27.864155 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854501c8-83f0-4172-bfd3-c73eec42bce8 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:27.864441 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854501c8-83f0-4172-bfd3-c73eec42bce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:27.865852 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854501c8-83f0-4172-bfd3-c73eec42bce8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:27.865852 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854501c8-83f0-4172-bfd3-c73eec42bce8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:27.867859 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854501c8-83f0-4172-bfd3-c73eec42bce8 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:27.912167 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c0d79-286d-4ed4-97e2-4c18a38fe2aa None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:27.912167 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-f05c0d79-286d-4ed4-97e2-4c18a38fe2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:27.924620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c0d79-286d-4ed4-97e2-4c18a38fe2aa None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:27.936403 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26397599-db40-43eb-8bbc-bd82a083f7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:27.941315 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26397599-db40-43eb-8bbc-bd82a083f7ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:27.941315 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26397599-db40-43eb-8bbc-bd82a083f7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:27.941541 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1219/2445] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:57:27 2022] POST /identity/v3/projects => generated 391 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:57:27.941984 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26397599-db40-43eb-8bbc-bd82a083f7ba admin admin] PATH_INFO: `/v3/users/90d17781b19f423e86f7d5fc891eb272` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:27.941984 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26397599-db40-43eb-8bbc-bd82a083f7ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=90d17781b19f423e86f7d5fc891eb272)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:27.941984 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26397599-db40-43eb-8bbc-bd82a083f7ba admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:27.944020 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854501c8-83f0-4172-bfd3-c73eec42bce8 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:28.006781 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854501c8-83f0-4172-bfd3-c73eec42bce8 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:28.011477 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744649f-be7f-414f-82ce-f29dbe63bb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:28.012077 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744649f-be7f-414f-82ce-f29dbe63bb74 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:28.012357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744649f-be7f-414f-82ce-f29dbe63bb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:28.012631 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744649f-be7f-414f-82ce-f29dbe63bb74 admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:28.013355 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744649f-be7f-414f-82ce-f29dbe63bb74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:28.015290 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744649f-be7f-414f-82ce-f29dbe63bb74 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:28.144464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1220/2446] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:57:27 2022] POST /identity/v3/users => generated 302 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:57:28.145706 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744649f-be7f-414f-82ce-f29dbe63bb74 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:28.149742 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-26397599-db40-43eb-8bbc-bd82a083f7ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90d17781b19f423e86f7d5fc891eb272'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:28.155910 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744649f-be7f-414f-82ce-f29dbe63bb74 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:28.161328 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad232ca-d9b6-4cc5-8a93-a3ec8725dae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:28.161958 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad232ca-d9b6-4cc5-8a93-a3ec8725dae8 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:28.162270 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad232ca-d9b6-4cc5-8a93-a3ec8725dae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:28.162783 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad232ca-d9b6-4cc5-8a93-a3ec8725dae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:28.163714 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad232ca-d9b6-4cc5-8a93-a3ec8725dae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:28.166081 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad232ca-d9b6-4cc5-8a93-a3ec8725dae8 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:28.187618 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1221/2447] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:57:28.191873 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad232ca-d9b6-4cc5-8a93-a3ec8725dae8 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:28.201563 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad232ca-d9b6-4cc5-8a93-a3ec8725dae8 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:28.206675 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609f110-a65d-47d2-92cd-c09856f56238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:28.207309 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609f110-a65d-47d2-92cd-c09856f56238 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:28.207584 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609f110-a65d-47d2-92cd-c09856f56238 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:28.209806 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609f110-a65d-47d2-92cd-c09856f56238 admin admin] PATH_INFO: `/v3/projects/debe43ba44a6420894bccbfe87815c81/users/91d12e3fb6a046669abeddfdb667bced/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:28.223096 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609f110-a65d-47d2-92cd-c09856f56238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=debe43ba44a6420894bccbfe87815c81, user_id=91d12e3fb6a046669abeddfdb667bced, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:28.225844 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609f110-a65d-47d2-92cd-c09856f56238 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:28.249507 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-26397599-db40-43eb-8bbc-bd82a083f7ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90d17781b19f423e86f7d5fc891eb272'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:28.250163 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-26397599-db40-43eb-8bbc-bd82a083f7ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90d17781b19f423e86f7d5fc891eb272'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:28.250773 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-26397599-db40-43eb-8bbc-bd82a083f7ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90d17781b19f423e86f7d5fc891eb272'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:28.258442 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-26397599-db40-43eb-8bbc-bd82a083f7ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90d17781b19f423e86f7d5fc891eb272'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:28.277825 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1227/2448] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:57:27 2022] DELETE /identity/v3/users/90d17781b19f423e86f7d5fc891eb272 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:57:28.282229 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7adf3-22df-442e-ad01-cdb321b66b61 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:28.282582 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7adf3-22df-442e-ad01-cdb321b66b61 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:28.282793 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7adf3-22df-442e-ad01-cdb321b66b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:28.302274 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-68f7adf3-22df-442e-ad01-cdb321b66b61 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:28.303623 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-68f7adf3-22df-442e-ad01-cdb321b66b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:28.318341 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1222/2449] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:57:28 2022] PUT /identity/v3/projects/debe43ba44a6420894bccbfe87815c81/users/91d12e3fb6a046669abeddfdb667bced/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:57:28.322169 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609f110-a65d-47d2-92cd-c09856f56238 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:28.323759 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-e609f110-a65d-47d2-92cd-c09856f56238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:28.363815 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1228/2450] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:57:28.374069 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7adf3-22df-442e-ad01-cdb321b66b61 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:28.375461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-68f7adf3-22df-442e-ad01-cdb321b66b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:28.387171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:28.397571 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609f110-a65d-47d2-92cd-c09856f56238 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:28.398100 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff3e1b-e62d-48ef-8905-7d7a0f4a8df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:28.398849 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff3e1b-e62d-48ef-8905-7d7a0f4a8df4 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:28.399138 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff3e1b-e62d-48ef-8905-7d7a0f4a8df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:28.399413 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff3e1b-e62d-48ef-8905-7d7a0f4a8df4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:28.400059 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff3e1b-e62d-48ef-8905-7d7a0f4a8df4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:28.401744 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff3e1b-e62d-48ef-8905-7d7a0f4a8df4 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:28.403225 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:28.416652 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1223/2451] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:57:28.417713 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff3e1b-e62d-48ef-8905-7d7a0f4a8df4 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:28.428800 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff3e1b-e62d-48ef-8905-7d7a0f4a8df4 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:28.433556 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68746f-5e86-46ff-ba8a-935393a549d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:28.434233 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68746f-5e86-46ff-ba8a-935393a549d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:28.434522 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68746f-5e86-46ff-ba8a-935393a549d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:28.434797 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68746f-5e86-46ff-ba8a-935393a549d9 admin admin] PATH_INFO: `/v3/projects/debe43ba44a6420894bccbfe87815c81/users/91d12e3fb6a046669abeddfdb667bced/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:28.436115 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7adf3-22df-442e-ad01-cdb321b66b61 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:28.436737 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68746f-5e86-46ff-ba8a-935393a549d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=debe43ba44a6420894bccbfe87815c81, user_id=91d12e3fb6a046669abeddfdb667bced, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:28.439421 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68746f-5e86-46ff-ba8a-935393a549d9 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:28.450085 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1224/2452] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:57:28 2022] PUT /identity/v3/projects/debe43ba44a6420894bccbfe87815c81/users/91d12e3fb6a046669abeddfdb667bced/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:28.460946 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96664313-dd83-4c1b-a2b0-04e9d59b6e11 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:28.461320 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96664313-dd83-4c1b-a2b0-04e9d59b6e11 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:28.462017 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96664313-dd83-4c1b-a2b0-04e9d59b6e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:28.487546 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a63aa-250b-4c1c-b121-f0d70c84f30c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:28.488252 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a63aa-250b-4c1c-b121-f0d70c84f30c service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:28.488540 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a63aa-250b-4c1c-b121-f0d70c84f30c service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:28.488807 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a63aa-250b-4c1c-b121-f0d70c84f30c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:28.493379 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-96664313-dd83-4c1b-a2b0-04e9d59b6e11 None None] MFA Rules not processed for user `91d12e3fb6a046669abeddfdb667bced`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:28.494772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-96664313-dd83-4c1b-a2b0-04e9d59b6e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:28.499259 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a63aa-250b-4c1c-b121-f0d70c84f30c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:28.500755 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a63aa-250b-4c1c-b121-f0d70c84f30c service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:28.511127 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1229/2453] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:57:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:57:28.567657 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1225/2454] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:28 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:57:28.578667 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a63aa-250b-4c1c-b121-f0d70c84f30c service neutron] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:28.580205 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-bb1a63aa-250b-4c1c-b121-f0d70c84f30c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:28.640145 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a63aa-250b-4c1c-b121-f0d70c84f30c service neutron] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:28.690769 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bdaf0-bbb0-42b9-b498-11dc0b0785f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:28.691379 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bdaf0-bbb0-42b9-b498-11dc0b0785f8 service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:28.691662 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bdaf0-bbb0-42b9-b498-11dc0b0785f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:28.691940 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bdaf0-bbb0-42b9-b498-11dc0b0785f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:28.701591 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172bdaf0-bbb0-42b9-b498-11dc0b0785f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:28.703283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172bdaf0-bbb0-42b9-b498-11dc0b0785f8 service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:28.717951 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1230/2455] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:57:28 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:57:28.769064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96664313-dd83-4c1b-a2b0-04e9d59b6e11 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:28.770497 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-96664313-dd83-4c1b-a2b0-04e9d59b6e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:28.783378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96664313-dd83-4c1b-a2b0-04e9d59b6e11 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:28.787680 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1b21d-2bdf-45ce-8b7f-16b0f3bf1542 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:28.788354 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1b21d-2bdf-45ce-8b7f-16b0f3bf1542 service cinder] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:28.788553 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1b21d-2bdf-45ce-8b7f-16b0f3bf1542 service cinder] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:28.788822 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1b21d-2bdf-45ce-8b7f-16b0f3bf1542 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:28.790586 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-16f1b21d-2bdf-45ce-8b7f-16b0f3bf1542 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:28.852459 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1b21d-2bdf-45ce-8b7f-16b0f3bf1542 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:28.854107 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1b21d-2bdf-45ce-8b7f-16b0f3bf1542 service cinder] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:28.863898 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1226/2456] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:57:28 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:57:28.930470 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bdaf0-bbb0-42b9-b498-11dc0b0785f8 service cinder] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:28.930470 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-172bdaf0-bbb0-42b9-b498-11dc0b0785f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:28.994737 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:29.018103 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bdaf0-bbb0-42b9-b498-11dc0b0785f8 service cinder] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:29.023356 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b16cf4-4636-4442-a3e7-e7659ce36609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:29.023982 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b16cf4-4636-4442-a3e7-e7659ce36609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:29.024264 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b16cf4-4636-4442-a3e7-e7659ce36609 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:29.024537 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b16cf4-4636-4442-a3e7-e7659ce36609 admin admin] PATH_INFO: `/v3/projects/4775d4a9a26c49ba889faa8401589909` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:29.025676 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b16cf4-4636-4442-a3e7-e7659ce36609 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4775d4a9a26c49ba889faa8401589909)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:29.027614 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b16cf4-4636-4442-a3e7-e7659ce36609 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:29.186067 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-49b16cf4-4636-4442-a3e7-e7659ce36609 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4775d4a9a26c49ba889faa8401589909', 'request_id': 'req-49b16cf4-4636-4442-a3e7-e7659ce36609'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:29.191456 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-49b16cf4-4636-4442-a3e7-e7659ce36609 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4775d4a9a26c49ba889faa8401589909', 'request_id': 'req-49b16cf4-4636-4442-a3e7-e7659ce36609'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:29.219028 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1b21d-2bdf-45ce-8b7f-16b0f3bf1542 service cinder] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:29.220476 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-16f1b21d-2bdf-45ce-8b7f-16b0f3bf1542 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:29.234923 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1b21d-2bdf-45ce-8b7f-16b0f3bf1542 service cinder] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:29.293571 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aaba2d-6a72-43ea-8fe1-e86e377f3dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:29.294209 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aaba2d-6a72-43ea-8fe1-e86e377f3dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:29.294493 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aaba2d-6a72-43ea-8fe1-e86e377f3dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:29.294776 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aaba2d-6a72-43ea-8fe1-e86e377f3dfd admin admin] PATH_INFO: `/v3/users/77d109dccaf14053ab8fee2de7a3dd91` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:29.295899 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-49b16cf4-4636-4442-a3e7-e7659ce36609 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4775d4a9a26c49ba889faa8401589909', 'request_id': 'req-49b16cf4-4636-4442-a3e7-e7659ce36609'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:29.296029 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aaba2d-6a72-43ea-8fe1-e86e377f3dfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=77d109dccaf14053ab8fee2de7a3dd91)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:29.297875 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aaba2d-6a72-43ea-8fe1-e86e377f3dfd admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:29.300301 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:29.307958 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-49b16cf4-4636-4442-a3e7-e7659ce36609 admin admin] The token cache is being invalidate because project 4775d4a9a26c49ba889faa8401589909 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:57:29.310014 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-49b16cf4-4636-4442-a3e7-e7659ce36609 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:29.310014 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-49b16cf4-4636-4442-a3e7-e7659ce36609 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:29.310520 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1231/2457] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:57:28 2022] DELETE /identity/v3/projects/4775d4a9a26c49ba889faa8401589909 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:29.316253 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffea5a-ac77-4178-909b-1ab33d775d60 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:29.316650 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffea5a-ac77-4178-909b-1ab33d775d60 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:29.316959 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffea5a-ac77-4178-909b-1ab33d775d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:29.337350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-5cffea5a-ac77-4178-909b-1ab33d775d60 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:29.338718 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-5cffea5a-ac77-4178-909b-1ab33d775d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:29.346941 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1232/2458] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:57:29.354532 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332444d-341c-48bc-8c29-7926dada62ef None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:29.354817 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332444d-341c-48bc-8c29-7926dada62ef None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:29.355091 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332444d-341c-48bc-8c29-7926dada62ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:29.374800 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-3332444d-341c-48bc-8c29-7926dada62ef None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:29.376015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-3332444d-341c-48bc-8c29-7926dada62ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:29.384650 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1233/2459] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:57:29.388895 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332444d-341c-48bc-8c29-7926dada62ef None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:29.399081 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332444d-341c-48bc-8c29-7926dada62ef None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:29.403900 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aae23a-1953-4dc8-b5da-e3bdbeb9c4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:29.404496 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aae23a-1953-4dc8-b5da-e3bdbeb9c4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:29.404780 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aae23a-1953-4dc8-b5da-e3bdbeb9c4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:29.405080 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aae23a-1953-4dc8-b5da-e3bdbeb9c4d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:29.405732 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aae23a-1953-4dc8-b5da-e3bdbeb9c4d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:57:29.406036 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aae23a-1953-4dc8-b5da-e3bdbeb9c4d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:29.407714 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aae23a-1953-4dc8-b5da-e3bdbeb9c4d7 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:29.419835 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1234/2460] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:57:29.425345 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aae23a-1953-4dc8-b5da-e3bdbeb9c4d7 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:29.435743 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aae23a-1953-4dc8-b5da-e3bdbeb9c4d7 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:29.440898 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7968b-c7de-43d3-b97f-d25acc5b83c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:29.441448 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7968b-c7de-43d3-b97f-d25acc5b83c2 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:29.441736 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7968b-c7de-43d3-b97f-d25acc5b83c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:29.442017 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7968b-c7de-43d3-b97f-d25acc5b83c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:29.442740 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7968b-c7de-43d3-b97f-d25acc5b83c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:29.444590 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7968b-c7de-43d3-b97f-d25acc5b83c2 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:29.488360 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-f9aaba2d-6a72-43ea-8fe1-e86e377f3dfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77d109dccaf14053ab8fee2de7a3dd91'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:29.560908 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-f9aaba2d-6a72-43ea-8fe1-e86e377f3dfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77d109dccaf14053ab8fee2de7a3dd91'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:29.561700 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-f9aaba2d-6a72-43ea-8fe1-e86e377f3dfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77d109dccaf14053ab8fee2de7a3dd91'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:29.562418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-f9aaba2d-6a72-43ea-8fe1-e86e377f3dfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77d109dccaf14053ab8fee2de7a3dd91'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:29.566716 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1235/2461] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:57:29 2022] POST /identity/v3/projects => generated 371 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:57:29.571324 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7968b-c7de-43d3-b97f-d25acc5b83c2 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:29.571538 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-f9aaba2d-6a72-43ea-8fe1-e86e377f3dfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77d109dccaf14053ab8fee2de7a3dd91'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:29.573194 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-54f7968b-c7de-43d3-b97f-d25acc5b83c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:29.590347 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1227/2462] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:57:29 2022] DELETE /identity/v3/users/77d109dccaf14053ab8fee2de7a3dd91 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:57:29.600228 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631930c5-1749-427a-96b5-56761e9b5054 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:29.600514 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631930c5-1749-427a-96b5-56761e9b5054 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:29.600788 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631930c5-1749-427a-96b5-56761e9b5054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:29.621193 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-631930c5-1749-427a-96b5-56761e9b5054 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:29.622582 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-631930c5-1749-427a-96b5-56761e9b5054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:29.656224 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7968b-c7de-43d3-b97f-d25acc5b83c2 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:29.685580 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:29.694355 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1228/2463] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:57:29.701311 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631930c5-1749-427a-96b5-56761e9b5054 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:29.705422 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-631930c5-1749-427a-96b5-56761e9b5054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:29.718718 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765cc830-3e88-4f8a-8982-f66909f2e911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:29.719408 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765cc830-3e88-4f8a-8982-f66909f2e911 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:29.719761 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765cc830-3e88-4f8a-8982-f66909f2e911 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:29.720103 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765cc830-3e88-4f8a-8982-f66909f2e911 admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:29.720788 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765cc830-3e88-4f8a-8982-f66909f2e911 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:29.723431 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765cc830-3e88-4f8a-8982-f66909f2e911 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:29.760372 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631930c5-1749-427a-96b5-56761e9b5054 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:29.763996 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348f1ca-4565-4f00-a757-82a962f26b77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:29.764597 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348f1ca-4565-4f00-a757-82a962f26b77 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:29.764875 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348f1ca-4565-4f00-a757-82a962f26b77 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:29.765183 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348f1ca-4565-4f00-a757-82a962f26b77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:29.774624 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a348f1ca-4565-4f00-a757-82a962f26b77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:29.776039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a348f1ca-4565-4f00-a757-82a962f26b77 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:29.785930 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1229/2464] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:57:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:57:29.818974 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1236/2465] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:57:29 2022] POST /identity/v3/users => generated 286 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:57:29.820139 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348f1ca-4565-4f00-a757-82a962f26b77 service neutron] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:29.829763 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348f1ca-4565-4f00-a757-82a962f26b77 service neutron] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:29.835191 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb198be-5510-4a0c-89ee-2dd1bb9e503f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:29.835866 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb198be-5510-4a0c-89ee-2dd1bb9e503f admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:29.836200 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb198be-5510-4a0c-89ee-2dd1bb9e503f admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:29.839450 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb198be-5510-4a0c-89ee-2dd1bb9e503f admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:29.839450 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb198be-5510-4a0c-89ee-2dd1bb9e503f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:29.839450 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb198be-5510-4a0c-89ee-2dd1bb9e503f admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:29.850253 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1230/2466] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:57:29.854385 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765cc830-3e88-4f8a-8982-f66909f2e911 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:29.864506 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765cc830-3e88-4f8a-8982-f66909f2e911 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:29.869934 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3472da4-eb8e-4514-a474-978e6066eed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:29.870549 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3472da4-eb8e-4514-a474-978e6066eed4 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:29.870832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3472da4-eb8e-4514-a474-978e6066eed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:29.871699 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3472da4-eb8e-4514-a474-978e6066eed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:29.872359 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3472da4-eb8e-4514-a474-978e6066eed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:29.874090 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3472da4-eb8e-4514-a474-978e6066eed4 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:29.885059 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1237/2467] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:57:29.888964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb198be-5510-4a0c-89ee-2dd1bb9e503f admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:29.899866 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb198be-5510-4a0c-89ee-2dd1bb9e503f admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:29.906912 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c85d7c-0790-4c04-920b-0bba6680e322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:29.906912 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c85d7c-0790-4c04-920b-0bba6680e322 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:29.906912 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c85d7c-0790-4c04-920b-0bba6680e322 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:29.906912 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c85d7c-0790-4c04-920b-0bba6680e322 admin admin] PATH_INFO: `/v3/projects/00ca3c24e4d246c3872c2ef62784bf98/users/5fbb94b57e8a4d3c83a4cab9598a5a1f/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:29.921261 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c85d7c-0790-4c04-920b-0bba6680e322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00ca3c24e4d246c3872c2ef62784bf98, user_id=5fbb94b57e8a4d3c83a4cab9598a5a1f, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:29.924054 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c85d7c-0790-4c04-920b-0bba6680e322 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:30.022106 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1231/2468] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:57:29 2022] PUT /identity/v3/projects/00ca3c24e4d246c3872c2ef62784bf98/users/5fbb94b57e8a4d3c83a4cab9598a5a1f/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:30.030830 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08125a61-a9aa-483e-bf73-19ee4218860c None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:30.031122 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08125a61-a9aa-483e-bf73-19ee4218860c None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:30.031402 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08125a61-a9aa-483e-bf73-19ee4218860c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:30.039014 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:30.062212 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-08125a61-a9aa-483e-bf73-19ee4218860c None None] MFA Rules not processed for user `5fbb94b57e8a4d3c83a4cab9598a5a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:30.063471 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-08125a61-a9aa-483e-bf73-19ee4218860c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:30.130315 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1238/2469] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:30.135059 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c85d7c-0790-4c04-920b-0bba6680e322 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:30.196769 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08125a61-a9aa-483e-bf73-19ee4218860c None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:30.198357 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-08125a61-a9aa-483e-bf73-19ee4218860c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:30.198789 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c85d7c-0790-4c04-920b-0bba6680e322 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:30.203838 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939bfda3-eaa1-4ab1-9599-a813d729bce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:30.205024 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939bfda3-eaa1-4ab1-9599-a813d729bce1 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:30.205024 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939bfda3-eaa1-4ab1-9599-a813d729bce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:30.205024 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939bfda3-eaa1-4ab1-9599-a813d729bce1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:30.205737 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939bfda3-eaa1-4ab1-9599-a813d729bce1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:30.208295 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939bfda3-eaa1-4ab1-9599-a813d729bce1 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:30.215658 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08125a61-a9aa-483e-bf73-19ee4218860c None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:30.221125 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45a23e-56ab-4018-9093-77dac7714baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:30.222511 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45a23e-56ab-4018-9093-77dac7714baf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:30.222791 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45a23e-56ab-4018-9093-77dac7714baf admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:30.223056 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45a23e-56ab-4018-9093-77dac7714baf admin admin] PATH_INFO: `/v3/projects/7a3f3ea76e3a4bcbbc0b1bf0b665cce2` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:30.224434 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45a23e-56ab-4018-9093-77dac7714baf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a3f3ea76e3a4bcbbc0b1bf0b665cce2)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:30.226368 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45a23e-56ab-4018-9093-77dac7714baf admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:30.302795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1232/2470] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:57:30 2022] POST /identity/v3/projects => generated 371 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:57:30.306889 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939bfda3-eaa1-4ab1-9599-a813d729bce1 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:30.344123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-0b45a23e-56ab-4018-9093-77dac7714baf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a3f3ea76e3a4bcbbc0b1bf0b665cce2', 'request_id': 'req-0b45a23e-56ab-4018-9093-77dac7714baf'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:30.350131 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-0b45a23e-56ab-4018-9093-77dac7714baf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a3f3ea76e3a4bcbbc0b1bf0b665cce2', 'request_id': 'req-0b45a23e-56ab-4018-9093-77dac7714baf'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:30.369574 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939bfda3-eaa1-4ab1-9599-a813d729bce1 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:30.426923 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2194ea1-8d27-4dc4-9c1d-dd2693823cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:30.427534 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2194ea1-8d27-4dc4-9c1d-dd2693823cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:30.427829 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2194ea1-8d27-4dc4-9c1d-dd2693823cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:30.428097 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2194ea1-8d27-4dc4-9c1d-dd2693823cf4 admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:30.428743 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2194ea1-8d27-4dc4-9c1d-dd2693823cf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:30.430682 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2194ea1-8d27-4dc4-9c1d-dd2693823cf4 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:30.432618 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-0b45a23e-56ab-4018-9093-77dac7714baf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a3f3ea76e3a4bcbbc0b1bf0b665cce2', 'request_id': 'req-0b45a23e-56ab-4018-9093-77dac7714baf'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:30.446110 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-0b45a23e-56ab-4018-9093-77dac7714baf admin admin] The token cache is being invalidate because project 7a3f3ea76e3a4bcbbc0b1bf0b665cce2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:57:30.446405 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-0b45a23e-56ab-4018-9093-77dac7714baf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:30.447083 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-0b45a23e-56ab-4018-9093-77dac7714baf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:30.448633 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1239/2471] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:57:30 2022] DELETE /identity/v3/projects/7a3f3ea76e3a4bcbbc0b1bf0b665cce2 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:57:30.452508 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45a23e-56ab-4018-9093-77dac7714baf admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:30.453913 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-0b45a23e-56ab-4018-9093-77dac7714baf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:30.467225 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45a23e-56ab-4018-9093-77dac7714baf admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:30.471887 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdfe4d-b2a3-487b-8d7b-b62424848719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:30.473149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdfe4d-b2a3-487b-8d7b-b62424848719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:30.473149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdfe4d-b2a3-487b-8d7b-b62424848719 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:30.473149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdfe4d-b2a3-487b-8d7b-b62424848719 admin admin] PATH_INFO: `/v3/users/bd62361e072242688c7478b269f147c6` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:30.474159 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cdfe4d-b2a3-487b-8d7b-b62424848719 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd62361e072242688c7478b269f147c6)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:30.476076 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cdfe4d-b2a3-487b-8d7b-b62424848719 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:30.490580 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:30.518646 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1233/2472] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:57:30 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:57:30.522524 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2194ea1-8d27-4dc4-9c1d-dd2693823cf4 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:30.524087 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-b2194ea1-8d27-4dc4-9c1d-dd2693823cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:30.535843 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2194ea1-8d27-4dc4-9c1d-dd2693823cf4 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:30.541825 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899be050-11bd-4bff-a3ba-83fbbfe55a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:30.542412 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899be050-11bd-4bff-a3ba-83fbbfe55a70 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:30.542689 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899be050-11bd-4bff-a3ba-83fbbfe55a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:30.542958 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899be050-11bd-4bff-a3ba-83fbbfe55a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:30.543585 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899be050-11bd-4bff-a3ba-83fbbfe55a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:30.545201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899be050-11bd-4bff-a3ba-83fbbfe55a70 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:30.551225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:30.556113 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1234/2473] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:57:30.560207 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899be050-11bd-4bff-a3ba-83fbbfe55a70 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:30.570446 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899be050-11bd-4bff-a3ba-83fbbfe55a70 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:30.575098 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a3fb7-dc9f-4e92-9d25-013c127035c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:30.575721 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a3fb7-dc9f-4e92-9d25-013c127035c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:30.576004 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a3fb7-dc9f-4e92-9d25-013c127035c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:30.576278 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a3fb7-dc9f-4e92-9d25-013c127035c8 admin admin] PATH_INFO: `/v3/projects/8bdec3d739784107bf3c004ed236c6a8/users/2e3c32db9cd5491fbc3c793c50953d3e/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:30.591099 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a3fb7-dc9f-4e92-9d25-013c127035c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bdec3d739784107bf3c004ed236c6a8, user_id=2e3c32db9cd5491fbc3c793c50953d3e, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:30.593762 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a3fb7-dc9f-4e92-9d25-013c127035c8 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:30.630361 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-62cdfe4d-b2a3-487b-8d7b-b62424848719 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd62361e072242688c7478b269f147c6'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:30.661640 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1235/2474] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:57:30 2022] PUT /identity/v3/projects/8bdec3d739784107bf3c004ed236c6a8/users/2e3c32db9cd5491fbc3c793c50953d3e/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:57:30.665606 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a3fb7-dc9f-4e92-9d25-013c127035c8 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:30.678423 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-62cdfe4d-b2a3-487b-8d7b-b62424848719 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd62361e072242688c7478b269f147c6'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:30.679332 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-62cdfe4d-b2a3-487b-8d7b-b62424848719 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd62361e072242688c7478b269f147c6'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:30.679988 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-62cdfe4d-b2a3-487b-8d7b-b62424848719 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd62361e072242688c7478b269f147c6'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:30.688642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-62cdfe4d-b2a3-487b-8d7b-b62424848719 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd62361e072242688c7478b269f147c6'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:30.709490 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1240/2475] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:57:30 2022] DELETE /identity/v3/users/bd62361e072242688c7478b269f147c6 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:57:30.737631 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a3fb7-dc9f-4e92-9d25-013c127035c8 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:30.798822 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f22e0-4794-4e7b-8c16-15763b9a1221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:30.800010 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f22e0-4794-4e7b-8c16-15763b9a1221 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:30.800388 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f22e0-4794-4e7b-8c16-15763b9a1221 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:30.800685 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f22e0-4794-4e7b-8c16-15763b9a1221 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:30.801341 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f22e0-4794-4e7b-8c16-15763b9a1221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:30.803009 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f22e0-4794-4e7b-8c16-15763b9a1221 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:30.818510 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1236/2476] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:57:30.819733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdfe4d-b2a3-487b-8d7b-b62424848719 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:30.821383 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-62cdfe4d-b2a3-487b-8d7b-b62424848719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:30.834355 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdfe4d-b2a3-487b-8d7b-b62424848719 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:30.839136 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22017bd4-dccb-440f-b0dd-16fe8c403593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:30.839782 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22017bd4-dccb-440f-b0dd-16fe8c403593 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:30.840321 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22017bd4-dccb-440f-b0dd-16fe8c403593 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:30.840597 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22017bd4-dccb-440f-b0dd-16fe8c403593 admin admin] PATH_INFO: `/v3/projects/8bdec3d739784107bf3c004ed236c6a8/users/2e3c32db9cd5491fbc3c793c50953d3e/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:30.842556 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22017bd4-dccb-440f-b0dd-16fe8c403593 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bdec3d739784107bf3c004ed236c6a8, user_id=2e3c32db9cd5491fbc3c793c50953d3e, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:30.847911 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22017bd4-dccb-440f-b0dd-16fe8c403593 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:30.855848 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1241/2477] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:57:30 2022] PUT /identity/v3/projects/8bdec3d739784107bf3c004ed236c6a8/users/2e3c32db9cd5491fbc3c793c50953d3e/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:30.868166 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96ff39-9b87-463b-9aba-f294289af4d9 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:30.869214 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96ff39-9b87-463b-9aba-f294289af4d9 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:30.869214 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96ff39-9b87-463b-9aba-f294289af4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:30.897342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-1b96ff39-9b87-463b-9aba-f294289af4d9 None None] MFA Rules not processed for user `2e3c32db9cd5491fbc3c793c50953d3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:30.898567 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-1b96ff39-9b87-463b-9aba-f294289af4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:31.001961 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1237/2478] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:31.013810 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22017bd4-dccb-440f-b0dd-16fe8c403593 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:31.015624 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-22017bd4-dccb-440f-b0dd-16fe8c403593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:31.079635 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22017bd4-dccb-440f-b0dd-16fe8c403593 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:31.083560 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ec405-f577-4315-b77b-d7b21924aaa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:31.084162 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ec405-f577-4315-b77b-d7b21924aaa0 service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:31.084434 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ec405-f577-4315-b77b-d7b21924aaa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:31.084703 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ec405-f577-4315-b77b-d7b21924aaa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:31.094303 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ec405-f577-4315-b77b-d7b21924aaa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:31.095724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ec405-f577-4315-b77b-d7b21924aaa0 service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:31.107179 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1242/2479] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:57:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:57:31.199984 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96ff39-9b87-463b-9aba-f294289af4d9 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:31.203108 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-1b96ff39-9b87-463b-9aba-f294289af4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:31.214327 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:31.275040 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96ff39-9b87-463b-9aba-f294289af4d9 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:31.280130 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa742c0-3099-47aa-809b-1d68407184ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:31.280868 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa742c0-3099-47aa-809b-1d68407184ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:31.281200 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa742c0-3099-47aa-809b-1d68407184ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:31.281480 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa742c0-3099-47aa-809b-1d68407184ac admin admin] PATH_INFO: `/v3/projects/95f69d9b4b9344c0a5442bd3616a0491` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:31.282708 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa742c0-3099-47aa-809b-1d68407184ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=95f69d9b4b9344c0a5442bd3616a0491)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:31.285841 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa742c0-3099-47aa-809b-1d68407184ac admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:31.398374 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ec405-f577-4315-b77b-d7b21924aaa0 service cinder] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:31.400426 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-afa742c0-3099-47aa-809b-1d68407184ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95f69d9b4b9344c0a5442bd3616a0491', 'request_id': 'req-afa742c0-3099-47aa-809b-1d68407184ac'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:31.409443 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-afa742c0-3099-47aa-809b-1d68407184ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95f69d9b4b9344c0a5442bd3616a0491', 'request_id': 'req-afa742c0-3099-47aa-809b-1d68407184ac'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:31.410229 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ec405-f577-4315-b77b-d7b21924aaa0 service cinder] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:31.462967 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42b558-56aa-4551-ba9d-dadf414ebdf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:31.463512 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42b558-56aa-4551-ba9d-dadf414ebdf2 service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:31.463795 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42b558-56aa-4551-ba9d-dadf414ebdf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:31.464069 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42b558-56aa-4551-ba9d-dadf414ebdf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:31.466110 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-7e42b558-56aa-4551-ba9d-dadf414ebdf2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:31.489560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-afa742c0-3099-47aa-809b-1d68407184ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95f69d9b4b9344c0a5442bd3616a0491', 'request_id': 'req-afa742c0-3099-47aa-809b-1d68407184ac'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:31.502062 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-afa742c0-3099-47aa-809b-1d68407184ac admin admin] The token cache is being invalidate because project 95f69d9b4b9344c0a5442bd3616a0491 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:57:31.502480 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-afa742c0-3099-47aa-809b-1d68407184ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:31.503347 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-afa742c0-3099-47aa-809b-1d68407184ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:31.505385 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1238/2480] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:57:31 2022] DELETE /identity/v3/projects/95f69d9b4b9344c0a5442bd3616a0491 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:31.505524 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:31.510021 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a764cc-ae8b-4c01-abff-53e66e06fe44 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:31.510405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a764cc-ae8b-4c01-abff-53e66e06fe44 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:31.510782 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a764cc-ae8b-4c01-abff-53e66e06fe44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:31.533330 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-74a764cc-ae8b-4c01-abff-53e66e06fe44 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:31.535594 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-74a764cc-ae8b-4c01-abff-53e66e06fe44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:31.537938 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42b558-56aa-4551-ba9d-dadf414ebdf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:31.539436 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42b558-56aa-4551-ba9d-dadf414ebdf2 service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:31.549411 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1243/2481] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:57:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:57:31.603850 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1239/2482] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:57:31.611931 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1357e6-73cd-4187-9572-256826e31607 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:31.612234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1357e6-73cd-4187-9572-256826e31607 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:31.612528 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1357e6-73cd-4187-9572-256826e31607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:31.632651 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-bf1357e6-73cd-4187-9572-256826e31607 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:31.633919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-bf1357e6-73cd-4187-9572-256826e31607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:31.642305 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1244/2483] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:31.647272 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a764cc-ae8b-4c01-abff-53e66e06fe44 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:31.657642 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a764cc-ae8b-4c01-abff-53e66e06fe44 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:31.663136 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e6093-fa22-40c0-acf1-93a31099c14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:31.663933 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e6093-fa22-40c0-acf1-93a31099c14c admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:31.664299 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e6093-fa22-40c0-acf1-93a31099c14c admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:31.664484 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e6093-fa22-40c0-acf1-93a31099c14c admin admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:31.665254 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e6093-fa22-40c0-acf1-93a31099c14c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:57:31.665549 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e6093-fa22-40c0-acf1-93a31099c14c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:31.667173 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e6093-fa22-40c0-acf1-93a31099c14c admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:31.686347 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1240/2484] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:57:31.691183 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1357e6-73cd-4187-9572-256826e31607 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:31.700645 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1357e6-73cd-4187-9572-256826e31607 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:31.706350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc75a0-8150-4024-81f4-4bbb37886f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:31.707120 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc75a0-8150-4024-81f4-4bbb37886f24 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:31.707399 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc75a0-8150-4024-81f4-4bbb37886f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:31.707670 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc75a0-8150-4024-81f4-4bbb37886f24 admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:31.708307 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc75a0-8150-4024-81f4-4bbb37886f24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:31.710234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc75a0-8150-4024-81f4-4bbb37886f24 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:31.833130 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1245/2485] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:57:31 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:57:31.834350 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e6093-fa22-40c0-acf1-93a31099c14c admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:31.844703 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e6093-fa22-40c0-acf1-93a31099c14c admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:31.863088 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:31.900205 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97b562-0fad-470d-b03b-ddcb0c69b02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:31.900831 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97b562-0fad-470d-b03b-ddcb0c69b02e admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:31.901144 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97b562-0fad-470d-b03b-ddcb0c69b02e admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:31.901419 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97b562-0fad-470d-b03b-ddcb0c69b02e admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:31.902037 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97b562-0fad-470d-b03b-ddcb0c69b02e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:31.904024 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97b562-0fad-470d-b03b-ddcb0c69b02e admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:32.005271 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1241/2486] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:57:31 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:57:32.010006 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc75a0-8150-4024-81f4-4bbb37886f24 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:32.024488 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc75a0-8150-4024-81f4-4bbb37886f24 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:32.038208 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f90baa-26bd-4bbd-ac78-c86c526d1c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:32.038823 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f90baa-26bd-4bbd-ac78-c86c526d1c3c admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:32.039106 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f90baa-26bd-4bbd-ac78-c86c526d1c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:32.039384 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f90baa-26bd-4bbd-ac78-c86c526d1c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:32.040052 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f90baa-26bd-4bbd-ac78-c86c526d1c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:32.041707 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f90baa-26bd-4bbd-ac78-c86c526d1c3c admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:32.053083 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1246/2487] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:57:32.057094 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97b562-0fad-470d-b03b-ddcb0c69b02e admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:32.068330 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97b562-0fad-470d-b03b-ddcb0c69b02e admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:32.073083 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f6e88-794c-4ff6-b20b-230bcc162ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:32.073636 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f6e88-794c-4ff6-b20b-230bcc162ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:32.073921 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f6e88-794c-4ff6-b20b-230bcc162ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:32.074196 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f6e88-794c-4ff6-b20b-230bcc162ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:32.074845 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f6e88-794c-4ff6-b20b-230bcc162ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:32.076438 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f6e88-794c-4ff6-b20b-230bcc162ee7 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:32.087361 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1242/2488] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:57:32.091776 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f90baa-26bd-4bbd-ac78-c86c526d1c3c admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:32.101952 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f90baa-26bd-4bbd-ac78-c86c526d1c3c admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:32.106647 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357df3d-3b48-4528-8df9-a036c0d9d672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:32.107287 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357df3d-3b48-4528-8df9-a036c0d9d672 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:32.107569 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357df3d-3b48-4528-8df9-a036c0d9d672 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:32.107845 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357df3d-3b48-4528-8df9-a036c0d9d672 admin admin] PATH_INFO: `/v3/projects/58989def4930477fa2f13453542c2dd9/users/ecf633d2428f4725b01f860a427bb0cc/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:32.123136 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357df3d-3b48-4528-8df9-a036c0d9d672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58989def4930477fa2f13453542c2dd9, user_id=ecf633d2428f4725b01f860a427bb0cc, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:32.125836 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357df3d-3b48-4528-8df9-a036c0d9d672 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:32.245533 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1247/2489] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:57:32 2022] PUT /identity/v3/projects/58989def4930477fa2f13453542c2dd9/users/ecf633d2428f4725b01f860a427bb0cc/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:32.256764 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449567e4-0492-4dd2-9ec6-5d391b3ac0ba None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:32.257073 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449567e4-0492-4dd2-9ec6-5d391b3ac0ba None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:32.257351 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449567e4-0492-4dd2-9ec6-5d391b3ac0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:32.286127 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-449567e4-0492-4dd2-9ec6-5d391b3ac0ba None None] MFA Rules not processed for user `ecf633d2428f4725b01f860a427bb0cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:32.287336 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-449567e4-0492-4dd2-9ec6-5d391b3ac0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:32.354258 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1243/2490] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:32.358791 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357df3d-3b48-4528-8df9-a036c0d9d672 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:32.421410 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357df3d-3b48-4528-8df9-a036c0d9d672 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:32.427392 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14406884-333f-43cd-91e6-5980aa9a931e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:32.428018 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14406884-333f-43cd-91e6-5980aa9a931e admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:32.428295 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14406884-333f-43cd-91e6-5980aa9a931e admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:32.428562 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14406884-333f-43cd-91e6-5980aa9a931e admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:32.429345 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14406884-333f-43cd-91e6-5980aa9a931e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:32.431325 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14406884-333f-43cd-91e6-5980aa9a931e admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:32.531345 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1248/2491] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:57:32 2022] POST /identity/v3/projects => generated 375 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:57:32.535996 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449567e4-0492-4dd2-9ec6-5d391b3ac0ba None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:32.546790 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449567e4-0492-4dd2-9ec6-5d391b3ac0ba None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:32.603839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb6827-511b-4f66-84ce-e641d8a7b285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:32.604532 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb6827-511b-4f66-84ce-e641d8a7b285 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:32.604762 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb6827-511b-4f66-84ce-e641d8a7b285 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:32.605055 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb6827-511b-4f66-84ce-e641d8a7b285 admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:32.605737 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb6827-511b-4f66-84ce-e641d8a7b285 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:32.607682 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb6827-511b-4f66-84ce-e641d8a7b285 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:32.666595 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1244/2492] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:57:32 2022] POST /identity/v3/users => generated 294 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:57:32.670555 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14406884-333f-43cd-91e6-5980aa9a931e admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:32.682395 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14406884-333f-43cd-91e6-5980aa9a931e admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:32.687269 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1dcc2d-4732-4a4b-b2ed-97be2406b5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:32.687965 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1dcc2d-4732-4a4b-b2ed-97be2406b5aa admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:32.688246 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1dcc2d-4732-4a4b-b2ed-97be2406b5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:32.688518 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1dcc2d-4732-4a4b-b2ed-97be2406b5aa admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:32.689237 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1dcc2d-4732-4a4b-b2ed-97be2406b5aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:32.691752 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1dcc2d-4732-4a4b-b2ed-97be2406b5aa admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:32.702868 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1249/2493] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:57:32.707764 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb6827-511b-4f66-84ce-e641d8a7b285 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:32.718115 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb6827-511b-4f66-84ce-e641d8a7b285 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:32.723431 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1ac57-ea83-4a43-a487-8b0ae36ac63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:32.724066 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1ac57-ea83-4a43-a487-8b0ae36ac63e admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:32.724461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1ac57-ea83-4a43-a487-8b0ae36ac63e admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:32.724742 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1ac57-ea83-4a43-a487-8b0ae36ac63e admin admin] PATH_INFO: `/v3/projects/849f8fa354484164a405491a19051900/users/18bfcec471a546df93f7abdfac5ab0a8/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:32.739463 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1ac57-ea83-4a43-a487-8b0ae36ac63e admin admin] RBAC: Authorizing `identity:create_grant(project_id=849f8fa354484164a405491a19051900, user_id=18bfcec471a546df93f7abdfac5ab0a8, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:32.742140 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1ac57-ea83-4a43-a487-8b0ae36ac63e admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:32.745275 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:32.820911 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1245/2494] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:57:32 2022] PUT /identity/v3/projects/849f8fa354484164a405491a19051900/users/18bfcec471a546df93f7abdfac5ab0a8/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:57:32.824933 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1dcc2d-4732-4a4b-b2ed-97be2406b5aa admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:32.836119 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1dcc2d-4732-4a4b-b2ed-97be2406b5aa admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:32.880870 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:32.893929 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3b43c-8537-41f8-8f5e-9b467420c75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:32.894537 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3b43c-8537-41f8-8f5e-9b467420c75a admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:32.894813 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3b43c-8537-41f8-8f5e-9b467420c75a admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:32.895082 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3b43c-8537-41f8-8f5e-9b467420c75a admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:32.895707 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3b43c-8537-41f8-8f5e-9b467420c75a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:32.897322 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3b43c-8537-41f8-8f5e-9b467420c75a admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:32.907477 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1250/2495] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:57:32.911909 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1ac57-ea83-4a43-a487-8b0ae36ac63e admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:32.922292 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1ac57-ea83-4a43-a487-8b0ae36ac63e admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:32.926882 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2adbb46-a41a-4b1d-9a38-0e8e23923513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:32.927517 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adbb46-a41a-4b1d-9a38-0e8e23923513 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:32.927793 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adbb46-a41a-4b1d-9a38-0e8e23923513 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:32.928070 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adbb46-a41a-4b1d-9a38-0e8e23923513 admin admin] PATH_INFO: `/v3/projects/849f8fa354484164a405491a19051900/users/18bfcec471a546df93f7abdfac5ab0a8/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:32.930006 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2adbb46-a41a-4b1d-9a38-0e8e23923513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=849f8fa354484164a405491a19051900, user_id=18bfcec471a546df93f7abdfac5ab0a8, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:32.932609 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2adbb46-a41a-4b1d-9a38-0e8e23923513 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:32.942669 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1246/2496] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:57:32 2022] PUT /identity/v3/projects/849f8fa354484164a405491a19051900/users/18bfcec471a546df93f7abdfac5ab0a8/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:32.953687 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b4e60-b7c6-4545-ac71-9812d5676d5c None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:32.953979 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b4e60-b7c6-4545-ac71-9812d5676d5c None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:32.954290 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b4e60-b7c6-4545-ac71-9812d5676d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:32.982910 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-ab4b4e60-b7c6-4545-ac71-9812d5676d5c None None] MFA Rules not processed for user `18bfcec471a546df93f7abdfac5ab0a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:32.984136 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-ab4b4e60-b7c6-4545-ac71-9812d5676d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:33.051671 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1251/2497] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:33.066912 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2adbb46-a41a-4b1d-9a38-0e8e23923513 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:33.068798 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-d2adbb46-a41a-4b1d-9a38-0e8e23923513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:33.133078 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2adbb46-a41a-4b1d-9a38-0e8e23923513 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:33.136815 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a30e3-4bb1-4133-b173-87ddb9b9005c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:33.137456 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a30e3-4bb1-4133-b173-87ddb9b9005c service cinder] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:33.137738 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a30e3-4bb1-4133-b173-87ddb9b9005c service cinder] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:33.138006 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a30e3-4bb1-4133-b173-87ddb9b9005c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:33.199755 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a30e3-4bb1-4133-b173-87ddb9b9005c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:33.201270 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a30e3-4bb1-4133-b173-87ddb9b9005c service cinder] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:33.211404 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1247/2498] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:57:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:57:34.530738 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b4e60-b7c6-4545-ac71-9812d5676d5c None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:34.532181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-ab4b4e60-b7c6-4545-ac71-9812d5676d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:34.598724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b4e60-b7c6-4545-ac71-9812d5676d5c None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:34.603347 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987c27d-430e-4823-968d-b72ebbfd7f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:34.603971 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987c27d-430e-4823-968d-b72ebbfd7f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:34.604250 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987c27d-430e-4823-968d-b72ebbfd7f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:34.604523 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987c27d-430e-4823-968d-b72ebbfd7f60 admin admin] PATH_INFO: `/v3/users/b12dc7c932104f1cbb4bbfcd4fb5ef1f` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:34.605639 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987c27d-430e-4823-968d-b72ebbfd7f60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b12dc7c932104f1cbb4bbfcd4fb5ef1f)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:34.607558 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987c27d-430e-4823-968d-b72ebbfd7f60 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:34.772166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-b987c27d-430e-4823-968d-b72ebbfd7f60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b12dc7c932104f1cbb4bbfcd4fb5ef1f'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:34.838071 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-b987c27d-430e-4823-968d-b72ebbfd7f60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b12dc7c932104f1cbb4bbfcd4fb5ef1f'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:34.838726 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-b987c27d-430e-4823-968d-b72ebbfd7f60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b12dc7c932104f1cbb4bbfcd4fb5ef1f'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:34.839341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-b987c27d-430e-4823-968d-b72ebbfd7f60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b12dc7c932104f1cbb4bbfcd4fb5ef1f'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:34.847391 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-b987c27d-430e-4823-968d-b72ebbfd7f60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b12dc7c932104f1cbb4bbfcd4fb5ef1f'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:34.852664 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:34.865108 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1252/2499] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:57:34 2022] DELETE /identity/v3/users/b12dc7c932104f1cbb4bbfcd4fb5ef1f => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:34.869555 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857afd7-c03d-4588-ba64-bdcfbd9b930a None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:34.870015 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857afd7-c03d-4588-ba64-bdcfbd9b930a None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:34.870114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857afd7-c03d-4588-ba64-bdcfbd9b930a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:34.891076 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-9857afd7-c03d-4588-ba64-bdcfbd9b930a None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:34.892429 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-9857afd7-c03d-4588-ba64-bdcfbd9b930a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:34.996692 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1248/2500] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:35.006869 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987c27d-430e-4823-968d-b72ebbfd7f60 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:35.008456 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-b987c27d-430e-4823-968d-b72ebbfd7f60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:35.070792 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987c27d-430e-4823-968d-b72ebbfd7f60 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:35.074421 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebfd8f4-7438-4ecb-a928-8c09b579fba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:35.075182 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebfd8f4-7438-4ecb-a928-8c09b579fba4 service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:35.075374 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebfd8f4-7438-4ecb-a928-8c09b579fba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:35.075650 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebfd8f4-7438-4ecb-a928-8c09b579fba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:35.085537 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebfd8f4-7438-4ecb-a928-8c09b579fba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:35.086993 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebfd8f4-7438-4ecb-a928-8c09b579fba4 service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:35.097095 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1253/2501] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:57:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:57:35.560513 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857afd7-c03d-4588-ba64-bdcfbd9b930a None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:35.562162 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-9857afd7-c03d-4588-ba64-bdcfbd9b930a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:35.574733 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857afd7-c03d-4588-ba64-bdcfbd9b930a None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:35.581138 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9280c-d7f6-48e3-9c74-b15c0afe821b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:35.581675 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9280c-d7f6-48e3-9c74-b15c0afe821b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:35.581954 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9280c-d7f6-48e3-9c74-b15c0afe821b admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:35.582253 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9280c-d7f6-48e3-9c74-b15c0afe821b admin admin] PATH_INFO: `/v3/projects/7cdbade4cd49405496fed5cc50df5b80` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:35.583404 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b9280c-d7f6-48e3-9c74-b15c0afe821b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cdbade4cd49405496fed5cc50df5b80)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:35.585548 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b9280c-d7f6-48e3-9c74-b15c0afe821b admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:35.662310 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:35.673951 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-f6b9280c-d7f6-48e3-9c74-b15c0afe821b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cdbade4cd49405496fed5cc50df5b80', 'request_id': 'req-f6b9280c-d7f6-48e3-9c74-b15c0afe821b'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:35.680217 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-f6b9280c-d7f6-48e3-9c74-b15c0afe821b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cdbade4cd49405496fed5cc50df5b80', 'request_id': 'req-f6b9280c-d7f6-48e3-9c74-b15c0afe821b'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:35.735431 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-f6b9280c-d7f6-48e3-9c74-b15c0afe821b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cdbade4cd49405496fed5cc50df5b80', 'request_id': 'req-f6b9280c-d7f6-48e3-9c74-b15c0afe821b'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:35.747195 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-f6b9280c-d7f6-48e3-9c74-b15c0afe821b admin admin] The token cache is being invalidate because project 7cdbade4cd49405496fed5cc50df5b80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:57:35.747485 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-f6b9280c-d7f6-48e3-9c74-b15c0afe821b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:35.748123 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-f6b9280c-d7f6-48e3-9c74-b15c0afe821b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:35.749656 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1249/2502] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:57:35 2022] DELETE /identity/v3/projects/7cdbade4cd49405496fed5cc50df5b80 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:35.753890 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebfd8f4-7438-4ecb-a928-8c09b579fba4 service neutron] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:35.763513 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebfd8f4-7438-4ecb-a928-8c09b579fba4 service neutron] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:35.820204 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de2912-84b4-4403-97d5-fb67a13cea1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:35.820745 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de2912-84b4-4403-97d5-fb67a13cea1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:35.821023 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de2912-84b4-4403-97d5-fb67a13cea1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:35.821378 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de2912-84b4-4403-97d5-fb67a13cea1a admin admin] PATH_INFO: `/v3/users/91d12e3fb6a046669abeddfdb667bced` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:35.822504 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de2912-84b4-4403-97d5-fb67a13cea1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=91d12e3fb6a046669abeddfdb667bced)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:35.824420 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de2912-84b4-4403-97d5-fb67a13cea1a admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:35.989525 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-c5de2912-84b4-4403-97d5-fb67a13cea1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91d12e3fb6a046669abeddfdb667bced'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:36.061124 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-c5de2912-84b4-4403-97d5-fb67a13cea1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91d12e3fb6a046669abeddfdb667bced'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:36.061900 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-c5de2912-84b4-4403-97d5-fb67a13cea1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91d12e3fb6a046669abeddfdb667bced'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:36.062525 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-c5de2912-84b4-4403-97d5-fb67a13cea1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91d12e3fb6a046669abeddfdb667bced'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:36.074519 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-c5de2912-84b4-4403-97d5-fb67a13cea1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91d12e3fb6a046669abeddfdb667bced'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:36.097207 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1254/2503] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:57:35 2022] DELETE /identity/v3/users/91d12e3fb6a046669abeddfdb667bced => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:36.545559 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9280c-d7f6-48e3-9c74-b15c0afe821b admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:36.547033 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-f6b9280c-d7f6-48e3-9c74-b15c0afe821b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:36.567495 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9280c-d7f6-48e3-9c74-b15c0afe821b admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:36.605883 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de2912-84b4-4403-97d5-fb67a13cea1a admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:36.607336 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-c5de2912-84b4-4403-97d5-fb67a13cea1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:36.620070 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:36.627693 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e410a3-5ce5-4be0-8636-5cc0483e0928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:36.629104 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e410a3-5ce5-4be0-8636-5cc0483e0928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:36.634375 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e410a3-5ce5-4be0-8636-5cc0483e0928 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:36.634375 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e410a3-5ce5-4be0-8636-5cc0483e0928 admin admin] PATH_INFO: `/v3/projects/debe43ba44a6420894bccbfe87815c81` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:36.634375 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e410a3-5ce5-4be0-8636-5cc0483e0928 admin admin] RBAC: Authorizing `identity:delete_project(project_id=debe43ba44a6420894bccbfe87815c81)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:36.634375 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e410a3-5ce5-4be0-8636-5cc0483e0928 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:36.672059 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de2912-84b4-4403-97d5-fb67a13cea1a admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:36.676244 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2a6b1-434a-4f61-8858-cfe9b2b6c2e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:36.676932 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2a6b1-434a-4f61-8858-cfe9b2b6c2e8 service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:36.677312 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2a6b1-434a-4f61-8858-cfe9b2b6c2e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:36.677594 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2a6b1-434a-4f61-8858-cfe9b2b6c2e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:36.679356 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-a6c2a6b1-434a-4f61-8858-cfe9b2b6c2e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:36.749369 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e5e410a3-5ce5-4be0-8636-5cc0483e0928 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'debe43ba44a6420894bccbfe87815c81', 'request_id': 'req-e5e410a3-5ce5-4be0-8636-5cc0483e0928'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:36.753909 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2a6b1-434a-4f61-8858-cfe9b2b6c2e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:36.754450 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e5e410a3-5ce5-4be0-8636-5cc0483e0928 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'debe43ba44a6420894bccbfe87815c81', 'request_id': 'req-e5e410a3-5ce5-4be0-8636-5cc0483e0928'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:36.756424 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2a6b1-434a-4f61-8858-cfe9b2b6c2e8 service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:36.767078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1255/2504] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:57:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:57:36.826614 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e5e410a3-5ce5-4be0-8636-5cc0483e0928 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'debe43ba44a6420894bccbfe87815c81', 'request_id': 'req-e5e410a3-5ce5-4be0-8636-5cc0483e0928'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:36.838857 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e5e410a3-5ce5-4be0-8636-5cc0483e0928 admin admin] The token cache is being invalidate because project debe43ba44a6420894bccbfe87815c81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:57:36.839087 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e5e410a3-5ce5-4be0-8636-5cc0483e0928 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:36.839740 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e5e410a3-5ce5-4be0-8636-5cc0483e0928 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:36.841622 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1250/2505] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:57:36 2022] DELETE /identity/v3/projects/debe43ba44a6420894bccbfe87815c81 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:36.848235 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2394a-53d4-46b7-bdcd-f2e18cc9cb92 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:36.848524 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2394a-53d4-46b7-bdcd-f2e18cc9cb92 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:36.848803 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2394a-53d4-46b7-bdcd-f2e18cc9cb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:36.870775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-b3c2394a-53d4-46b7-bdcd-f2e18cc9cb92 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:36.871937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-b3c2394a-53d4-46b7-bdcd-f2e18cc9cb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:36.934066 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1256/2506] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:36.942447 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570c7b7-55d3-4269-b640-12fbf97a479d None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:36.942741 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570c7b7-55d3-4269-b640-12fbf97a479d None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:36.943052 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570c7b7-55d3-4269-b640-12fbf97a479d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:36.963455 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-0570c7b7-55d3-4269-b640-12fbf97a479d None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:36.964673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-0570c7b7-55d3-4269-b640-12fbf97a479d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:36.973987 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1251/2507] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:36.981318 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2394a-53d4-46b7-bdcd-f2e18cc9cb92 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:36.989671 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2394a-53d4-46b7-bdcd-f2e18cc9cb92 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:36.994460 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145c28e-a2a6-4458-8dc1-a9b86b65dffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:36.995052 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145c28e-a2a6-4458-8dc1-a9b86b65dffa admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:36.995328 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145c28e-a2a6-4458-8dc1-a9b86b65dffa admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:36.995597 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145c28e-a2a6-4458-8dc1-a9b86b65dffa admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:36.996572 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8145c28e-a2a6-4458-8dc1-a9b86b65dffa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:57:36.996874 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8145c28e-a2a6-4458-8dc1-a9b86b65dffa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:36.998509 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8145c28e-a2a6-4458-8dc1-a9b86b65dffa admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:37.011643 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1257/2508] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:57:37.016413 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570c7b7-55d3-4269-b640-12fbf97a479d None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:37.027228 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570c7b7-55d3-4269-b640-12fbf97a479d None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:37.031373 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17b9d7-55e0-48e9-8380-beab5e905354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:37.031887 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17b9d7-55e0-48e9-8380-beab5e905354 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:37.032175 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17b9d7-55e0-48e9-8380-beab5e905354 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:37.032453 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17b9d7-55e0-48e9-8380-beab5e905354 admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:37.033120 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17b9d7-55e0-48e9-8380-beab5e905354 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:37.035656 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17b9d7-55e0-48e9-8380-beab5e905354 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:37.148304 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1252/2509] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:57:37 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:57:37.152560 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145c28e-a2a6-4458-8dc1-a9b86b65dffa admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:37.163400 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145c28e-a2a6-4458-8dc1-a9b86b65dffa admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:37.210802 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:37.225214 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6c68b-9d6e-4043-b2b9-394ad52a4d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:37.225820 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6c68b-9d6e-4043-b2b9-394ad52a4d4e admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:37.226130 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6c68b-9d6e-4043-b2b9-394ad52a4d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:37.226405 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6c68b-9d6e-4043-b2b9-394ad52a4d4e admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:37.227132 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6c68b-9d6e-4043-b2b9-394ad52a4d4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:37.229118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6c68b-9d6e-4043-b2b9-394ad52a4d4e admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:37.313729 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1258/2510] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:57:37 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:57:37.317925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17b9d7-55e0-48e9-8380-beab5e905354 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:37.329743 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17b9d7-55e0-48e9-8380-beab5e905354 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:37.335181 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98d57d-cd49-4008-b0c4-e7997b911150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:37.335786 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98d57d-cd49-4008-b0c4-e7997b911150 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:37.336072 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98d57d-cd49-4008-b0c4-e7997b911150 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:37.336356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98d57d-cd49-4008-b0c4-e7997b911150 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:37.336996 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98d57d-cd49-4008-b0c4-e7997b911150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:37.338613 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98d57d-cd49-4008-b0c4-e7997b911150 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:37.350216 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1253/2511] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:57:37.354281 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6c68b-9d6e-4043-b2b9-394ad52a4d4e admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:37.364594 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6c68b-9d6e-4043-b2b9-394ad52a4d4e admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:37.369217 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4c62b-f982-4a32-9bb1-c0c2ffaaa400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:37.369809 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4c62b-f982-4a32-9bb1-c0c2ffaaa400 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:37.370091 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4c62b-f982-4a32-9bb1-c0c2ffaaa400 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:37.372904 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4c62b-f982-4a32-9bb1-c0c2ffaaa400 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:37.372904 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4c62b-f982-4a32-9bb1-c0c2ffaaa400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:37.372904 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4c62b-f982-4a32-9bb1-c0c2ffaaa400 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:37.383755 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1259/2512] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:57:37.387919 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98d57d-cd49-4008-b0c4-e7997b911150 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:37.398665 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98d57d-cd49-4008-b0c4-e7997b911150 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:37.403716 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f35b58-a8d0-4f89-a9e1-7b15becf2cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:37.404374 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f35b58-a8d0-4f89-a9e1-7b15becf2cc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:37.404658 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f35b58-a8d0-4f89-a9e1-7b15becf2cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:37.404934 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f35b58-a8d0-4f89-a9e1-7b15becf2cc2 admin admin] PATH_INFO: `/v3/projects/e7e9cf664c864fc6961a9c544d8443a6/users/a0b66b2839b9408b8e046b522dcc7d85/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:37.422431 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:37.435234 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f35b58-a8d0-4f89-a9e1-7b15becf2cc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7e9cf664c864fc6961a9c544d8443a6, user_id=a0b66b2839b9408b8e046b522dcc7d85, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:37.435234 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f35b58-a8d0-4f89-a9e1-7b15becf2cc2 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:37.534073 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1254/2513] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:57:37 2022] PUT /identity/v3/projects/e7e9cf664c864fc6961a9c544d8443a6/users/a0b66b2839b9408b8e046b522dcc7d85/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:37.545115 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3975e04-e88d-4787-aaf6-d03c8ec7839a None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:37.545636 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3975e04-e88d-4787-aaf6-d03c8ec7839a None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:37.546028 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3975e04-e88d-4787-aaf6-d03c8ec7839a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:37.575102 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-a3975e04-e88d-4787-aaf6-d03c8ec7839a None None] MFA Rules not processed for user `a0b66b2839b9408b8e046b522dcc7d85`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:37.576305 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-a3975e04-e88d-4787-aaf6-d03c8ec7839a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:37.661091 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1260/2514] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:57:37.666204 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f35b58-a8d0-4f89-a9e1-7b15becf2cc2 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:37.746454 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f35b58-a8d0-4f89-a9e1-7b15becf2cc2 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:37.751483 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026219b9-b9c7-4b0c-93d2-4a43d5c93f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:37.753697 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026219b9-b9c7-4b0c-93d2-4a43d5c93f7e admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:37.753697 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026219b9-b9c7-4b0c-93d2-4a43d5c93f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:37.753697 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026219b9-b9c7-4b0c-93d2-4a43d5c93f7e admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:37.753999 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026219b9-b9c7-4b0c-93d2-4a43d5c93f7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:37.755985 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026219b9-b9c7-4b0c-93d2-4a43d5c93f7e admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:37.824912 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1255/2515] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:57:37 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:57:37.829091 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3975e04-e88d-4787-aaf6-d03c8ec7839a None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:37.843897 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3975e04-e88d-4787-aaf6-d03c8ec7839a None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:37.905401 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6c5a5-0e9b-4a2e-b193-974dd90582c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:37.906045 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6c5a5-0e9b-4a2e-b193-974dd90582c8 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:37.906336 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6c5a5-0e9b-4a2e-b193-974dd90582c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:37.906616 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6c5a5-0e9b-4a2e-b193-974dd90582c8 admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:37.907247 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6c5a5-0e9b-4a2e-b193-974dd90582c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:37.909569 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6c5a5-0e9b-4a2e-b193-974dd90582c8 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:37.994172 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1261/2516] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:57:37 2022] POST /identity/v3/users => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:57:37.998263 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026219b9-b9c7-4b0c-93d2-4a43d5c93f7e admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:38.010096 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026219b9-b9c7-4b0c-93d2-4a43d5c93f7e admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:38.015369 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c814e51-0d85-44c0-8aee-3c24f6583749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:38.016069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c814e51-0d85-44c0-8aee-3c24f6583749 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:38.016356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c814e51-0d85-44c0-8aee-3c24f6583749 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:38.016654 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c814e51-0d85-44c0-8aee-3c24f6583749 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:38.017337 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c814e51-0d85-44c0-8aee-3c24f6583749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:38.019070 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c814e51-0d85-44c0-8aee-3c24f6583749 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:38.030591 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1256/2517] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:57:38.034630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6c5a5-0e9b-4a2e-b193-974dd90582c8 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:38.045881 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6c5a5-0e9b-4a2e-b193-974dd90582c8 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:38.052852 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7403e6b-b253-462d-910d-7ca82b027bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:38.055180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7403e6b-b253-462d-910d-7ca82b027bb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:38.055180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7403e6b-b253-462d-910d-7ca82b027bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:38.055180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7403e6b-b253-462d-910d-7ca82b027bb6 admin admin] PATH_INFO: `/v3/projects/a60f8dd102464b4fb6feaf44205fd405/users/56e2086fe25144f0a36cda26ab73499f/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:38.072561 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7403e6b-b253-462d-910d-7ca82b027bb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a60f8dd102464b4fb6feaf44205fd405, user_id=56e2086fe25144f0a36cda26ab73499f, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:38.075325 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7403e6b-b253-462d-910d-7ca82b027bb6 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:38.136740 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1262/2518] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:57:38 2022] PUT /identity/v3/projects/a60f8dd102464b4fb6feaf44205fd405/users/56e2086fe25144f0a36cda26ab73499f/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:57:38.140844 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c814e51-0d85-44c0-8aee-3c24f6583749 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:38.151298 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c814e51-0d85-44c0-8aee-3c24f6583749 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:38.221504 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f2458-8ba4-4789-80df-00540731c086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:38.222349 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f2458-8ba4-4789-80df-00540731c086 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:38.222637 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f2458-8ba4-4789-80df-00540731c086 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:38.222976 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f2458-8ba4-4789-80df-00540731c086 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:38.223558 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f2458-8ba4-4789-80df-00540731c086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:38.225171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f2458-8ba4-4789-80df-00540731c086 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:38.235075 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1257/2519] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:57:38.240015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7403e6b-b253-462d-910d-7ca82b027bb6 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:38.250620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7403e6b-b253-462d-910d-7ca82b027bb6 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:38.256079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3d9e8-2715-48bb-8a2b-a47c0881eef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:38.256733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3d9e8-2715-48bb-8a2b-a47c0881eef1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:38.257068 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3d9e8-2715-48bb-8a2b-a47c0881eef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:38.257353 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3d9e8-2715-48bb-8a2b-a47c0881eef1 admin admin] PATH_INFO: `/v3/projects/a60f8dd102464b4fb6feaf44205fd405/users/56e2086fe25144f0a36cda26ab73499f/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:38.259308 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3d9e8-2715-48bb-8a2b-a47c0881eef1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a60f8dd102464b4fb6feaf44205fd405, user_id=56e2086fe25144f0a36cda26ab73499f, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:38.261987 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3d9e8-2715-48bb-8a2b-a47c0881eef1 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:38.272548 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1263/2520] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:57:38 2022] PUT /identity/v3/projects/a60f8dd102464b4fb6feaf44205fd405/users/56e2086fe25144f0a36cda26ab73499f/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:38.338866 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707078bb-59d9-4d15-8e93-11dfe5e28bb3 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:38.339446 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707078bb-59d9-4d15-8e93-11dfe5e28bb3 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:38.339744 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707078bb-59d9-4d15-8e93-11dfe5e28bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:38.370499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-707078bb-59d9-4d15-8e93-11dfe5e28bb3 None None] MFA Rules not processed for user `56e2086fe25144f0a36cda26ab73499f`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:38.371223 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-707078bb-59d9-4d15-8e93-11dfe5e28bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:38.434634 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:38.459600 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1258/2521] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:38 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:38.478352 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3d9e8-2715-48bb-8a2b-a47c0881eef1 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:38.480288 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-57e3d9e8-2715-48bb-8a2b-a47c0881eef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:38.491425 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:38.541238 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3d9e8-2715-48bb-8a2b-a47c0881eef1 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:38.544895 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32b30f-a708-4222-8a0d-b418c4dae25e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:38.545612 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32b30f-a708-4222-8a0d-b418c4dae25e service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:38.545893 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32b30f-a708-4222-8a0d-b418c4dae25e service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:38.546164 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32b30f-a708-4222-8a0d-b418c4dae25e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:38.556018 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32b30f-a708-4222-8a0d-b418c4dae25e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:38.557502 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32b30f-a708-4222-8a0d-b418c4dae25e service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:38.567248 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1264/2522] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:57:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:57:38.739191 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707078bb-59d9-4d15-8e93-11dfe5e28bb3 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:38.758030 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707078bb-59d9-4d15-8e93-11dfe5e28bb3 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:38.762726 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883835c1-3e9a-41f5-b488-609115ebcf95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:38.764758 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883835c1-3e9a-41f5-b488-609115ebcf95 service cinder] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:38.765598 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883835c1-3e9a-41f5-b488-609115ebcf95 service cinder] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:38.766062 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883835c1-3e9a-41f5-b488-609115ebcf95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:38.889669 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883835c1-3e9a-41f5-b488-609115ebcf95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:38.892089 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883835c1-3e9a-41f5-b488-609115ebcf95 service cinder] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:38.903428 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1259/2523] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:57:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:57:39.511738 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32b30f-a708-4222-8a0d-b418c4dae25e service cinder] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:39.594115 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32b30f-a708-4222-8a0d-b418c4dae25e service cinder] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:39.599571 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97eb96-b0d8-442f-95d5-8a2247d9e86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:39.600213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97eb96-b0d8-442f-95d5-8a2247d9e86a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:39.600490 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97eb96-b0d8-442f-95d5-8a2247d9e86a admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:39.600760 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97eb96-b0d8-442f-95d5-8a2247d9e86a admin admin] PATH_INFO: `/v3/users/a0b66b2839b9408b8e046b522dcc7d85` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:39.601925 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97eb96-b0d8-442f-95d5-8a2247d9e86a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0b66b2839b9408b8e046b522dcc7d85)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:39.603910 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97eb96-b0d8-442f-95d5-8a2247d9e86a admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:39.801735 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-7f97eb96-b0d8-442f-95d5-8a2247d9e86a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0b66b2839b9408b8e046b522dcc7d85'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:39.908998 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-7f97eb96-b0d8-442f-95d5-8a2247d9e86a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0b66b2839b9408b8e046b522dcc7d85'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:39.910176 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-7f97eb96-b0d8-442f-95d5-8a2247d9e86a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0b66b2839b9408b8e046b522dcc7d85'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:39.911213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-7f97eb96-b0d8-442f-95d5-8a2247d9e86a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0b66b2839b9408b8e046b522dcc7d85'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:39.922471 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-7f97eb96-b0d8-442f-95d5-8a2247d9e86a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0b66b2839b9408b8e046b522dcc7d85'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:39.948715 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1265/2524] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:57:39 2022] DELETE /identity/v3/users/a0b66b2839b9408b8e046b522dcc7d85 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:39.956558 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed386785-9015-4e36-87b8-7bad8d6ddec6 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:39.957869 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed386785-9015-4e36-87b8-7bad8d6ddec6 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:39.958178 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed386785-9015-4e36-87b8-7bad8d6ddec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:39.979318 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-ed386785-9015-4e36-87b8-7bad8d6ddec6 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:39.987740 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-ed386785-9015-4e36-87b8-7bad8d6ddec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:40.048648 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1260/2525] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:40.059439 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97eb96-b0d8-442f-95d5-8a2247d9e86a admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:40.061015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-7f97eb96-b0d8-442f-95d5-8a2247d9e86a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:40.098859 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:40.131050 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97eb96-b0d8-442f-95d5-8a2247d9e86a admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:40.136397 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ce3b1-57d6-4f4a-9cbc-745c75a9bc38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:40.137018 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ce3b1-57d6-4f4a-9cbc-745c75a9bc38 service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:40.137349 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ce3b1-57d6-4f4a-9cbc-745c75a9bc38 service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:40.137602 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ce3b1-57d6-4f4a-9cbc-745c75a9bc38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:40.148923 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ce3b1-57d6-4f4a-9cbc-745c75a9bc38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:40.150568 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ce3b1-57d6-4f4a-9cbc-745c75a9bc38 service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:40.161572 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1266/2526] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:57:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:57:40.811860 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed386785-9015-4e36-87b8-7bad8d6ddec6 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:40.813622 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-ed386785-9015-4e36-87b8-7bad8d6ddec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:40.832344 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed386785-9015-4e36-87b8-7bad8d6ddec6 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:40.837553 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff992677-ce39-4df0-82a4-b868f6770764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:40.838222 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff992677-ce39-4df0-82a4-b868f6770764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:40.838538 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff992677-ce39-4df0-82a4-b868f6770764 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:40.842057 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff992677-ce39-4df0-82a4-b868f6770764 admin admin] PATH_INFO: `/v3/projects/e7e9cf664c864fc6961a9c544d8443a6` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:40.842057 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff992677-ce39-4df0-82a4-b868f6770764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7e9cf664c864fc6961a9c544d8443a6)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:40.842689 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff992677-ce39-4df0-82a4-b868f6770764 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:40.993631 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-ff992677-ce39-4df0-82a4-b868f6770764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7e9cf664c864fc6961a9c544d8443a6', 'request_id': 'req-ff992677-ce39-4df0-82a4-b868f6770764'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:41.004514 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-ff992677-ce39-4df0-82a4-b868f6770764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7e9cf664c864fc6961a9c544d8443a6', 'request_id': 'req-ff992677-ce39-4df0-82a4-b868f6770764'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:41.077775 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-ff992677-ce39-4df0-82a4-b868f6770764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7e9cf664c864fc6961a9c544d8443a6', 'request_id': 'req-ff992677-ce39-4df0-82a4-b868f6770764'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:41.090651 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-ff992677-ce39-4df0-82a4-b868f6770764 admin admin] The token cache is being invalidate because project e7e9cf664c864fc6961a9c544d8443a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:57:41.090942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-ff992677-ce39-4df0-82a4-b868f6770764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:41.091699 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-ff992677-ce39-4df0-82a4-b868f6770764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:41.093284 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1261/2527] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:57:40 2022] DELETE /identity/v3/projects/e7e9cf664c864fc6961a9c544d8443a6 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:57:41.097705 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ce3b1-57d6-4f4a-9cbc-745c75a9bc38 service neutron] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:41.108018 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ce3b1-57d6-4f4a-9cbc-745c75a9bc38 service neutron] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:41.169401 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb0d33-e43c-49c9-869b-ff6ea82865a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:41.170030 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb0d33-e43c-49c9-869b-ff6ea82865a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:41.170313 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb0d33-e43c-49c9-869b-ff6ea82865a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:41.170590 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb0d33-e43c-49c9-869b-ff6ea82865a2 admin admin] PATH_INFO: `/v3/users/56e2086fe25144f0a36cda26ab73499f` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:41.171714 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb0d33-e43c-49c9-869b-ff6ea82865a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56e2086fe25144f0a36cda26ab73499f)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:41.173765 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb0d33-e43c-49c9-869b-ff6ea82865a2 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:41.403233 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-b8cb0d33-e43c-49c9-869b-ff6ea82865a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56e2086fe25144f0a36cda26ab73499f'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:41.471402 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-b8cb0d33-e43c-49c9-869b-ff6ea82865a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56e2086fe25144f0a36cda26ab73499f'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:41.472021 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-b8cb0d33-e43c-49c9-869b-ff6ea82865a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56e2086fe25144f0a36cda26ab73499f'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:41.473198 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-b8cb0d33-e43c-49c9-869b-ff6ea82865a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56e2086fe25144f0a36cda26ab73499f'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:41.480819 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-b8cb0d33-e43c-49c9-869b-ff6ea82865a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56e2086fe25144f0a36cda26ab73499f'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:41.502476 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1267/2528] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:57:41 2022] DELETE /identity/v3/users/56e2086fe25144f0a36cda26ab73499f => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:41.914225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff992677-ce39-4df0-82a4-b868f6770764 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:41.915902 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-ff992677-ce39-4df0-82a4-b868f6770764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:41.926566 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:41.932027 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff992677-ce39-4df0-82a4-b868f6770764 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:41.999128 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230367c8-1f1a-45c8-80ff-fc61bfa5f0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:41.999797 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230367c8-1f1a-45c8-80ff-fc61bfa5f0f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:42.000109 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230367c8-1f1a-45c8-80ff-fc61bfa5f0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:42.000383 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230367c8-1f1a-45c8-80ff-fc61bfa5f0f2 admin admin] PATH_INFO: `/v3/projects/a60f8dd102464b4fb6feaf44205fd405` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:42.001570 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230367c8-1f1a-45c8-80ff-fc61bfa5f0f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a60f8dd102464b4fb6feaf44205fd405)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:42.004051 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230367c8-1f1a-45c8-80ff-fc61bfa5f0f2 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:42.170598 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-230367c8-1f1a-45c8-80ff-fc61bfa5f0f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a60f8dd102464b4fb6feaf44205fd405', 'request_id': 'req-230367c8-1f1a-45c8-80ff-fc61bfa5f0f2'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:42.176720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-230367c8-1f1a-45c8-80ff-fc61bfa5f0f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a60f8dd102464b4fb6feaf44205fd405', 'request_id': 'req-230367c8-1f1a-45c8-80ff-fc61bfa5f0f2'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:42.255816 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-230367c8-1f1a-45c8-80ff-fc61bfa5f0f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a60f8dd102464b4fb6feaf44205fd405', 'request_id': 'req-230367c8-1f1a-45c8-80ff-fc61bfa5f0f2'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:42.267952 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-230367c8-1f1a-45c8-80ff-fc61bfa5f0f2 admin admin] The token cache is being invalidate because project a60f8dd102464b4fb6feaf44205fd405 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:57:42.268240 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-230367c8-1f1a-45c8-80ff-fc61bfa5f0f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:42.268929 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-230367c8-1f1a-45c8-80ff-fc61bfa5f0f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:42.271094 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1262/2529] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:57:41 2022] DELETE /identity/v3/projects/a60f8dd102464b4fb6feaf44205fd405 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:42.276330 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84e82a-ac21-4934-97e4-2e97a22b54dd None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:42.276822 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84e82a-ac21-4934-97e4-2e97a22b54dd None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:42.276822 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84e82a-ac21-4934-97e4-2e97a22b54dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:42.296804 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-ea84e82a-ac21-4934-97e4-2e97a22b54dd None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:42.298051 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-ea84e82a-ac21-4934-97e4-2e97a22b54dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:42.346981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:42.375670 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1268/2530] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:42.379935 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e59886-beb9-4bea-9c45-3aa87d6f8d9a None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:42.379935 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e59886-beb9-4bea-9c45-3aa87d6f8d9a None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:42.379935 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e59886-beb9-4bea-9c45-3aa87d6f8d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:42.403262 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-a7e59886-beb9-4bea-9c45-3aa87d6f8d9a None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:42.403262 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-a7e59886-beb9-4bea-9c45-3aa87d6f8d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:42.413376 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1263/2531] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:57:42.417424 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84e82a-ac21-4934-97e4-2e97a22b54dd None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:42.427882 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84e82a-ac21-4934-97e4-2e97a22b54dd None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:42.433071 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2095e0-dd4c-493c-8fb4-77f0649dc3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:42.433376 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2095e0-dd4c-493c-8fb4-77f0649dc3b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:42.433657 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2095e0-dd4c-493c-8fb4-77f0649dc3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:42.433931 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2095e0-dd4c-493c-8fb4-77f0649dc3b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:42.434581 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2095e0-dd4c-493c-8fb4-77f0649dc3b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:57:42.434882 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2095e0-dd4c-493c-8fb4-77f0649dc3b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:42.436503 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2095e0-dd4c-493c-8fb4-77f0649dc3b8 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:42.449315 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1269/2532] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:57:42.453566 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e59886-beb9-4bea-9c45-3aa87d6f8d9a None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:42.463767 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e59886-beb9-4bea-9c45-3aa87d6f8d9a None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:42.469374 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133c4ef-88ce-457f-a3e3-caa5937837d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:42.472868 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133c4ef-88ce-457f-a3e3-caa5937837d5 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:42.472868 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133c4ef-88ce-457f-a3e3-caa5937837d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:42.472868 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133c4ef-88ce-457f-a3e3-caa5937837d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:42.472868 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133c4ef-88ce-457f-a3e3-caa5937837d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:42.474029 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133c4ef-88ce-457f-a3e3-caa5937837d5 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:42.564881 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1264/2533] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:57:42 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:57:42.570815 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2095e0-dd4c-493c-8fb4-77f0649dc3b8 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:42.580944 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2095e0-dd4c-493c-8fb4-77f0649dc3b8 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:42.637747 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed0b59-7959-4867-8f18-2d972fc8c14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:42.638352 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed0b59-7959-4867-8f18-2d972fc8c14a admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:42.638633 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed0b59-7959-4867-8f18-2d972fc8c14a admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:42.638904 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed0b59-7959-4867-8f18-2d972fc8c14a admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:42.639532 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed0b59-7959-4867-8f18-2d972fc8c14a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:42.641502 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed0b59-7959-4867-8f18-2d972fc8c14a admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:42.746719 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1270/2534] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:57:42 2022] POST /identity/v3/users => generated 288 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:57:42.751103 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133c4ef-88ce-457f-a3e3-caa5937837d5 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:42.762264 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133c4ef-88ce-457f-a3e3-caa5937837d5 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:42.766898 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af37e4-03f0-4c4d-9c40-fe902be193bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:42.767543 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af37e4-03f0-4c4d-9c40-fe902be193bb admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:42.767832 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af37e4-03f0-4c4d-9c40-fe902be193bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:42.768105 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af37e4-03f0-4c4d-9c40-fe902be193bb admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:42.768795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af37e4-03f0-4c4d-9c40-fe902be193bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:42.770924 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af37e4-03f0-4c4d-9c40-fe902be193bb admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:42.784132 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1265/2535] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:57:42.786413 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed0b59-7959-4867-8f18-2d972fc8c14a admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:42.797281 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed0b59-7959-4867-8f18-2d972fc8c14a admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:42.802586 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76634251-def1-4a67-9696-087747ad698f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:42.803178 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76634251-def1-4a67-9696-087747ad698f admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:42.803459 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76634251-def1-4a67-9696-087747ad698f admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:42.803731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76634251-def1-4a67-9696-087747ad698f admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:42.804373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76634251-def1-4a67-9696-087747ad698f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:42.806008 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76634251-def1-4a67-9696-087747ad698f admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:42.817655 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1271/2536] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:57:42.821869 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af37e4-03f0-4c4d-9c40-fe902be193bb admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:42.832195 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af37e4-03f0-4c4d-9c40-fe902be193bb admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:42.836747 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6d63a-a638-4433-b021-e0ab3390f6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:42.837425 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6d63a-a638-4433-b021-e0ab3390f6f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:42.837709 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6d63a-a638-4433-b021-e0ab3390f6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:42.837987 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6d63a-a638-4433-b021-e0ab3390f6f6 admin admin] PATH_INFO: `/v3/projects/e378c7d7c2304db08c4c93e6e43ee2a8/users/b6bf6bd846014454bd7824007c79c633/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:42.853451 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6d63a-a638-4433-b021-e0ab3390f6f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e378c7d7c2304db08c4c93e6e43ee2a8, user_id=b6bf6bd846014454bd7824007c79c633, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:42.856083 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6d63a-a638-4433-b021-e0ab3390f6f6 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:42.960183 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1266/2537] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:57:42 2022] PUT /identity/v3/projects/e378c7d7c2304db08c4c93e6e43ee2a8/users/b6bf6bd846014454bd7824007c79c633/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:42.971574 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6eca19-1979-4698-bdb2-ec000cff6e11 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:42.971863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6eca19-1979-4698-bdb2-ec000cff6e11 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:42.972701 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6eca19-1979-4698-bdb2-ec000cff6e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:43.005134 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-cf6eca19-1979-4698-bdb2-ec000cff6e11 None None] MFA Rules not processed for user `b6bf6bd846014454bd7824007c79c633`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:43.006366 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-cf6eca19-1979-4698-bdb2-ec000cff6e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:43.072937 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1272/2538] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:43.077576 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6d63a-a638-4433-b021-e0ab3390f6f6 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:43.117398 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:43.147967 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6d63a-a638-4433-b021-e0ab3390f6f6 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:43.152805 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecdf02f-87fb-4e3c-8508-bfd13d5ff01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:43.153452 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecdf02f-87fb-4e3c-8508-bfd13d5ff01a admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:43.153729 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecdf02f-87fb-4e3c-8508-bfd13d5ff01a admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:43.153996 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecdf02f-87fb-4e3c-8508-bfd13d5ff01a admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:43.154628 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecdf02f-87fb-4e3c-8508-bfd13d5ff01a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:43.156576 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecdf02f-87fb-4e3c-8508-bfd13d5ff01a admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:43.245093 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1267/2539] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:57:43 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:57:43.249356 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6eca19-1979-4698-bdb2-ec000cff6e11 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:43.260347 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6eca19-1979-4698-bdb2-ec000cff6e11 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:43.304619 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:43.317335 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30256de7-bc67-4942-9a0e-6285887648e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:43.317940 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30256de7-bc67-4942-9a0e-6285887648e9 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:43.318224 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30256de7-bc67-4942-9a0e-6285887648e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:43.318501 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30256de7-bc67-4942-9a0e-6285887648e9 admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:43.319198 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30256de7-bc67-4942-9a0e-6285887648e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:43.321561 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30256de7-bc67-4942-9a0e-6285887648e9 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:43.416491 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1273/2540] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:57:43 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:57:43.420410 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecdf02f-87fb-4e3c-8508-bfd13d5ff01a admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:43.431294 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecdf02f-87fb-4e3c-8508-bfd13d5ff01a admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:43.436299 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41131286-a49f-438d-b5cb-821a28844baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:43.436936 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41131286-a49f-438d-b5cb-821a28844baf admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:43.437257 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41131286-a49f-438d-b5cb-821a28844baf admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:43.437561 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41131286-a49f-438d-b5cb-821a28844baf admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:43.438207 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41131286-a49f-438d-b5cb-821a28844baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:43.439805 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41131286-a49f-438d-b5cb-821a28844baf admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:43.452147 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1268/2541] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:57:43.456241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30256de7-bc67-4942-9a0e-6285887648e9 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:43.467276 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30256de7-bc67-4942-9a0e-6285887648e9 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:43.471954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd996c02-ed9f-486e-9697-603e9d9cefc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:43.473329 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd996c02-ed9f-486e-9697-603e9d9cefc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:43.473610 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd996c02-ed9f-486e-9697-603e9d9cefc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:43.473889 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd996c02-ed9f-486e-9697-603e9d9cefc5 admin admin] PATH_INFO: `/v3/projects/39f6ae35d7a141619a6baeb3ab0f18e5/users/e323a211bf3b4251822eac3ed164c54d/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:43.489930 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd996c02-ed9f-486e-9697-603e9d9cefc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39f6ae35d7a141619a6baeb3ab0f18e5, user_id=e323a211bf3b4251822eac3ed164c54d, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:43.492573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd996c02-ed9f-486e-9697-603e9d9cefc5 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:43.569394 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1274/2542] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:57:43 2022] PUT /identity/v3/projects/39f6ae35d7a141619a6baeb3ab0f18e5/users/e323a211bf3b4251822eac3ed164c54d/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:43.577853 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41131286-a49f-438d-b5cb-821a28844baf admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:43.588612 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41131286-a49f-438d-b5cb-821a28844baf admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:43.647666 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1288aa-1656-4611-b34c-2ee893d3dfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:43.648277 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1288aa-1656-4611-b34c-2ee893d3dfbe admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:43.648559 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1288aa-1656-4611-b34c-2ee893d3dfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:43.648829 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1288aa-1656-4611-b34c-2ee893d3dfbe admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:43.649509 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1288aa-1656-4611-b34c-2ee893d3dfbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:43.651098 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1288aa-1656-4611-b34c-2ee893d3dfbe admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:43.661496 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1269/2543] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:57:43.665798 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd996c02-ed9f-486e-9697-603e9d9cefc5 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:43.677011 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd996c02-ed9f-486e-9697-603e9d9cefc5 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:43.681814 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a519d-acda-4299-bfb7-b349ac004eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:43.682466 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a519d-acda-4299-bfb7-b349ac004eac admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:43.684224 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a519d-acda-4299-bfb7-b349ac004eac admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:43.684224 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a519d-acda-4299-bfb7-b349ac004eac admin admin] PATH_INFO: `/v3/projects/39f6ae35d7a141619a6baeb3ab0f18e5/users/e323a211bf3b4251822eac3ed164c54d/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:43.685513 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a519d-acda-4299-bfb7-b349ac004eac admin admin] RBAC: Authorizing `identity:create_grant(project_id=39f6ae35d7a141619a6baeb3ab0f18e5, user_id=e323a211bf3b4251822eac3ed164c54d, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:43.688442 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a519d-acda-4299-bfb7-b349ac004eac admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:43.709672 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1275/2544] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:57:43 2022] PUT /identity/v3/projects/39f6ae35d7a141619a6baeb3ab0f18e5/users/e323a211bf3b4251822eac3ed164c54d/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:43.717494 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023edcc-ad61-470a-94cd-4b7f8da1abd6 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:43.717805 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023edcc-ad61-470a-94cd-4b7f8da1abd6 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:43.718430 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023edcc-ad61-470a-94cd-4b7f8da1abd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:43.755352 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-1023edcc-ad61-470a-94cd-4b7f8da1abd6 None None] MFA Rules not processed for user `e323a211bf3b4251822eac3ed164c54d`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:43.757166 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-1023edcc-ad61-470a-94cd-4b7f8da1abd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:43.802052 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a519d-acda-4299-bfb7-b349ac004eac admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:43.804007 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-af0a519d-acda-4299-bfb7-b349ac004eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:43.840550 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1270/2545] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:43.852351 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023edcc-ad61-470a-94cd-4b7f8da1abd6 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:43.853903 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-1023edcc-ad61-470a-94cd-4b7f8da1abd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:43.867462 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a519d-acda-4299-bfb7-b349ac004eac admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:43.871268 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595666b-c4f3-42c6-88eb-d2635978fae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:43.871875 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595666b-c4f3-42c6-88eb-d2635978fae2 service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:43.872156 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595666b-c4f3-42c6-88eb-d2635978fae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:43.872431 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595666b-c4f3-42c6-88eb-d2635978fae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:43.874331 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-b595666b-c4f3-42c6-88eb-d2635978fae2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:43.886139 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:43.920330 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023edcc-ad61-470a-94cd-4b7f8da1abd6 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:43.924127 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cf3da-e1b5-400d-8147-51a046afdf8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:43.924870 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cf3da-e1b5-400d-8147-51a046afdf8b service cinder] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:43.925418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cf3da-e1b5-400d-8147-51a046afdf8b service cinder] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:43.925767 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cf3da-e1b5-400d-8147-51a046afdf8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:43.949356 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595666b-c4f3-42c6-88eb-d2635978fae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:43.950878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595666b-c4f3-42c6-88eb-d2635978fae2 service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:43.961532 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1276/2546] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:57:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:57:43.985673 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5cf3da-e1b5-400d-8147-51a046afdf8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:43.987098 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5cf3da-e1b5-400d-8147-51a046afdf8b service cinder] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:43.997155 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1271/2547] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:57:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:57:47.179182 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595666b-c4f3-42c6-88eb-d2635978fae2 service neutron] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:47.192225 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595666b-c4f3-42c6-88eb-d2635978fae2 service neutron] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:47.199798 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2521c9-5b63-44a6-ba02-3bfcc58686ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:47.200455 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2521c9-5b63-44a6-ba02-3bfcc58686ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:47.200730 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2521c9-5b63-44a6-ba02-3bfcc58686ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:47.200999 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2521c9-5b63-44a6-ba02-3bfcc58686ef admin admin] PATH_INFO: `/v3/users/b6bf6bd846014454bd7824007c79c633` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:47.204090 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2521c9-5b63-44a6-ba02-3bfcc58686ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6bf6bd846014454bd7824007c79c633)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:47.206063 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2521c9-5b63-44a6-ba02-3bfcc58686ef admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:47.419556 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:47.423022 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-aa2521c9-5b63-44a6-ba02-3bfcc58686ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6bf6bd846014454bd7824007c79c633'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:47.531652 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-aa2521c9-5b63-44a6-ba02-3bfcc58686ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6bf6bd846014454bd7824007c79c633'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:47.532880 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-aa2521c9-5b63-44a6-ba02-3bfcc58686ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6bf6bd846014454bd7824007c79c633'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:47.534048 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-aa2521c9-5b63-44a6-ba02-3bfcc58686ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6bf6bd846014454bd7824007c79c633'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:47.542076 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-aa2521c9-5b63-44a6-ba02-3bfcc58686ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6bf6bd846014454bd7824007c79c633'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:47.562413 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1277/2548] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:57:47 2022] DELETE /identity/v3/users/b6bf6bd846014454bd7824007c79c633 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:47.566701 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0551f0-e3e8-420b-b218-de567d219caa None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:47.567169 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0551f0-e3e8-420b-b218-de567d219caa None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:47.567416 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0551f0-e3e8-420b-b218-de567d219caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:47.609350 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-1c0551f0-e3e8-420b-b218-de567d219caa None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:47.611817 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-1c0551f0-e3e8-420b-b218-de567d219caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:47.721333 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1272/2549] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:47.733344 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2521c9-5b63-44a6-ba02-3bfcc58686ef admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:47.734990 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-aa2521c9-5b63-44a6-ba02-3bfcc58686ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:47.803420 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2521c9-5b63-44a6-ba02-3bfcc58686ef admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:47.807020 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0a59e-5562-4b47-86e7-0887f506fc9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:47.809237 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0a59e-5562-4b47-86e7-0887f506fc9b service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:47.809624 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0a59e-5562-4b47-86e7-0887f506fc9b service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:47.810099 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0a59e-5562-4b47-86e7-0887f506fc9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:47.828495 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f0a59e-5562-4b47-86e7-0887f506fc9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:47.830096 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f0a59e-5562-4b47-86e7-0887f506fc9b service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:47.845875 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1278/2550] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:57:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:57:47.978324 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0551f0-e3e8-420b-b218-de567d219caa None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:47.980206 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-1c0551f0-e3e8-420b-b218-de567d219caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:47.996396 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0551f0-e3e8-420b-b218-de567d219caa None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:48.001283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5747161-e6a3-4efc-ac2e-d12be8a8eaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:48.004227 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5747161-e6a3-4efc-ac2e-d12be8a8eaba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:48.004227 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5747161-e6a3-4efc-ac2e-d12be8a8eaba admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:48.004227 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5747161-e6a3-4efc-ac2e-d12be8a8eaba admin admin] PATH_INFO: `/v3/users/56427a32e1044299a1098c911849e601` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:48.004892 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5747161-e6a3-4efc-ac2e-d12be8a8eaba admin admin] RBAC: Authorizing `identity:delete_user(user_id=56427a32e1044299a1098c911849e601)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:48.006869 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5747161-e6a3-4efc-ac2e-d12be8a8eaba admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:48.189471 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e5747161-e6a3-4efc-ac2e-d12be8a8eaba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56427a32e1044299a1098c911849e601'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:48.312428 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e5747161-e6a3-4efc-ac2e-d12be8a8eaba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56427a32e1044299a1098c911849e601'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:48.312965 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e5747161-e6a3-4efc-ac2e-d12be8a8eaba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56427a32e1044299a1098c911849e601'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:48.313613 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e5747161-e6a3-4efc-ac2e-d12be8a8eaba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56427a32e1044299a1098c911849e601'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:48.320142 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0a59e-5562-4b47-86e7-0887f506fc9b service neutron] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:48.327060 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-d9f0a59e-5562-4b47-86e7-0887f506fc9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:48.327281 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e5747161-e6a3-4efc-ac2e-d12be8a8eaba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56427a32e1044299a1098c911849e601'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:48.336511 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:48.337760 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0a59e-5562-4b47-86e7-0887f506fc9b service neutron] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:48.343329 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbdc7ec-1232-4307-a298-61a579292a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:48.344010 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdc7ec-1232-4307-a298-61a579292a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:48.344490 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdc7ec-1232-4307-a298-61a579292a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:48.345553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdc7ec-1232-4307-a298-61a579292a4b admin admin] PATH_INFO: `/v3/projects/e378c7d7c2304db08c4c93e6e43ee2a8` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:48.347248 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbdc7ec-1232-4307-a298-61a579292a4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e378c7d7c2304db08c4c93e6e43ee2a8)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:48.350603 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1273/2551] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:57:47 2022] DELETE /identity/v3/users/56427a32e1044299a1098c911849e601 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:48.351133 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbdc7ec-1232-4307-a298-61a579292a4b admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:48.480582 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-3dbdc7ec-1232-4307-a298-61a579292a4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e378c7d7c2304db08c4c93e6e43ee2a8', 'request_id': 'req-3dbdc7ec-1232-4307-a298-61a579292a4b'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:48.486973 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-3dbdc7ec-1232-4307-a298-61a579292a4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e378c7d7c2304db08c4c93e6e43ee2a8', 'request_id': 'req-3dbdc7ec-1232-4307-a298-61a579292a4b'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:48.597948 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-3dbdc7ec-1232-4307-a298-61a579292a4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e378c7d7c2304db08c4c93e6e43ee2a8', 'request_id': 'req-3dbdc7ec-1232-4307-a298-61a579292a4b'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:48.609581 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-3dbdc7ec-1232-4307-a298-61a579292a4b admin admin] The token cache is being invalidate because project e378c7d7c2304db08c4c93e6e43ee2a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:57:48.609868 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-3dbdc7ec-1232-4307-a298-61a579292a4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:48.610501 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-3dbdc7ec-1232-4307-a298-61a579292a4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:48.611991 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1279/2552] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:57:48 2022] DELETE /identity/v3/projects/e378c7d7c2304db08c4c93e6e43ee2a8 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:57:48.616519 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5747161-e6a3-4efc-ac2e-d12be8a8eaba admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:48.618284 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-e5747161-e6a3-4efc-ac2e-d12be8a8eaba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:48.646714 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbdc7ec-1232-4307-a298-61a579292a4b admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:48.648756 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-3dbdc7ec-1232-4307-a298-61a579292a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:48.699169 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5747161-e6a3-4efc-ac2e-d12be8a8eaba admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:48.704223 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:48.723400 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbdc7ec-1232-4307-a298-61a579292a4b admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:48.728399 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14192e1b-fafb-4cf9-adc1-34de59bb1449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:48.729041 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14192e1b-fafb-4cf9-adc1-34de59bb1449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:48.729332 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14192e1b-fafb-4cf9-adc1-34de59bb1449 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:48.729606 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14192e1b-fafb-4cf9-adc1-34de59bb1449 admin admin] PATH_INFO: `/v3/projects/262fdd56118b426eb90f326b791a20d9` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:48.730751 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14192e1b-fafb-4cf9-adc1-34de59bb1449 admin admin] RBAC: Authorizing `identity:delete_project(project_id=262fdd56118b426eb90f326b791a20d9)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:48.732640 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14192e1b-fafb-4cf9-adc1-34de59bb1449 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:48.761243 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b5bf7-d53c-4442-8e0c-586688669f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:48.761876 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b5bf7-d53c-4442-8e0c-586688669f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:48.762197 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b5bf7-d53c-4442-8e0c-586688669f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:48.762469 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b5bf7-d53c-4442-8e0c-586688669f21 admin admin] PATH_INFO: `/v3/users/e323a211bf3b4251822eac3ed164c54d` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:48.763650 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b5bf7-d53c-4442-8e0c-586688669f21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e323a211bf3b4251822eac3ed164c54d)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:48.765634 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b5bf7-d53c-4442-8e0c-586688669f21 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:48.837903 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-14192e1b-fafb-4cf9-adc1-34de59bb1449 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '262fdd56118b426eb90f326b791a20d9', 'request_id': 'req-14192e1b-fafb-4cf9-adc1-34de59bb1449'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:48.851528 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-14192e1b-fafb-4cf9-adc1-34de59bb1449 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '262fdd56118b426eb90f326b791a20d9', 'request_id': 'req-14192e1b-fafb-4cf9-adc1-34de59bb1449'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:48.921966 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-f53b5bf7-d53c-4442-8e0c-586688669f21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e323a211bf3b4251822eac3ed164c54d'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:48.934805 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-14192e1b-fafb-4cf9-adc1-34de59bb1449 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '262fdd56118b426eb90f326b791a20d9', 'request_id': 'req-14192e1b-fafb-4cf9-adc1-34de59bb1449'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:48.947583 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-14192e1b-fafb-4cf9-adc1-34de59bb1449 admin admin] The token cache is being invalidate because project 262fdd56118b426eb90f326b791a20d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:57:48.947919 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-14192e1b-fafb-4cf9-adc1-34de59bb1449 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:48.948638 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-14192e1b-fafb-4cf9-adc1-34de59bb1449 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:48.950594 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1280/2553] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:57:48 2022] DELETE /identity/v3/projects/262fdd56118b426eb90f326b791a20d9 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:57:48.955297 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc2ad9-853a-450d-81aa-fa85d973849d None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:48.955579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc2ad9-853a-450d-81aa-fa85d973849d None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:48.955896 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc2ad9-853a-450d-81aa-fa85d973849d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:48.978013 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-05bc2ad9-853a-450d-81aa-fa85d973849d None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:48.979254 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-05bc2ad9-853a-450d-81aa-fa85d973849d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:49.027336 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-f53b5bf7-d53c-4442-8e0c-586688669f21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e323a211bf3b4251822eac3ed164c54d'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:49.035652 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-f53b5bf7-d53c-4442-8e0c-586688669f21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e323a211bf3b4251822eac3ed164c54d'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:49.036348 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-f53b5bf7-d53c-4442-8e0c-586688669f21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e323a211bf3b4251822eac3ed164c54d'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:49.044839 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-f53b5bf7-d53c-4442-8e0c-586688669f21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e323a211bf3b4251822eac3ed164c54d'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:49.056685 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1281/2554] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:57:49.059203 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697df5d-c401-4497-9235-a222670a92b5 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:49.059203 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697df5d-c401-4497-9235-a222670a92b5 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:49.059203 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697df5d-c401-4497-9235-a222670a92b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:49.073124 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1274/2555] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:57:48 2022] DELETE /identity/v3/users/e323a211bf3b4251822eac3ed164c54d => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:49.091028 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-a697df5d-c401-4497-9235-a222670a92b5 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:49.092529 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-a697df5d-c401-4497-9235-a222670a92b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:49.166497 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1282/2556] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:49.170941 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b5bf7-d53c-4442-8e0c-586688669f21 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:49.187806 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b5bf7-d53c-4442-8e0c-586688669f21 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:49.192627 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51e0e4-de8b-4520-98c3-3d1ef5387a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:49.193338 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51e0e4-de8b-4520-98c3-3d1ef5387a48 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:49.193638 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51e0e4-de8b-4520-98c3-3d1ef5387a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:49.193892 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51e0e4-de8b-4520-98c3-3d1ef5387a48 admin admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:49.194564 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51e0e4-de8b-4520-98c3-3d1ef5387a48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:57:49.194868 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51e0e4-de8b-4520-98c3-3d1ef5387a48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:49.196679 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51e0e4-de8b-4520-98c3-3d1ef5387a48 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:49.227954 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1275/2557] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:57:49.234976 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697df5d-c401-4497-9235-a222670a92b5 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:49.244876 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697df5d-c401-4497-9235-a222670a92b5 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:49.249824 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fe6b4-7c38-41f0-aa6c-ccbae74a01f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:49.250472 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fe6b4-7c38-41f0-aa6c-ccbae74a01f0 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:49.250774 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fe6b4-7c38-41f0-aa6c-ccbae74a01f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:49.251049 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fe6b4-7c38-41f0-aa6c-ccbae74a01f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:49.251703 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23fe6b4-7c38-41f0-aa6c-ccbae74a01f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:49.254399 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23fe6b4-7c38-41f0-aa6c-ccbae74a01f0 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:49.271062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:49.355011 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1283/2558] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:57:49 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:57:49.356094 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51e0e4-de8b-4520-98c3-3d1ef5387a48 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:49.366817 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51e0e4-de8b-4520-98c3-3d1ef5387a48 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:49.375294 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:49.445742 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12345ca-a3aa-4895-ae43-16e3396235fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:49.446422 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12345ca-a3aa-4895-ae43-16e3396235fe admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:49.446774 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12345ca-a3aa-4895-ae43-16e3396235fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:49.447135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12345ca-a3aa-4895-ae43-16e3396235fe admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:49.447903 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12345ca-a3aa-4895-ae43-16e3396235fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:49.449860 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12345ca-a3aa-4895-ae43-16e3396235fe admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:49.510231 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fe6b4-7c38-41f0-aa6c-ccbae74a01f0 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:49.511995 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-d23fe6b4-7c38-41f0-aa6c-ccbae74a01f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:49.528445 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fe6b4-7c38-41f0-aa6c-ccbae74a01f0 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:49.531405 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1276/2559] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:57:49 2022] POST /identity/v3/users => generated 286 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:57:49.536103 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12345ca-a3aa-4895-ae43-16e3396235fe admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:49.538014 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd088966-2eab-4ec8-b641-291d523a40d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:49.538660 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd088966-2eab-4ec8-b641-291d523a40d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:49.538957 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd088966-2eab-4ec8-b641-291d523a40d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:49.541923 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd088966-2eab-4ec8-b641-291d523a40d4 admin admin] PATH_INFO: `/v3/projects/39f6ae35d7a141619a6baeb3ab0f18e5` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:49.541923 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd088966-2eab-4ec8-b641-291d523a40d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39f6ae35d7a141619a6baeb3ab0f18e5)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:49.542791 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd088966-2eab-4ec8-b641-291d523a40d4 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:49.557938 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12345ca-a3aa-4895-ae43-16e3396235fe admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:49.565353 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7369d01-a760-4d15-b06a-2574fa7d0593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:49.565353 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7369d01-a760-4d15-b06a-2574fa7d0593 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:49.565353 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7369d01-a760-4d15-b06a-2574fa7d0593 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:49.566646 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7369d01-a760-4d15-b06a-2574fa7d0593 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:49.566909 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7369d01-a760-4d15-b06a-2574fa7d0593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:49.568738 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7369d01-a760-4d15-b06a-2574fa7d0593 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:49.587005 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1277/2560] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:57:49.590976 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7369d01-a760-4d15-b06a-2574fa7d0593 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:49.603739 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7369d01-a760-4d15-b06a-2574fa7d0593 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:49.609322 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006af3ee-4ee7-4d43-ad09-524a63db3bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:49.610118 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006af3ee-4ee7-4d43-ad09-524a63db3bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:49.610965 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006af3ee-4ee7-4d43-ad09-524a63db3bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:49.611292 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006af3ee-4ee7-4d43-ad09-524a63db3bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:49.612038 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006af3ee-4ee7-4d43-ad09-524a63db3bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:49.613764 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006af3ee-4ee7-4d43-ad09-524a63db3bd1 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:49.625012 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1278/2561] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:57:49.629916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006af3ee-4ee7-4d43-ad09-524a63db3bd1 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:49.641434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006af3ee-4ee7-4d43-ad09-524a63db3bd1 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:49.647292 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e83a5-c913-4c98-839b-c7f2bcf3b954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:49.647987 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e83a5-c913-4c98-839b-c7f2bcf3b954 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:49.648274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e83a5-c913-4c98-839b-c7f2bcf3b954 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:49.648547 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e83a5-c913-4c98-839b-c7f2bcf3b954 admin admin] PATH_INFO: `/v3/projects/469b2c56886b4ba9992bd2ce99c7e50d/users/0dc95fdedf854d52b67ef5b5c9887cc1/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:49.665623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e83a5-c913-4c98-839b-c7f2bcf3b954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=469b2c56886b4ba9992bd2ce99c7e50d, user_id=0dc95fdedf854d52b67ef5b5c9887cc1, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:49.668496 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e83a5-c913-4c98-839b-c7f2bcf3b954 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:49.788368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1279/2562] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:57:49 2022] PUT /identity/v3/projects/469b2c56886b4ba9992bd2ce99c7e50d/users/0dc95fdedf854d52b67ef5b5c9887cc1/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:57:49.798764 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39924263-b74a-4285-9bbd-60224bdbf294 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:49.799063 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39924263-b74a-4285-9bbd-60224bdbf294 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:49.799342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39924263-b74a-4285-9bbd-60224bdbf294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:49.807929 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-fd088966-2eab-4ec8-b641-291d523a40d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39f6ae35d7a141619a6baeb3ab0f18e5', 'request_id': 'req-fd088966-2eab-4ec8-b641-291d523a40d4'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:49.820285 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-fd088966-2eab-4ec8-b641-291d523a40d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39f6ae35d7a141619a6baeb3ab0f18e5', 'request_id': 'req-fd088966-2eab-4ec8-b641-291d523a40d4'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:49.832705 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-39924263-b74a-4285-9bbd-60224bdbf294 None None] MFA Rules not processed for user `0dc95fdedf854d52b67ef5b5c9887cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:49.834100 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-39924263-b74a-4285-9bbd-60224bdbf294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:49.894845 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-fd088966-2eab-4ec8-b641-291d523a40d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39f6ae35d7a141619a6baeb3ab0f18e5', 'request_id': 'req-fd088966-2eab-4ec8-b641-291d523a40d4'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:49.901570 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1280/2563] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:49.906484 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-fd088966-2eab-4ec8-b641-291d523a40d4 admin admin] The token cache is being invalidate because project 39f6ae35d7a141619a6baeb3ab0f18e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:57:49.906778 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-fd088966-2eab-4ec8-b641-291d523a40d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:49.907663 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-fd088966-2eab-4ec8-b641-291d523a40d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:49.909216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1284/2564] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:57:49 2022] DELETE /identity/v3/projects/39f6ae35d7a141619a6baeb3ab0f18e5 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:57:49.914104 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39924263-b74a-4285-9bbd-60224bdbf294 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:49.915715 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-39924263-b74a-4285-9bbd-60224bdbf294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:49.988960 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:50.023127 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39924263-b74a-4285-9bbd-60224bdbf294 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:50.029718 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44aede0-e7b4-4f9f-82a3-c8cd34d4ebcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3973b8fbfbb9475896e4e110ca8aa615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:50.030327 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44aede0-e7b4-4f9f-82a3-c8cd34d4ebcc service nova] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:50.030605 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44aede0-e7b4-4f9f-82a3-c8cd34d4ebcc service nova] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:50.030870 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44aede0-e7b4-4f9f-82a3-c8cd34d4ebcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:50.032698 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-e44aede0-e7b4-4f9f-82a3-c8cd34d4ebcc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:50.044791 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44aede0-e7b4-4f9f-82a3-c8cd34d4ebcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:50.046504 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44aede0-e7b4-4f9f-82a3-c8cd34d4ebcc service nova] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:50.057810 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1281/2565] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:57:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:57:50.289930 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd088966-2eab-4ec8-b641-291d523a40d4 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:50.289930 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-fd088966-2eab-4ec8-b641-291d523a40d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:50.356677 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd088966-2eab-4ec8-b641-291d523a40d4 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:50.361461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b7517-beac-4bb3-8902-82f2178832b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:50.362092 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b7517-beac-4bb3-8902-82f2178832b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:50.362368 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b7517-beac-4bb3-8902-82f2178832b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:50.362765 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b7517-beac-4bb3-8902-82f2178832b6 admin admin] PATH_INFO: `/v3/users/0dc95fdedf854d52b67ef5b5c9887cc1` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:50.363912 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b7517-beac-4bb3-8902-82f2178832b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dc95fdedf854d52b67ef5b5c9887cc1)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:50.365846 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b7517-beac-4bb3-8902-82f2178832b6 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:50.571713 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-db6b7517-beac-4bb3-8902-82f2178832b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dc95fdedf854d52b67ef5b5c9887cc1'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:50.637521 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-db6b7517-beac-4bb3-8902-82f2178832b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dc95fdedf854d52b67ef5b5c9887cc1'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:50.638157 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-db6b7517-beac-4bb3-8902-82f2178832b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dc95fdedf854d52b67ef5b5c9887cc1'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:50.638761 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-db6b7517-beac-4bb3-8902-82f2178832b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dc95fdedf854d52b67ef5b5c9887cc1'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:50.646877 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-db6b7517-beac-4bb3-8902-82f2178832b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dc95fdedf854d52b67ef5b5c9887cc1'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:50.660056 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:50.665211 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1285/2566] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:57:50 2022] DELETE /identity/v3/users/0dc95fdedf854d52b67ef5b5c9887cc1 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:50.669599 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6160e-a6c3-448e-9e7b-7e90b3836d8f None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:50.670071 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6160e-a6c3-448e-9e7b-7e90b3836d8f None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:50.670215 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6160e-a6c3-448e-9e7b-7e90b3836d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:50.689576 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-a5c6160e-a6c3-448e-9e7b-7e90b3836d8f None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:50.691912 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-a5c6160e-a6c3-448e-9e7b-7e90b3836d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:50.751006 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1282/2567] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:50.761020 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b7517-beac-4bb3-8902-82f2178832b6 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:50.762495 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-db6b7517-beac-4bb3-8902-82f2178832b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:50.820962 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b7517-beac-4bb3-8902-82f2178832b6 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:50.824650 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f436f-adff-4b2d-8a55-71756f6482aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:50.826335 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f436f-adff-4b2d-8a55-71756f6482aa service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:50.826335 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f436f-adff-4b2d-8a55-71756f6482aa service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:50.826335 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f436f-adff-4b2d-8a55-71756f6482aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:50.835604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f436f-adff-4b2d-8a55-71756f6482aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:50.837045 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f436f-adff-4b2d-8a55-71756f6482aa service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:50.846644 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1286/2568] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:57:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:57:51.274706 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6160e-a6c3-448e-9e7b-7e90b3836d8f None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:51.276175 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-a5c6160e-a6c3-448e-9e7b-7e90b3836d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:51.288479 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6160e-a6c3-448e-9e7b-7e90b3836d8f None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:51.293231 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce6b34-56b8-41fa-a03b-ed81007c0875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:51.293863 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce6b34-56b8-41fa-a03b-ed81007c0875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:51.294139 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce6b34-56b8-41fa-a03b-ed81007c0875 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:51.294414 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce6b34-56b8-41fa-a03b-ed81007c0875 admin admin] PATH_INFO: `/v3/projects/469b2c56886b4ba9992bd2ce99c7e50d` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:51.295526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce6b34-56b8-41fa-a03b-ed81007c0875 admin admin] RBAC: Authorizing `identity:delete_project(project_id=469b2c56886b4ba9992bd2ce99c7e50d)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:51.297452 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce6b34-56b8-41fa-a03b-ed81007c0875 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:51.428303 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-d2ce6b34-56b8-41fa-a03b-ed81007c0875 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '469b2c56886b4ba9992bd2ce99c7e50d', 'request_id': 'req-d2ce6b34-56b8-41fa-a03b-ed81007c0875'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:51.434786 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-d2ce6b34-56b8-41fa-a03b-ed81007c0875 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '469b2c56886b4ba9992bd2ce99c7e50d', 'request_id': 'req-d2ce6b34-56b8-41fa-a03b-ed81007c0875'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:51.517410 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-d2ce6b34-56b8-41fa-a03b-ed81007c0875 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '469b2c56886b4ba9992bd2ce99c7e50d', 'request_id': 'req-d2ce6b34-56b8-41fa-a03b-ed81007c0875'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:51.529368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-d2ce6b34-56b8-41fa-a03b-ed81007c0875 admin admin] The token cache is being invalidate because project 469b2c56886b4ba9992bd2ce99c7e50d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:57:51.529658 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-d2ce6b34-56b8-41fa-a03b-ed81007c0875 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:51.530291 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-d2ce6b34-56b8-41fa-a03b-ed81007c0875 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:51.531845 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1283/2569] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:57:51 2022] DELETE /identity/v3/projects/469b2c56886b4ba9992bd2ce99c7e50d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:51.537181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cf287-056a-4a99-bf5b-5ccf596f51dd None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:51.537665 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cf287-056a-4a99-bf5b-5ccf596f51dd None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:51.540698 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cf287-056a-4a99-bf5b-5ccf596f51dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:51.560904 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-ce2cf287-056a-4a99-bf5b-5ccf596f51dd None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:51.562440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-ce2cf287-056a-4a99-bf5b-5ccf596f51dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:51.623685 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1287/2570] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:51.633748 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab818179-560b-45f4-820e-8af3cd4517e1 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:51.634043 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab818179-560b-45f4-820e-8af3cd4517e1 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:51.634323 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab818179-560b-45f4-820e-8af3cd4517e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:51.654190 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-ab818179-560b-45f4-820e-8af3cd4517e1 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:51.655433 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-ab818179-560b-45f4-820e-8af3cd4517e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:51.664030 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1284/2571] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:51.668530 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cf287-056a-4a99-bf5b-5ccf596f51dd None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:51.678979 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cf287-056a-4a99-bf5b-5ccf596f51dd None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:51.683605 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf3160-fae3-4448-9d25-81cad3758fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:51.684202 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf3160-fae3-4448-9d25-81cad3758fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:51.684483 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf3160-fae3-4448-9d25-81cad3758fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:51.684761 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf3160-fae3-4448-9d25-81cad3758fc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:51.689888 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf3160-fae3-4448-9d25-81cad3758fc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:57:51.689888 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf3160-fae3-4448-9d25-81cad3758fc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:51.689888 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf3160-fae3-4448-9d25-81cad3758fc7 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:51.703707 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1288/2572] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:57:51.704771 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab818179-560b-45f4-820e-8af3cd4517e1 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:51.715398 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab818179-560b-45f4-820e-8af3cd4517e1 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:51.723148 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6acfd7-cb1f-4620-9811-e22d188c8576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:51.723148 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6acfd7-cb1f-4620-9811-e22d188c8576 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:51.723148 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6acfd7-cb1f-4620-9811-e22d188c8576 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:51.723148 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6acfd7-cb1f-4620-9811-e22d188c8576 admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:51.723551 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6acfd7-cb1f-4620-9811-e22d188c8576 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:51.724922 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6acfd7-cb1f-4620-9811-e22d188c8576 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:51.827981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1285/2573] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:57:51 2022] POST /identity/v3/projects => generated 403 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:57:51.833494 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf3160-fae3-4448-9d25-81cad3758fc7 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:51.843901 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf3160-fae3-4448-9d25-81cad3758fc7 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:51.899457 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57f64c-9c7a-48af-bf23-2cb92c941a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:51.900056 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57f64c-9c7a-48af-bf23-2cb92c941a45 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:51.900343 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57f64c-9c7a-48af-bf23-2cb92c941a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:51.900620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57f64c-9c7a-48af-bf23-2cb92c941a45 admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:51.901287 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb57f64c-9c7a-48af-bf23-2cb92c941a45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:51.903190 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb57f64c-9c7a-48af-bf23-2cb92c941a45 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:51.980300 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1289/2574] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:57:51 2022] POST /identity/v3/users => generated 302 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:57:51.984374 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6acfd7-cb1f-4620-9811-e22d188c8576 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:51.995049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6acfd7-cb1f-4620-9811-e22d188c8576 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:51.999647 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efcae4-a692-4d90-b0b3-05179827c51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:52.000232 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efcae4-a692-4d90-b0b3-05179827c51a admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:52.000510 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efcae4-a692-4d90-b0b3-05179827c51a admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:52.000780 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efcae4-a692-4d90-b0b3-05179827c51a admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:52.001447 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48efcae4-a692-4d90-b0b3-05179827c51a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:52.003514 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48efcae4-a692-4d90-b0b3-05179827c51a admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:52.013768 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1286/2575] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:57:52.017758 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57f64c-9c7a-48af-bf23-2cb92c941a45 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:52.028373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57f64c-9c7a-48af-bf23-2cb92c941a45 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:52.033057 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295ccb1-7d46-472f-aad1-c11a58d13679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:52.033650 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295ccb1-7d46-472f-aad1-c11a58d13679 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:52.033932 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295ccb1-7d46-472f-aad1-c11a58d13679 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:52.034255 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295ccb1-7d46-472f-aad1-c11a58d13679 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:52.034926 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e295ccb1-7d46-472f-aad1-c11a58d13679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:52.036529 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e295ccb1-7d46-472f-aad1-c11a58d13679 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:52.046851 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1290/2576] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:57:52.050973 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efcae4-a692-4d90-b0b3-05179827c51a admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:52.061086 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efcae4-a692-4d90-b0b3-05179827c51a admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:52.066377 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3255534-37cb-4f1e-912b-3d8304092697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:52.066990 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3255534-37cb-4f1e-912b-3d8304092697 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:52.067272 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3255534-37cb-4f1e-912b-3d8304092697 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:52.067543 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3255534-37cb-4f1e-912b-3d8304092697 admin admin] PATH_INFO: `/v3/projects/880299ba4b2c4a88b16b12443eb65981/users/db33aea171c940d98841e1e6c53821eb/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:52.070595 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:52.084745 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3255534-37cb-4f1e-912b-3d8304092697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=880299ba4b2c4a88b16b12443eb65981, user_id=db33aea171c940d98841e1e6c53821eb, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:52.087513 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3255534-37cb-4f1e-912b-3d8304092697 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:52.181477 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1287/2577] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:57:52 2022] PUT /identity/v3/projects/880299ba4b2c4a88b16b12443eb65981/users/db33aea171c940d98841e1e6c53821eb/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:57:52.187911 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637ddae-2ab4-417b-8583-459df3e011f6 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:52.188199 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637ddae-2ab4-417b-8583-459df3e011f6 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:52.188473 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637ddae-2ab4-417b-8583-459df3e011f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:52.202964 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:52.208789 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-d637ddae-2ab4-417b-8583-459df3e011f6 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:52.210017 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-d637ddae-2ab4-417b-8583-459df3e011f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:52.269301 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1291/2578] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:52.270379 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3255534-37cb-4f1e-912b-3d8304092697 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:52.272268 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-d3255534-37cb-4f1e-912b-3d8304092697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:52.278607 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637ddae-2ab4-417b-8583-459df3e011f6 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:52.280434 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-d637ddae-2ab4-417b-8583-459df3e011f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:52.287189 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3255534-37cb-4f1e-912b-3d8304092697 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:52.291817 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7feed4c-483b-4355-9354-ad50ba15d80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:52.292438 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7feed4c-483b-4355-9354-ad50ba15d80f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:52.292714 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7feed4c-483b-4355-9354-ad50ba15d80f admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:52.292984 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7feed4c-483b-4355-9354-ad50ba15d80f admin admin] PATH_INFO: `/v3/users/ecf633d2428f4725b01f860a427bb0cc` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:52.294180 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7feed4c-483b-4355-9354-ad50ba15d80f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecf633d2428f4725b01f860a427bb0cc)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:52.296112 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7feed4c-483b-4355-9354-ad50ba15d80f admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:52.338832 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637ddae-2ab4-417b-8583-459df3e011f6 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:52.342725 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b70d6-0b97-4206-b99d-f5fa831b361a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:52.343326 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b70d6-0b97-4206-b99d-f5fa831b361a service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:52.343606 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b70d6-0b97-4206-b99d-f5fa831b361a service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:52.343878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b70d6-0b97-4206-b99d-f5fa831b361a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:52.354041 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b70d6-0b97-4206-b99d-f5fa831b361a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:52.355454 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b70d6-0b97-4206-b99d-f5fa831b361a service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:52.364932 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1292/2579] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:57:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:57:52.481269 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-c7feed4c-483b-4355-9354-ad50ba15d80f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecf633d2428f4725b01f860a427bb0cc'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:52.580599 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-c7feed4c-483b-4355-9354-ad50ba15d80f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecf633d2428f4725b01f860a427bb0cc'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:52.581368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-c7feed4c-483b-4355-9354-ad50ba15d80f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecf633d2428f4725b01f860a427bb0cc'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:52.582484 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-c7feed4c-483b-4355-9354-ad50ba15d80f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecf633d2428f4725b01f860a427bb0cc'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:52.590371 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-c7feed4c-483b-4355-9354-ad50ba15d80f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecf633d2428f4725b01f860a427bb0cc'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:52.609474 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1288/2580] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:57:52 2022] DELETE /identity/v3/users/ecf633d2428f4725b01f860a427bb0cc => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:52.614707 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac10179-d16d-4281-a324-a1340f721aec None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:52.615207 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac10179-d16d-4281-a324-a1340f721aec None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:52.615328 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac10179-d16d-4281-a324-a1340f721aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:52.636847 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-2ac10179-d16d-4281-a324-a1340f721aec None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:52.638094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-2ac10179-d16d-4281-a324-a1340f721aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:52.705005 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1293/2581] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:52.715090 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7feed4c-483b-4355-9354-ad50ba15d80f admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:52.716499 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-c7feed4c-483b-4355-9354-ad50ba15d80f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:52.773679 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7feed4c-483b-4355-9354-ad50ba15d80f admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:52.777465 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745f211-399a-46f4-b021-e5ef2d4fdade service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:52.778135 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745f211-399a-46f4-b021-e5ef2d4fdade service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:52.778434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745f211-399a-46f4-b021-e5ef2d4fdade service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:52.779707 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745f211-399a-46f4-b021-e5ef2d4fdade service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:52.790420 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6745f211-399a-46f4-b021-e5ef2d4fdade service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:52.791884 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6745f211-399a-46f4-b021-e5ef2d4fdade service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:52.803161 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1289/2582] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:57:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:57:53.456241 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac10179-d16d-4281-a324-a1340f721aec None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:53.458476 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-2ac10179-d16d-4281-a324-a1340f721aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:53.471879 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac10179-d16d-4281-a324-a1340f721aec None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:53.477316 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696112af-1fde-496b-9109-32bcc3e587dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:53.477956 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696112af-1fde-496b-9109-32bcc3e587dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:53.478237 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696112af-1fde-496b-9109-32bcc3e587dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:53.478511 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696112af-1fde-496b-9109-32bcc3e587dd admin admin] PATH_INFO: `/v3/projects/58989def4930477fa2f13453542c2dd9` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:53.479650 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696112af-1fde-496b-9109-32bcc3e587dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=58989def4930477fa2f13453542c2dd9)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:53.487211 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696112af-1fde-496b-9109-32bcc3e587dd admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:53.619238 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:53.622149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-696112af-1fde-496b-9109-32bcc3e587dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58989def4930477fa2f13453542c2dd9', 'request_id': 'req-696112af-1fde-496b-9109-32bcc3e587dd'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:53.627697 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-696112af-1fde-496b-9109-32bcc3e587dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58989def4930477fa2f13453542c2dd9', 'request_id': 'req-696112af-1fde-496b-9109-32bcc3e587dd'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:53.700797 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-696112af-1fde-496b-9109-32bcc3e587dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58989def4930477fa2f13453542c2dd9', 'request_id': 'req-696112af-1fde-496b-9109-32bcc3e587dd'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:53.718688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-696112af-1fde-496b-9109-32bcc3e587dd admin admin] The token cache is being invalidate because project 58989def4930477fa2f13453542c2dd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:57:53.718688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-696112af-1fde-496b-9109-32bcc3e587dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:53.719668 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-696112af-1fde-496b-9109-32bcc3e587dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:53.721334 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1294/2583] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:57:53 2022] DELETE /identity/v3/projects/58989def4930477fa2f13453542c2dd9 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:57:53.726266 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745f211-399a-46f4-b021-e5ef2d4fdade service neutron] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:53.736097 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745f211-399a-46f4-b021-e5ef2d4fdade service neutron] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:53.788264 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d01f8c-0adc-479f-9d00-959f9930427a None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:53.788987 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d01f8c-0adc-479f-9d00-959f9930427a None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:53.789518 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d01f8c-0adc-479f-9d00-959f9930427a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:53.802619 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16bec2-48fc-4bf8-a071-b7ef95c9a4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:53.803350 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16bec2-48fc-4bf8-a071-b7ef95c9a4f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:53.803662 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16bec2-48fc-4bf8-a071-b7ef95c9a4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:53.803972 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16bec2-48fc-4bf8-a071-b7ef95c9a4f4 admin admin] PATH_INFO: `/v3/users/18bfcec471a546df93f7abdfac5ab0a8` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:53.805176 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea16bec2-48fc-4bf8-a071-b7ef95c9a4f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18bfcec471a546df93f7abdfac5ab0a8)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:53.808139 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea16bec2-48fc-4bf8-a071-b7ef95c9a4f4 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:53.810989 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:53.829936 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-c6d01f8c-0adc-479f-9d00-959f9930427a None None] MFA Rules not processed for user `db33aea171c940d98841e1e6c53821eb`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:53.832289 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-c6d01f8c-0adc-479f-9d00-959f9930427a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:53.925007 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1295/2584] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:53 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:57:53.927891 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d01f8c-0adc-479f-9d00-959f9930427a None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:53.929294 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-c6d01f8c-0adc-479f-9d00-959f9930427a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:53.946025 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d01f8c-0adc-479f-9d00-959f9930427a None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:53.950776 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9945d-91d3-4b91-89bb-2332e93e971a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:53.951387 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9945d-91d3-4b91-89bb-2332e93e971a admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:53.951669 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9945d-91d3-4b91-89bb-2332e93e971a admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:53.951942 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9945d-91d3-4b91-89bb-2332e93e971a admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:53.952639 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a9945d-91d3-4b91-89bb-2332e93e971a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:53.954582 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a9945d-91d3-4b91-89bb-2332e93e971a admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:54.011361 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-ea16bec2-48fc-4bf8-a071-b7ef95c9a4f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18bfcec471a546df93f7abdfac5ab0a8'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:54.026791 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1296/2585] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:57:53 2022] POST /identity/v3/projects => generated 403 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:57:54.027522 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9945d-91d3-4b91-89bb-2332e93e971a admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:54.091016 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9945d-91d3-4b91-89bb-2332e93e971a admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:54.094951 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-ea16bec2-48fc-4bf8-a071-b7ef95c9a4f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18bfcec471a546df93f7abdfac5ab0a8'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:54.095577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-ea16bec2-48fc-4bf8-a071-b7ef95c9a4f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18bfcec471a546df93f7abdfac5ab0a8'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:54.096183 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-ea16bec2-48fc-4bf8-a071-b7ef95c9a4f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18bfcec471a546df93f7abdfac5ab0a8'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:54.096355 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42331ff3-59eb-44dd-b5a7-0acc7b8a7f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:54.097164 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42331ff3-59eb-44dd-b5a7-0acc7b8a7f24 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:54.097462 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42331ff3-59eb-44dd-b5a7-0acc7b8a7f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:54.097712 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42331ff3-59eb-44dd-b5a7-0acc7b8a7f24 admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:54.098369 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42331ff3-59eb-44dd-b5a7-0acc7b8a7f24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:54.100390 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42331ff3-59eb-44dd-b5a7-0acc7b8a7f24 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:54.105451 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-ea16bec2-48fc-4bf8-a071-b7ef95c9a4f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18bfcec471a546df93f7abdfac5ab0a8'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:54.127105 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1290/2586] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:57:53 2022] DELETE /identity/v3/users/18bfcec471a546df93f7abdfac5ab0a8 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:54.203598 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1297/2587] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:57:54 2022] POST /identity/v3/users => generated 308 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:57:54.208864 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16bec2-48fc-4bf8-a071-b7ef95c9a4f4 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:54.210370 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-ea16bec2-48fc-4bf8-a071-b7ef95c9a4f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:54.276548 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16bec2-48fc-4bf8-a071-b7ef95c9a4f4 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:54.281379 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae2bac-849a-4918-a1c5-2acf455e422e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:54.281991 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae2bac-849a-4918-a1c5-2acf455e422e admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:54.282276 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae2bac-849a-4918-a1c5-2acf455e422e admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:54.282551 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae2bac-849a-4918-a1c5-2acf455e422e admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:54.283197 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae2bac-849a-4918-a1c5-2acf455e422e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:54.284868 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae2bac-849a-4918-a1c5-2acf455e422e admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:54.294596 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1291/2588] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:57:54.299031 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42331ff3-59eb-44dd-b5a7-0acc7b8a7f24 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:54.309277 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42331ff3-59eb-44dd-b5a7-0acc7b8a7f24 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:54.313985 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb98103-23e8-46c8-a333-6f94d2736663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:54.314684 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb98103-23e8-46c8-a333-6f94d2736663 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:54.314966 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb98103-23e8-46c8-a333-6f94d2736663 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:54.315238 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb98103-23e8-46c8-a333-6f94d2736663 admin admin] PATH_INFO: `/v3/projects/9838c2ea426b425787de3949a65c2bd9/users/e49e79b03a1744c1a9703b82c4933183/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:54.330434 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb98103-23e8-46c8-a333-6f94d2736663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9838c2ea426b425787de3949a65c2bd9, user_id=e49e79b03a1744c1a9703b82c4933183, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:54.333625 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb98103-23e8-46c8-a333-6f94d2736663 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:54.468654 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1298/2589] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:57:54 2022] PUT /identity/v3/projects/9838c2ea426b425787de3949a65c2bd9/users/e49e79b03a1744c1a9703b82c4933183/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:54.473753 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae2bac-849a-4918-a1c5-2acf455e422e admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:54.484037 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae2bac-849a-4918-a1c5-2acf455e422e admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:54.544361 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233dae66-e76a-4fae-b24c-f2c9d696d5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:54.544963 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dae66-e76a-4fae-b24c-f2c9d696d5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:54.545276 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dae66-e76a-4fae-b24c-f2c9d696d5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:54.545548 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dae66-e76a-4fae-b24c-f2c9d696d5d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:54.546195 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233dae66-e76a-4fae-b24c-f2c9d696d5d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:54.547780 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233dae66-e76a-4fae-b24c-f2c9d696d5d2 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:54.560734 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1292/2590] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:57:54.562090 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb98103-23e8-46c8-a333-6f94d2736663 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:54.574203 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb98103-23e8-46c8-a333-6f94d2736663 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:54.576477 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233dae66-e76a-4fae-b24c-f2c9d696d5d2 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:54.578595 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-233dae66-e76a-4fae-b24c-f2c9d696d5d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:54.582170 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ba3fb-3934-4b54-8631-1481e65f5ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:54.582956 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ba3fb-3934-4b54-8631-1481e65f5ae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:54.583302 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ba3fb-3934-4b54-8631-1481e65f5ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:54.583576 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ba3fb-3934-4b54-8631-1481e65f5ae2 admin admin] PATH_INFO: `/v3/projects/9838c2ea426b425787de3949a65c2bd9/users/e49e79b03a1744c1a9703b82c4933183/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:54.586151 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ba3fb-3934-4b54-8631-1481e65f5ae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9838c2ea426b425787de3949a65c2bd9, user_id=e49e79b03a1744c1a9703b82c4933183, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:54.589514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ba3fb-3934-4b54-8631-1481e65f5ae2 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:54.593875 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:DELETE=4,keystone:SELECT=90,keystone:INSERT=6 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:54.603547 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233dae66-e76a-4fae-b24c-f2c9d696d5d2 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:54.607678 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1299/2591] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:57:54 2022] PUT /identity/v3/projects/9838c2ea426b425787de3949a65c2bd9/users/e49e79b03a1744c1a9703b82c4933183/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:57:54.614908 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:54.666669 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6837d99-9d56-4744-b1a1-a07cf6faee1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:54.667296 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6837d99-9d56-4744-b1a1-a07cf6faee1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:54.667586 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6837d99-9d56-4744-b1a1-a07cf6faee1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:54.667863 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6837d99-9d56-4744-b1a1-a07cf6faee1e admin admin] PATH_INFO: `/v3/projects/849f8fa354484164a405491a19051900` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:54.669012 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6837d99-9d56-4744-b1a1-a07cf6faee1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=849f8fa354484164a405491a19051900)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:54.674725 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6837d99-9d56-4744-b1a1-a07cf6faee1e admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:54.777331 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-b6837d99-9d56-4744-b1a1-a07cf6faee1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '849f8fa354484164a405491a19051900', 'request_id': 'req-b6837d99-9d56-4744-b1a1-a07cf6faee1e'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:54.783403 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-b6837d99-9d56-4744-b1a1-a07cf6faee1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '849f8fa354484164a405491a19051900', 'request_id': 'req-b6837d99-9d56-4744-b1a1-a07cf6faee1e'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:54.889118 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-b6837d99-9d56-4744-b1a1-a07cf6faee1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '849f8fa354484164a405491a19051900', 'request_id': 'req-b6837d99-9d56-4744-b1a1-a07cf6faee1e'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:54.902965 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-b6837d99-9d56-4744-b1a1-a07cf6faee1e admin admin] The token cache is being invalidate because project 849f8fa354484164a405491a19051900 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:57:54.903254 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-b6837d99-9d56-4744-b1a1-a07cf6faee1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:54.904193 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-b6837d99-9d56-4744-b1a1-a07cf6faee1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:54.905828 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1293/2592] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:57:54 2022] DELETE /identity/v3/projects/849f8fa354484164a405491a19051900 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:57:54.910920 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1847ec4-f92b-41da-846a-14519f7372a7 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:54.911434 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1847ec4-f92b-41da-846a-14519f7372a7 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:54.911549 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1847ec4-f92b-41da-846a-14519f7372a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:54.932133 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-e1847ec4-f92b-41da-846a-14519f7372a7 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:54.933473 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-e1847ec4-f92b-41da-846a-14519f7372a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:54.998526 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1300/2593] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:55.007299 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579a1e3-34d6-49e8-b600-508a0b608975 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:55.007590 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579a1e3-34d6-49e8-b600-508a0b608975 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:55.012167 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579a1e3-34d6-49e8-b600-508a0b608975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:55.028109 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-b579a1e3-34d6-49e8-b600-508a0b608975 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:55.029356 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-b579a1e3-34d6-49e8-b600-508a0b608975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:55.038586 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1294/2594] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:55.042960 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1847ec4-f92b-41da-846a-14519f7372a7 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:55.052888 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1847ec4-f92b-41da-846a-14519f7372a7 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:55.057481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393e242-7ab4-498b-8939-17536f45f8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:55.058071 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393e242-7ab4-498b-8939-17536f45f8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:55.058353 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393e242-7ab4-498b-8939-17536f45f8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:55.058676 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393e242-7ab4-498b-8939-17536f45f8d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:55.059329 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1393e242-7ab4-498b-8939-17536f45f8d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:57:55.059631 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1393e242-7ab4-498b-8939-17536f45f8d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:55.061254 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1393e242-7ab4-498b-8939-17536f45f8d2 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:55.077420 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1301/2595] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:57:55.090691 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579a1e3-34d6-49e8-b600-508a0b608975 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:55.100274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579a1e3-34d6-49e8-b600-508a0b608975 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:55.105228 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65abafc-ab77-4a49-8054-d7240c9624ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:55.105828 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65abafc-ab77-4a49-8054-d7240c9624ea admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:55.106115 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65abafc-ab77-4a49-8054-d7240c9624ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:55.106390 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65abafc-ab77-4a49-8054-d7240c9624ea admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:55.107043 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65abafc-ab77-4a49-8054-d7240c9624ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:55.108962 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65abafc-ab77-4a49-8054-d7240c9624ea admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:55.213074 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1295/2596] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:57:55 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:57:55.216799 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393e242-7ab4-498b-8939-17536f45f8d2 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:55.228035 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393e242-7ab4-498b-8939-17536f45f8d2 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:55.282963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d6203-1fce-4a0a-acaf-e3024030fd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:55.283554 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d6203-1fce-4a0a-acaf-e3024030fd3c admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:55.283830 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d6203-1fce-4a0a-acaf-e3024030fd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:55.284097 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d6203-1fce-4a0a-acaf-e3024030fd3c admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:55.285907 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6d6203-1fce-4a0a-acaf-e3024030fd3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:55.287791 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6d6203-1fce-4a0a-acaf-e3024030fd3c admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:55.413018 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1302/2597] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:57:55 2022] POST /identity/v3/users => generated 292 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:57:55.414516 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65abafc-ab77-4a49-8054-d7240c9624ea admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:55.425295 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65abafc-ab77-4a49-8054-d7240c9624ea admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:55.430121 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ddee9-dea2-4ae1-8e62-886765eebeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:55.430696 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ddee9-dea2-4ae1-8e62-886765eebeb1 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:55.430982 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ddee9-dea2-4ae1-8e62-886765eebeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:55.431258 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ddee9-dea2-4ae1-8e62-886765eebeb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:55.431903 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ddee9-dea2-4ae1-8e62-886765eebeb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:55.433552 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ddee9-dea2-4ae1-8e62-886765eebeb1 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:55.446766 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1296/2598] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:57:55.448263 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d6203-1fce-4a0a-acaf-e3024030fd3c admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:55.459259 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d6203-1fce-4a0a-acaf-e3024030fd3c admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:55.463958 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b01b6d-d45c-486f-abed-200c4a573e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:55.464558 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b01b6d-d45c-486f-abed-200c4a573e05 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:55.465136 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b01b6d-d45c-486f-abed-200c4a573e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:55.465413 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b01b6d-d45c-486f-abed-200c4a573e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:55.466053 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b01b6d-d45c-486f-abed-200c4a573e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:55.467655 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b01b6d-d45c-486f-abed-200c4a573e05 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:55.480722 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1303/2599] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:57:55.484801 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ddee9-dea2-4ae1-8e62-886765eebeb1 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:55.495064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ddee9-dea2-4ae1-8e62-886765eebeb1 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:55.499823 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93c641-5de0-4724-a536-18a5e753ba66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:55.500474 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93c641-5de0-4724-a536-18a5e753ba66 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:55.500758 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93c641-5de0-4724-a536-18a5e753ba66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:55.501057 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93c641-5de0-4724-a536-18a5e753ba66 admin admin] PATH_INFO: `/v3/projects/3d452ab42bd149a4bd62624530b29442/users/eeba411838e041b89d655651a8ab7db2/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:55.517022 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93c641-5de0-4724-a536-18a5e753ba66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d452ab42bd149a4bd62624530b29442, user_id=eeba411838e041b89d655651a8ab7db2, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:55.520348 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93c641-5de0-4724-a536-18a5e753ba66 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:55.633703 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1297/2600] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:57:55 2022] PUT /identity/v3/projects/3d452ab42bd149a4bd62624530b29442/users/eeba411838e041b89d655651a8ab7db2/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:55.646683 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106aa21-7745-4791-92b4-93a995826bb8 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:55.647009 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106aa21-7745-4791-92b4-93a995826bb8 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:55.647236 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106aa21-7745-4791-92b4-93a995826bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:55.676757 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-9106aa21-7745-4791-92b4-93a995826bb8 None None] MFA Rules not processed for user `eeba411838e041b89d655651a8ab7db2`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:55.677996 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-9106aa21-7745-4791-92b4-93a995826bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:55.728337 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:55.749826 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1304/2601] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:55.751291 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93c641-5de0-4724-a536-18a5e753ba66 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:55.923814 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:55.945425 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93c641-5de0-4724-a536-18a5e753ba66 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:55.950340 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72954e2a-ab05-45b4-89e4-a5727e9493c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:55.950959 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72954e2a-ab05-45b4-89e4-a5727e9493c9 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:55.951240 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72954e2a-ab05-45b4-89e4-a5727e9493c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:55.951515 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72954e2a-ab05-45b4-89e4-a5727e9493c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:55.952166 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72954e2a-ab05-45b4-89e4-a5727e9493c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:55.954412 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f02d3c-6018-40cf-9b06-2aaa6353f8fd None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:55.954918 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f02d3c-6018-40cf-9b06-2aaa6353f8fd None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:55.955031 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f02d3c-6018-40cf-9b06-2aaa6353f8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:55.964110 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72954e2a-ab05-45b4-89e4-a5727e9493c9 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:55.993520 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-e7f02d3c-6018-40cf-9b06-2aaa6353f8fd None None] MFA Rules not processed for user `e49e79b03a1744c1a9703b82c4933183`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:55.994770 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-e7f02d3c-6018-40cf-9b06-2aaa6353f8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:56.055121 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1298/2602] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:57:55 2022] POST /identity/v3/projects => generated 385 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:57:56.056274 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72954e2a-ab05-45b4-89e4-a5727e9493c9 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:56.071141 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1305/2603] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:55 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:56.130179 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72954e2a-ab05-45b4-89e4-a5727e9493c9 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:56.137801 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc22b0b-ed61-46e6-bf50-dcdefc702450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:56.138236 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc22b0b-ed61-46e6-bf50-dcdefc702450 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:56.138515 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc22b0b-ed61-46e6-bf50-dcdefc702450 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:56.138803 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc22b0b-ed61-46e6-bf50-dcdefc702450 admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:56.139450 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc22b0b-ed61-46e6-bf50-dcdefc702450 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:56.141933 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc22b0b-ed61-46e6-bf50-dcdefc702450 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:56.227869 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1299/2604] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:57:56 2022] POST /identity/v3/users => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:57:56.232485 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f02d3c-6018-40cf-9b06-2aaa6353f8fd None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:56.253451 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f02d3c-6018-40cf-9b06-2aaa6353f8fd None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:56.253451 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11534ca-4197-452e-99ef-ca5cb50bde2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:56.253451 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11534ca-4197-452e-99ef-ca5cb50bde2f admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:56.253451 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11534ca-4197-452e-99ef-ca5cb50bde2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:56.253808 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11534ca-4197-452e-99ef-ca5cb50bde2f admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:56.253808 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11534ca-4197-452e-99ef-ca5cb50bde2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:56.253808 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11534ca-4197-452e-99ef-ca5cb50bde2f admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:56.266659 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1306/2605] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:57:56.271716 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc22b0b-ed61-46e6-bf50-dcdefc702450 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:56.282155 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc22b0b-ed61-46e6-bf50-dcdefc702450 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:56.288012 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3a20e-f465-4624-8622-d9b6b5975352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:56.288690 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3a20e-f465-4624-8622-d9b6b5975352 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:56.288968 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3a20e-f465-4624-8622-d9b6b5975352 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:56.289395 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3a20e-f465-4624-8622-d9b6b5975352 admin admin] PATH_INFO: `/v3/projects/e470043d92b54005a3acf246b092eafa/users/42dae6b974584b1a8e19fb7183b0aad1/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:56.309226 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3a20e-f465-4624-8622-d9b6b5975352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e470043d92b54005a3acf246b092eafa, user_id=42dae6b974584b1a8e19fb7183b0aad1, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:56.309226 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3a20e-f465-4624-8622-d9b6b5975352 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:56.364148 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1300/2606] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:57:56 2022] PUT /identity/v3/projects/e470043d92b54005a3acf246b092eafa/users/42dae6b974584b1a8e19fb7183b0aad1/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:57:56.368245 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11534ca-4197-452e-99ef-ca5cb50bde2f admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:56.379024 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11534ca-4197-452e-99ef-ca5cb50bde2f admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:56.441113 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3406510-9c6b-494c-b940-a9361a61f137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:56.441906 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3406510-9c6b-494c-b940-a9361a61f137 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:56.442181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3406510-9c6b-494c-b940-a9361a61f137 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:56.442454 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3406510-9c6b-494c-b940-a9361a61f137 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:56.443093 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3406510-9c6b-494c-b940-a9361a61f137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:56.444693 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3406510-9c6b-494c-b940-a9361a61f137 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:56.455545 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1307/2607] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:57:56.460444 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3a20e-f465-4624-8622-d9b6b5975352 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:56.471100 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3a20e-f465-4624-8622-d9b6b5975352 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:56.475965 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d1092-b98b-442a-8534-511952c47b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:56.480229 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d1092-b98b-442a-8534-511952c47b8b admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:56.480229 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d1092-b98b-442a-8534-511952c47b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:56.480229 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d1092-b98b-442a-8534-511952c47b8b admin admin] PATH_INFO: `/v3/projects/e470043d92b54005a3acf246b092eafa/users/42dae6b974584b1a8e19fb7183b0aad1/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:56.480229 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d1092-b98b-442a-8534-511952c47b8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e470043d92b54005a3acf246b092eafa, user_id=42dae6b974584b1a8e19fb7183b0aad1, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:56.481775 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d1092-b98b-442a-8534-511952c47b8b admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:56.492693 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1301/2608] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:57:56 2022] PUT /identity/v3/projects/e470043d92b54005a3acf246b092eafa/users/42dae6b974584b1a8e19fb7183b0aad1/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:56.503508 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87be48-b590-4cef-b32f-7ce346e8b0ab None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:56.503742 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87be48-b590-4cef-b32f-7ce346e8b0ab None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:56.504056 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87be48-b590-4cef-b32f-7ce346e8b0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:56.532954 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-ae87be48-b590-4cef-b32f-7ce346e8b0ab None None] MFA Rules not processed for user `42dae6b974584b1a8e19fb7183b0aad1`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:56.534372 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-ae87be48-b590-4cef-b32f-7ce346e8b0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:56.582325 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:56.596157 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d1092-b98b-442a-8534-511952c47b8b admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:56.598410 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-b20d1092-b98b-442a-8534-511952c47b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:56.606211 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1308/2609] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:56 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:56.616878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87be48-b590-4cef-b32f-7ce346e8b0ab None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:56.618381 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-ae87be48-b590-4cef-b32f-7ce346e8b0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:56.679108 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87be48-b590-4cef-b32f-7ce346e8b0ab None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:56.681333 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d1092-b98b-442a-8534-511952c47b8b admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:56.682817 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7140e8e-c5a5-4021-b134-e065bdfd21ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:56.683426 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7140e8e-c5a5-4021-b134-e065bdfd21ae service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:56.683704 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7140e8e-c5a5-4021-b134-e065bdfd21ae service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:56.683983 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7140e8e-c5a5-4021-b134-e065bdfd21ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:56.686605 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab23203-594a-44cf-816f-04a043dc8f17 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68717c19e74e434da825d9b1d6ca202a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:56.687210 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab23203-594a-44cf-816f-04a043dc8f17 service placement] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:56.687492 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab23203-594a-44cf-816f-04a043dc8f17 service placement] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:56.687766 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab23203-594a-44cf-816f-04a043dc8f17 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:56.689545 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-5ab23203-594a-44cf-816f-04a043dc8f17 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:56.701735 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab23203-594a-44cf-816f-04a043dc8f17 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:56.703317 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab23203-594a-44cf-816f-04a043dc8f17 service placement] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:56.714351 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1302/2610] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:57:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:57:56.748332 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7140e8e-c5a5-4021-b134-e065bdfd21ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:56.749889 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7140e8e-c5a5-4021-b134-e065bdfd21ae service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:56.759522 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1309/2611] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:57:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:57:57.489635 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab23203-594a-44cf-816f-04a043dc8f17 service placement] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:57.494364 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-5ab23203-594a-44cf-816f-04a043dc8f17 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:57.510740 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:57.570050 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab23203-594a-44cf-816f-04a043dc8f17 service placement] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:57.574761 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88ac33-67b2-4b05-958a-86177dafd1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:57.575392 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88ac33-67b2-4b05-958a-86177dafd1cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:57.575675 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88ac33-67b2-4b05-958a-86177dafd1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:57.575952 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88ac33-67b2-4b05-958a-86177dafd1cd admin admin] PATH_INFO: `/v3/users/db33aea171c940d98841e1e6c53821eb` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:57.577100 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88ac33-67b2-4b05-958a-86177dafd1cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=db33aea171c940d98841e1e6c53821eb)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:57.579082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88ac33-67b2-4b05-958a-86177dafd1cd admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:57.782949 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-fd88ac33-67b2-4b05-958a-86177dafd1cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db33aea171c940d98841e1e6c53821eb'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:57.860171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-fd88ac33-67b2-4b05-958a-86177dafd1cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db33aea171c940d98841e1e6c53821eb'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:57.860800 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-fd88ac33-67b2-4b05-958a-86177dafd1cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db33aea171c940d98841e1e6c53821eb'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:57.861433 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-fd88ac33-67b2-4b05-958a-86177dafd1cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db33aea171c940d98841e1e6c53821eb'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:57.880007 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-fd88ac33-67b2-4b05-958a-86177dafd1cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db33aea171c940d98841e1e6c53821eb'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:57.888073 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1303/2612] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:57:57 2022] DELETE /identity/v3/users/db33aea171c940d98841e1e6c53821eb => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:58.126360 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7140e8e-c5a5-4021-b134-e065bdfd21ae service cinder] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:58.139224 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7140e8e-c5a5-4021-b134-e065bdfd21ae service cinder] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:58.203475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbae9d1-b903-4036-a31f-9d63b34d5c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:58.204096 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbae9d1-b903-4036-a31f-9d63b34d5c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:58.204370 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbae9d1-b903-4036-a31f-9d63b34d5c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:58.204637 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbae9d1-b903-4036-a31f-9d63b34d5c5f admin admin] PATH_INFO: `/v3/projects/880299ba4b2c4a88b16b12443eb65981` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:58.205800 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbae9d1-b903-4036-a31f-9d63b34d5c5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=880299ba4b2c4a88b16b12443eb65981)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:58.208905 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbae9d1-b903-4036-a31f-9d63b34d5c5f admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:58.362597 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:58.369633 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-9bbae9d1-b903-4036-a31f-9d63b34d5c5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '880299ba4b2c4a88b16b12443eb65981', 'request_id': 'req-9bbae9d1-b903-4036-a31f-9d63b34d5c5f'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:58.375231 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-9bbae9d1-b903-4036-a31f-9d63b34d5c5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '880299ba4b2c4a88b16b12443eb65981', 'request_id': 'req-9bbae9d1-b903-4036-a31f-9d63b34d5c5f'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:58.460165 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-9bbae9d1-b903-4036-a31f-9d63b34d5c5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '880299ba4b2c4a88b16b12443eb65981', 'request_id': 'req-9bbae9d1-b903-4036-a31f-9d63b34d5c5f'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:58.472443 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-9bbae9d1-b903-4036-a31f-9d63b34d5c5f admin admin] The token cache is being invalidate because project 880299ba4b2c4a88b16b12443eb65981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:57:58.473407 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-9bbae9d1-b903-4036-a31f-9d63b34d5c5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:58.474176 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-9bbae9d1-b903-4036-a31f-9d63b34d5c5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:58.475696 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1310/2613] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:57:58 2022] DELETE /identity/v3/projects/880299ba4b2c4a88b16b12443eb65981 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:58.479732 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88ac33-67b2-4b05-958a-86177dafd1cd admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:58.481208 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-fd88ac33-67b2-4b05-958a-86177dafd1cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:58.495561 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88ac33-67b2-4b05-958a-86177dafd1cd admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:58.555241 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3191a8e-7f3f-4f5e-bac4-b19b782576a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:58.555930 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3191a8e-7f3f-4f5e-bac4-b19b782576a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:58.556215 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3191a8e-7f3f-4f5e-bac4-b19b782576a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:58.556487 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3191a8e-7f3f-4f5e-bac4-b19b782576a0 admin admin] PATH_INFO: `/v3/users/e49e79b03a1744c1a9703b82c4933183` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:58.557655 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3191a8e-7f3f-4f5e-bac4-b19b782576a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e49e79b03a1744c1a9703b82c4933183)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:58.559542 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3191a8e-7f3f-4f5e-bac4-b19b782576a0 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:58.655450 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:57:58.782485 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-f3191a8e-7f3f-4f5e-bac4-b19b782576a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e49e79b03a1744c1a9703b82c4933183'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:58.850228 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-f3191a8e-7f3f-4f5e-bac4-b19b782576a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e49e79b03a1744c1a9703b82c4933183'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:58.851225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-f3191a8e-7f3f-4f5e-bac4-b19b782576a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e49e79b03a1744c1a9703b82c4933183'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:58.851917 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-f3191a8e-7f3f-4f5e-bac4-b19b782576a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e49e79b03a1744c1a9703b82c4933183'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:58.859428 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-f3191a8e-7f3f-4f5e-bac4-b19b782576a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e49e79b03a1744c1a9703b82c4933183'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:58.876796 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1304/2614] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:57:58 2022] DELETE /identity/v3/users/e49e79b03a1744c1a9703b82c4933183 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:59.118957 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbae9d1-b903-4036-a31f-9d63b34d5c5f admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:59.120410 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-9bbae9d1-b903-4036-a31f-9d63b34d5c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:59.141518 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbae9d1-b903-4036-a31f-9d63b34d5c5f admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:59.210889 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c6fb1-b844-46cf-bac5-a023f0069c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:59.211521 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c6fb1-b844-46cf-bac5-a023f0069c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:59.211801 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c6fb1-b844-46cf-bac5-a023f0069c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:59.212073 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c6fb1-b844-46cf-bac5-a023f0069c0b admin admin] PATH_INFO: `/v3/projects/9838c2ea426b425787de3949a65c2bd9` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:59.213292 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c6fb1-b844-46cf-bac5-a023f0069c0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9838c2ea426b425787de3949a65c2bd9)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:59.215462 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c6fb1-b844-46cf-bac5-a023f0069c0b admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:59.306867 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-db4c6fb1-b844-46cf-bac5-a023f0069c0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9838c2ea426b425787de3949a65c2bd9', 'request_id': 'req-db4c6fb1-b844-46cf-bac5-a023f0069c0b'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:59.312547 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-db4c6fb1-b844-46cf-bac5-a023f0069c0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9838c2ea426b425787de3949a65c2bd9', 'request_id': 'req-db4c6fb1-b844-46cf-bac5-a023f0069c0b'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:59.362702 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-db4c6fb1-b844-46cf-bac5-a023f0069c0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9838c2ea426b425787de3949a65c2bd9', 'request_id': 'req-db4c6fb1-b844-46cf-bac5-a023f0069c0b'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:59.375596 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-db4c6fb1-b844-46cf-bac5-a023f0069c0b admin admin] The token cache is being invalidate because project 9838c2ea426b425787de3949a65c2bd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:57:59.375884 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-db4c6fb1-b844-46cf-bac5-a023f0069c0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:59.376513 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-db4c6fb1-b844-46cf-bac5-a023f0069c0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:57:59.378131 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1311/2615] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:57:59 2022] DELETE /identity/v3/projects/9838c2ea426b425787de3949a65c2bd9 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:57:59.384143 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acff52d-66e3-4f74-b7b5-66bf794c55b5 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:59.384433 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acff52d-66e3-4f74-b7b5-66bf794c55b5 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:59.384711 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acff52d-66e3-4f74-b7b5-66bf794c55b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:59.404275 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-2acff52d-66e3-4f74-b7b5-66bf794c55b5 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:59.405450 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-2acff52d-66e3-4f74-b7b5-66bf794c55b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:59.466694 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1305/2616] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:57:59.475572 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e978f-c713-4f1f-9f1a-b3d7a3794c29 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:59.475851 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e978f-c713-4f1f-9f1a-b3d7a3794c29 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:59.476127 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e978f-c713-4f1f-9f1a-b3d7a3794c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:59.495975 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-2f8e978f-c713-4f1f-9f1a-b3d7a3794c29 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:57:59.497197 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-2f8e978f-c713-4f1f-9f1a-b3d7a3794c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:57:59.505986 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1312/2617] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:57:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:57:59.510243 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acff52d-66e3-4f74-b7b5-66bf794c55b5 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:59.520268 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acff52d-66e3-4f74-b7b5-66bf794c55b5 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:59.524924 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b53e02-10ca-4655-ad82-c36729aa9687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:59.525548 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b53e02-10ca-4655-ad82-c36729aa9687 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:59.525827 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b53e02-10ca-4655-ad82-c36729aa9687 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:59.526098 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b53e02-10ca-4655-ad82-c36729aa9687 admin admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:59.526745 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b53e02-10ca-4655-ad82-c36729aa9687 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:57:59.527048 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b53e02-10ca-4655-ad82-c36729aa9687 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:59.528637 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b53e02-10ca-4655-ad82-c36729aa9687 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:59.540201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1306/2618] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:57:59.544533 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e978f-c713-4f1f-9f1a-b3d7a3794c29 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:59.554457 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e978f-c713-4f1f-9f1a-b3d7a3794c29 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:59.559096 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b0fb3-d62e-4767-9377-1199e71968ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:59.559682 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b0fb3-d62e-4767-9377-1199e71968ec admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:59.559960 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b0fb3-d62e-4767-9377-1199e71968ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:59.560231 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b0fb3-d62e-4767-9377-1199e71968ec admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:59.560989 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b0fb3-d62e-4767-9377-1199e71968ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:59.563014 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b0fb3-d62e-4767-9377-1199e71968ec admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:59.661644 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1313/2619] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:57:59 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:57:59.666215 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b53e02-10ca-4655-ad82-c36729aa9687 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:59.676968 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b53e02-10ca-4655-ad82-c36729aa9687 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:59.732964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a047aa-e874-47c6-9935-e59f1fb6ca2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:59.733607 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a047aa-e874-47c6-9935-e59f1fb6ca2f admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:59.734003 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a047aa-e874-47c6-9935-e59f1fb6ca2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:59.734280 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a047aa-e874-47c6-9935-e59f1fb6ca2f admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:59.734920 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a047aa-e874-47c6-9935-e59f1fb6ca2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:59.736956 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a047aa-e874-47c6-9935-e59f1fb6ca2f admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:59.820070 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1307/2620] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:57:59 2022] POST /identity/v3/users => generated 291 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:57:59.824461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b0fb3-d62e-4767-9377-1199e71968ec admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:59.835226 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b0fb3-d62e-4767-9377-1199e71968ec admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:59.839765 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8d69f-a888-4142-90c0-0312111ba44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:59.840597 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8d69f-a888-4142-90c0-0312111ba44e admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:59.840877 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8d69f-a888-4142-90c0-0312111ba44e admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:59.841237 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8d69f-a888-4142-90c0-0312111ba44e admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:59.841869 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8d69f-a888-4142-90c0-0312111ba44e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:59.843434 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8d69f-a888-4142-90c0-0312111ba44e admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:59.854182 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1314/2621] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:57:59.858184 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a047aa-e874-47c6-9935-e59f1fb6ca2f admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:59.869124 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a047aa-e874-47c6-9935-e59f1fb6ca2f admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:59.873750 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99ed00-befd-41fc-aba6-3ffb854b9305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:59.874328 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99ed00-befd-41fc-aba6-3ffb854b9305 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:59.874605 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99ed00-befd-41fc-aba6-3ffb854b9305 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:59.874871 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99ed00-befd-41fc-aba6-3ffb854b9305 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:59.875498 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99ed00-befd-41fc-aba6-3ffb854b9305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:59.877133 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99ed00-befd-41fc-aba6-3ffb854b9305 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:59.888007 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1308/2622] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:57:59.892185 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8d69f-a888-4142-90c0-0312111ba44e admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:57:59.902139 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8d69f-a888-4142-90c0-0312111ba44e admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:57:59.906769 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475377a-1594-43f5-b7d2-cca5f135bf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:57:59.907399 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475377a-1594-43f5-b7d2-cca5f135bf6b admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:57:59.907698 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475377a-1594-43f5-b7d2-cca5f135bf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:57:59.907960 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475377a-1594-43f5-b7d2-cca5f135bf6b admin admin] PATH_INFO: `/v3/projects/b925ca5657e047f1908b5390eaed5c38/users/2ea178f7b3594564b56b22ae0d7381ef/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:57:59.922984 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475377a-1594-43f5-b7d2-cca5f135bf6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b925ca5657e047f1908b5390eaed5c38, user_id=2ea178f7b3594564b56b22ae0d7381ef, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:57:59.925602 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475377a-1594-43f5-b7d2-cca5f135bf6b admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:57:59.929246 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:00.043562 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1315/2623] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:57:59 2022] PUT /identity/v3/projects/b925ca5657e047f1908b5390eaed5c38/users/2ea178f7b3594564b56b22ae0d7381ef/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:00.054455 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cea5c-571b-4909-bdb7-86554ef01c3b None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:00.054747 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cea5c-571b-4909-bdb7-86554ef01c3b None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:00.055023 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cea5c-571b-4909-bdb7-86554ef01c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:00.074738 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:00.084160 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-b50cea5c-571b-4909-bdb7-86554ef01c3b None None] MFA Rules not processed for user `2ea178f7b3594564b56b22ae0d7381ef`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:00.085418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-b50cea5c-571b-4909-bdb7-86554ef01c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:00.151705 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1309/2624] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:58:00.156485 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475377a-1594-43f5-b7d2-cca5f135bf6b admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:00.218230 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475377a-1594-43f5-b7d2-cca5f135bf6b admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:00.222976 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae2eba-19c4-48e6-b8ef-0ba434e3a142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:00.224187 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae2eba-19c4-48e6-b8ef-0ba434e3a142 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:00.224605 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae2eba-19c4-48e6-b8ef-0ba434e3a142 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:00.224895 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae2eba-19c4-48e6-b8ef-0ba434e3a142 admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:00.225549 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae2eba-19c4-48e6-b8ef-0ba434e3a142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:00.227448 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae2eba-19c4-48e6-b8ef-0ba434e3a142 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:00.332845 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1316/2625] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:58:00 2022] POST /identity/v3/projects => generated 381 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:58:00.336213 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cea5c-571b-4909-bdb7-86554ef01c3b None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:00.347755 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cea5c-571b-4909-bdb7-86554ef01c3b None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:00.417507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae190bdf-5999-47bd-92bc-9a1b7ed37cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:00.418126 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae190bdf-5999-47bd-92bc-9a1b7ed37cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:00.418409 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae190bdf-5999-47bd-92bc-9a1b7ed37cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:00.418681 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae190bdf-5999-47bd-92bc-9a1b7ed37cc4 admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:00.419321 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae190bdf-5999-47bd-92bc-9a1b7ed37cc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:00.421254 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae190bdf-5999-47bd-92bc-9a1b7ed37cc4 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:00.529332 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1310/2626] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:58:00 2022] POST /identity/v3/users => generated 297 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:58:00.533433 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae2eba-19c4-48e6-b8ef-0ba434e3a142 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:00.544839 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae2eba-19c4-48e6-b8ef-0ba434e3a142 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:00.549519 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed77a6-6f96-4200-ba38-69cddae8c252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:00.550193 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed77a6-6f96-4200-ba38-69cddae8c252 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:00.550455 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed77a6-6f96-4200-ba38-69cddae8c252 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:00.550733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed77a6-6f96-4200-ba38-69cddae8c252 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:00.552518 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed77a6-6f96-4200-ba38-69cddae8c252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:00.554149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed77a6-6f96-4200-ba38-69cddae8c252 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:00.565507 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1317/2627] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:58:00.569605 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae190bdf-5999-47bd-92bc-9a1b7ed37cc4 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:00.579721 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae190bdf-5999-47bd-92bc-9a1b7ed37cc4 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:00.585176 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb8d92-51b7-45ac-a33b-8b4501220496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:00.589447 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb8d92-51b7-45ac-a33b-8b4501220496 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:00.589447 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb8d92-51b7-45ac-a33b-8b4501220496 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:00.589447 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb8d92-51b7-45ac-a33b-8b4501220496 admin admin] PATH_INFO: `/v3/projects/070fd92e541040e1910ccea8caf3214a/users/e8faac3e5034402b8a06b974f36b1233/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:00.601997 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb8d92-51b7-45ac-a33b-8b4501220496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=070fd92e541040e1910ccea8caf3214a, user_id=e8faac3e5034402b8a06b974f36b1233, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:00.604582 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb8d92-51b7-45ac-a33b-8b4501220496 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:00.688843 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1311/2628] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:58:00 2022] PUT /identity/v3/projects/070fd92e541040e1910ccea8caf3214a/users/e8faac3e5034402b8a06b974f36b1233/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:58:00.693547 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed77a6-6f96-4200-ba38-69cddae8c252 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:00.703533 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed77a6-6f96-4200-ba38-69cddae8c252 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:00.768478 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7838e-1bbd-46f9-9d7c-43d203e2a3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:00.769196 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7838e-1bbd-46f9-9d7c-43d203e2a3ba admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:00.769700 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7838e-1bbd-46f9-9d7c-43d203e2a3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:00.769815 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7838e-1bbd-46f9-9d7c-43d203e2a3ba admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:00.771258 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7838e-1bbd-46f9-9d7c-43d203e2a3ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:00.772889 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7838e-1bbd-46f9-9d7c-43d203e2a3ba admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:00.782925 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1318/2629] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:58:00.788546 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb8d92-51b7-45ac-a33b-8b4501220496 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:00.799340 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb8d92-51b7-45ac-a33b-8b4501220496 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:00.804518 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10751fba-881e-4972-9a93-2c5deaede0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:00.805306 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10751fba-881e-4972-9a93-2c5deaede0a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:00.809340 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10751fba-881e-4972-9a93-2c5deaede0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:00.809340 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10751fba-881e-4972-9a93-2c5deaede0a2 admin admin] PATH_INFO: `/v3/projects/070fd92e541040e1910ccea8caf3214a/users/e8faac3e5034402b8a06b974f36b1233/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:00.809340 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10751fba-881e-4972-9a93-2c5deaede0a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=070fd92e541040e1910ccea8caf3214a, user_id=e8faac3e5034402b8a06b974f36b1233, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:00.810505 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10751fba-881e-4972-9a93-2c5deaede0a2 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:00.821628 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1312/2630] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:58:00 2022] PUT /identity/v3/projects/070fd92e541040e1910ccea8caf3214a/users/e8faac3e5034402b8a06b974f36b1233/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:00.831969 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f855d-c7fa-4be1-8d30-6973a6e66e1a None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:00.832256 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f855d-c7fa-4be1-8d30-6973a6e66e1a None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:00.833214 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f855d-c7fa-4be1-8d30-6973a6e66e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:00.864676 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-1c8f855d-c7fa-4be1-8d30-6973a6e66e1a None None] MFA Rules not processed for user `e8faac3e5034402b8a06b974f36b1233`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:00.864996 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-1c8f855d-c7fa-4be1-8d30-6973a6e66e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:00.921929 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:00.939566 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1319/2631] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:00 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:00.951740 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10751fba-881e-4972-9a93-2c5deaede0a2 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:00.954942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-10751fba-881e-4972-9a93-2c5deaede0a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:01.015053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10751fba-881e-4972-9a93-2c5deaede0a2 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:01.018816 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aac1bd-b43a-4694-82c9-a6abe6838190 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:01.019583 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aac1bd-b43a-4694-82c9-a6abe6838190 service cinder] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:01.019872 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aac1bd-b43a-4694-82c9-a6abe6838190 service cinder] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:01.020664 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aac1bd-b43a-4694-82c9-a6abe6838190 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:01.026902 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:01.030645 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aac1bd-b43a-4694-82c9-a6abe6838190 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:01.035240 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aac1bd-b43a-4694-82c9-a6abe6838190 service cinder] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:01.042288 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1313/2632] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:58:00 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:58:01.325508 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f855d-c7fa-4be1-8d30-6973a6e66e1a None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:01.335502 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f855d-c7fa-4be1-8d30-6973a6e66e1a None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:01.339233 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d0e5a-c51f-456a-b3e5-53d8c54972a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:01.341567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d0e5a-c51f-456a-b3e5-53d8c54972a8 service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:01.341567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d0e5a-c51f-456a-b3e5-53d8c54972a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:01.341567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d0e5a-c51f-456a-b3e5-53d8c54972a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:01.396861 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d0e5a-c51f-456a-b3e5-53d8c54972a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:01.398389 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d0e5a-c51f-456a-b3e5-53d8c54972a8 service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:01.407449 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1320/2633] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:58:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:58:02.017750 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aac1bd-b43a-4694-82c9-a6abe6838190 service cinder] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:02.026923 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aac1bd-b43a-4694-82c9-a6abe6838190 service cinder] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:02.030498 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7f371-c00f-4fa3-b61f-19d0476d8e2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:02.031066 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7f371-c00f-4fa3-b61f-19d0476d8e2d service cinder] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:02.031511 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7f371-c00f-4fa3-b61f-19d0476d8e2d service cinder] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:02.031788 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7f371-c00f-4fa3-b61f-19d0476d8e2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:02.033548 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-c8f7f371-c00f-4fa3-b61f-19d0476d8e2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:02.100958 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7f371-c00f-4fa3-b61f-19d0476d8e2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:02.102427 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7f371-c00f-4fa3-b61f-19d0476d8e2d service cinder] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:02.112041 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1314/2634] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:58:02 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:58:08.219148 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d0e5a-c51f-456a-b3e5-53d8c54972a8 service cinder] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:08.220604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-f28d0e5a-c51f-456a-b3e5-53d8c54972a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:08.286823 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d0e5a-c51f-456a-b3e5-53d8c54972a8 service cinder] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:08.291577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586e37c-e5b2-451c-b9e8-d4c58c23186a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:08.292200 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586e37c-e5b2-451c-b9e8-d4c58c23186a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:08.292482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586e37c-e5b2-451c-b9e8-d4c58c23186a admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:08.292958 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586e37c-e5b2-451c-b9e8-d4c58c23186a admin admin] PATH_INFO: `/v3/users/eeba411838e041b89d655651a8ab7db2` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:08.293917 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586e37c-e5b2-451c-b9e8-d4c58c23186a admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeba411838e041b89d655651a8ab7db2)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:08.295830 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586e37c-e5b2-451c-b9e8-d4c58c23186a admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:08.555164 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-e586e37c-e5b2-451c-b9e8-d4c58c23186a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeba411838e041b89d655651a8ab7db2'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:08.619798 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-e586e37c-e5b2-451c-b9e8-d4c58c23186a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeba411838e041b89d655651a8ab7db2'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:08.620493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-e586e37c-e5b2-451c-b9e8-d4c58c23186a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeba411838e041b89d655651a8ab7db2'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:08.621086 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-e586e37c-e5b2-451c-b9e8-d4c58c23186a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeba411838e041b89d655651a8ab7db2'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:08.630469 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-e586e37c-e5b2-451c-b9e8-d4c58c23186a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeba411838e041b89d655651a8ab7db2'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:08.656311 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1321/2635] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:58:08 2022] DELETE /identity/v3/users/eeba411838e041b89d655651a8ab7db2 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:08.661815 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa6066-97ea-4f7b-bf16-ebcb43049293 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:08.662317 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa6066-97ea-4f7b-bf16-ebcb43049293 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:08.662563 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa6066-97ea-4f7b-bf16-ebcb43049293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:08.682813 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-0aaa6066-97ea-4f7b-bf16-ebcb43049293 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:08.687010 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-0aaa6066-97ea-4f7b-bf16-ebcb43049293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:08.745411 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1315/2636] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:08.755642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586e37c-e5b2-451c-b9e8-d4c58c23186a admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:08.757084 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-e586e37c-e5b2-451c-b9e8-d4c58c23186a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:08.768147 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:08.818365 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586e37c-e5b2-451c-b9e8-d4c58c23186a admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:08.822041 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcfbd67-2965-40aa-99e6-c4456273311d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:08.822637 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfbd67-2965-40aa-99e6-c4456273311d service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:08.822908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfbd67-2965-40aa-99e6-c4456273311d service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:08.823176 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfbd67-2965-40aa-99e6-c4456273311d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:08.832525 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcfbd67-2965-40aa-99e6-c4456273311d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:08.833967 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcfbd67-2965-40aa-99e6-c4456273311d service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:08.845839 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1322/2637] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:58:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:58:08.952801 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa6066-97ea-4f7b-bf16-ebcb43049293 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:08.954393 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-0aaa6066-97ea-4f7b-bf16-ebcb43049293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:08.968776 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa6066-97ea-4f7b-bf16-ebcb43049293 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:08.973529 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8582c-39ed-4105-a70b-4506f49e245e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:08.974248 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8582c-39ed-4105-a70b-4506f49e245e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:08.974527 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8582c-39ed-4105-a70b-4506f49e245e admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:08.974795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8582c-39ed-4105-a70b-4506f49e245e admin admin] PATH_INFO: `/v3/users/5fbb94b57e8a4d3c83a4cab9598a5a1f` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:08.975918 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8582c-39ed-4105-a70b-4506f49e245e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fbb94b57e8a4d3c83a4cab9598a5a1f)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:08.978655 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8582c-39ed-4105-a70b-4506f49e245e admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:09.151355 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-33f8582c-39ed-4105-a70b-4506f49e245e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fbb94b57e8a4d3c83a4cab9598a5a1f'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:09.237358 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-33f8582c-39ed-4105-a70b-4506f49e245e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fbb94b57e8a4d3c83a4cab9598a5a1f'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:09.237994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-33f8582c-39ed-4105-a70b-4506f49e245e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fbb94b57e8a4d3c83a4cab9598a5a1f'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:09.238645 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-33f8582c-39ed-4105-a70b-4506f49e245e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fbb94b57e8a4d3c83a4cab9598a5a1f'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:09.244870 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcfbd67-2965-40aa-99e6-c4456273311d service neutron] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:09.246466 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-6bcfbd67-2965-40aa-99e6-c4456273311d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:09.251089 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-33f8582c-39ed-4105-a70b-4506f49e245e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fbb94b57e8a4d3c83a4cab9598a5a1f'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:09.259529 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcfbd67-2965-40aa-99e6-c4456273311d service neutron] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:09.264683 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b3df9-3548-4420-b199-041d75f5968d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:09.265335 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b3df9-3548-4420-b199-041d75f5968d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:09.265940 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b3df9-3548-4420-b199-041d75f5968d admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:09.266210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b3df9-3548-4420-b199-041d75f5968d admin admin] PATH_INFO: `/v3/projects/3d452ab42bd149a4bd62624530b29442` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:09.267511 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b3df9-3548-4420-b199-041d75f5968d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d452ab42bd149a4bd62624530b29442)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:09.269505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b3df9-3548-4420-b199-041d75f5968d admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:09.269949 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:09.275777 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1316/2638] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:58:08 2022] DELETE /identity/v3/users/5fbb94b57e8a4d3c83a4cab9598a5a1f => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:09.279808 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ce81a-cb38-482e-bb8f-d0ef6eaad28a None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:09.280155 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ce81a-cb38-482e-bb8f-d0ef6eaad28a None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:09.280582 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ce81a-cb38-482e-bb8f-d0ef6eaad28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:09.305199 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-ef3ce81a-cb38-482e-bb8f-d0ef6eaad28a None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:09.306447 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-ef3ce81a-cb38-482e-bb8f-d0ef6eaad28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:09.365577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1317/2639] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:58:09.375468 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ce81a-cb38-482e-bb8f-d0ef6eaad28a None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:09.377351 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-ef3ce81a-cb38-482e-bb8f-d0ef6eaad28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:09.394354 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-fa7b3df9-3548-4420-b199-041d75f5968d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d452ab42bd149a4bd62624530b29442', 'request_id': 'req-fa7b3df9-3548-4420-b199-041d75f5968d'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:09.401273 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-fa7b3df9-3548-4420-b199-041d75f5968d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d452ab42bd149a4bd62624530b29442', 'request_id': 'req-fa7b3df9-3548-4420-b199-041d75f5968d'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:09.436871 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ce81a-cb38-482e-bb8f-d0ef6eaad28a None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:09.476916 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-fa7b3df9-3548-4420-b199-041d75f5968d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d452ab42bd149a4bd62624530b29442', 'request_id': 'req-fa7b3df9-3548-4420-b199-041d75f5968d'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:09.485993 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf92b8-f7ed-42ac-a4eb-b39b44f11364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:09.486622 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf92b8-f7ed-42ac-a4eb-b39b44f11364 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:09.486911 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf92b8-f7ed-42ac-a4eb-b39b44f11364 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:09.487319 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf92b8-f7ed-42ac-a4eb-b39b44f11364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:09.492317 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-fa7b3df9-3548-4420-b199-041d75f5968d admin admin] The token cache is being invalidate because project 3d452ab42bd149a4bd62624530b29442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:58:09.493705 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-fa7b3df9-3548-4420-b199-041d75f5968d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:09.493705 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-fa7b3df9-3548-4420-b199-041d75f5968d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:09.497526 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1323/2640] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:58:09 2022] DELETE /identity/v3/projects/3d452ab42bd149a4bd62624530b29442 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:58:09.501535 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b3df9-3548-4420-b199-041d75f5968d admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:09.503802 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-fa7b3df9-3548-4420-b199-041d75f5968d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:09.558619 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf92b8-f7ed-42ac-a4eb-b39b44f11364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:09.560378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf92b8-f7ed-42ac-a4eb-b39b44f11364 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:09.571212 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1318/2641] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:58:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:58:09.571785 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b3df9-3548-4420-b199-041d75f5968d admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:09.576662 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef70899-1640-43f5-95df-df4cc3ba1d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:09.577588 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef70899-1640-43f5-95df-df4cc3ba1d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:09.577588 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef70899-1640-43f5-95df-df4cc3ba1d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:09.577881 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef70899-1640-43f5-95df-df4cc3ba1d29 admin admin] PATH_INFO: `/v3/users/42dae6b974584b1a8e19fb7183b0aad1` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:09.579086 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef70899-1640-43f5-95df-df4cc3ba1d29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42dae6b974584b1a8e19fb7183b0aad1)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:09.581012 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef70899-1640-43f5-95df-df4cc3ba1d29 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:09.768168 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:09.776927 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-bef70899-1640-43f5-95df-df4cc3ba1d29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42dae6b974584b1a8e19fb7183b0aad1'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:09.877055 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-bef70899-1640-43f5-95df-df4cc3ba1d29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42dae6b974584b1a8e19fb7183b0aad1'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:09.877722 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-bef70899-1640-43f5-95df-df4cc3ba1d29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42dae6b974584b1a8e19fb7183b0aad1'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:09.878362 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-bef70899-1640-43f5-95df-df4cc3ba1d29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42dae6b974584b1a8e19fb7183b0aad1'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:09.886788 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-bef70899-1640-43f5-95df-df4cc3ba1d29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42dae6b974584b1a8e19fb7183b0aad1'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:09.903837 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1324/2642] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:58:09 2022] DELETE /identity/v3/users/42dae6b974584b1a8e19fb7183b0aad1 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:58:09.987547 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf92b8-f7ed-42ac-a4eb-b39b44f11364 service neutron] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:09.989237 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-31bf92b8-f7ed-42ac-a4eb-b39b44f11364 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:10.010538 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf92b8-f7ed-42ac-a4eb-b39b44f11364 service neutron] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:10.073277 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:10.086971 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055e0e9-945b-47e9-bbaf-1c27049c8976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:10.090404 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055e0e9-945b-47e9-bbaf-1c27049c8976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:10.090404 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055e0e9-945b-47e9-bbaf-1c27049c8976 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:10.090404 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055e0e9-945b-47e9-bbaf-1c27049c8976 admin admin] PATH_INFO: `/v3/projects/00ca3c24e4d246c3872c2ef62784bf98` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:10.090404 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e055e0e9-945b-47e9-bbaf-1c27049c8976 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00ca3c24e4d246c3872c2ef62784bf98)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:10.091547 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e055e0e9-945b-47e9-bbaf-1c27049c8976 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:10.204873 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e055e0e9-945b-47e9-bbaf-1c27049c8976 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00ca3c24e4d246c3872c2ef62784bf98', 'request_id': 'req-e055e0e9-945b-47e9-bbaf-1c27049c8976'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:10.212413 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e055e0e9-945b-47e9-bbaf-1c27049c8976 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00ca3c24e4d246c3872c2ef62784bf98', 'request_id': 'req-e055e0e9-945b-47e9-bbaf-1c27049c8976'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:10.294267 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e055e0e9-945b-47e9-bbaf-1c27049c8976 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00ca3c24e4d246c3872c2ef62784bf98', 'request_id': 'req-e055e0e9-945b-47e9-bbaf-1c27049c8976'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:10.304041 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef70899-1640-43f5-95df-df4cc3ba1d29 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:10.308654 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-bef70899-1640-43f5-95df-df4cc3ba1d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:10.309249 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e055e0e9-945b-47e9-bbaf-1c27049c8976 admin admin] The token cache is being invalidate because project 00ca3c24e4d246c3872c2ef62784bf98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:58:10.309626 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e055e0e9-945b-47e9-bbaf-1c27049c8976 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:10.310251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e055e0e9-945b-47e9-bbaf-1c27049c8976 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:10.312048 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1319/2643] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:58:09 2022] DELETE /identity/v3/projects/00ca3c24e4d246c3872c2ef62784bf98 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:10.315882 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055e0e9-945b-47e9-bbaf-1c27049c8976 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:10.317383 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-e055e0e9-945b-47e9-bbaf-1c27049c8976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:10.322524 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef70899-1640-43f5-95df-df4cc3ba1d29 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:10.381136 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36151eb7-dde9-497f-b6aa-922a784d2152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:10.381628 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36151eb7-dde9-497f-b6aa-922a784d2152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:10.381917 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36151eb7-dde9-497f-b6aa-922a784d2152 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:10.382196 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36151eb7-dde9-497f-b6aa-922a784d2152 admin admin] PATH_INFO: `/v3/users/2ea178f7b3594564b56b22ae0d7381ef` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:10.383631 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36151eb7-dde9-497f-b6aa-922a784d2152 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ea178f7b3594564b56b22ae0d7381ef)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:10.384956 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055e0e9-945b-47e9-bbaf-1c27049c8976 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:10.385748 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36151eb7-dde9-497f-b6aa-922a784d2152 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:10.390202 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa4409-f411-4f19-9449-c2860b26eb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:10.390833 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa4409-f411-4f19-9449-c2860b26eb36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:10.391124 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa4409-f411-4f19-9449-c2860b26eb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:10.391381 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa4409-f411-4f19-9449-c2860b26eb36 admin admin] PATH_INFO: `/v3/users/2e3c32db9cd5491fbc3c793c50953d3e` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:10.392583 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa4409-f411-4f19-9449-c2860b26eb36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e3c32db9cd5491fbc3c793c50953d3e)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:10.394583 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa4409-f411-4f19-9449-c2860b26eb36 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:10.600635 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-36151eb7-dde9-497f-b6aa-922a784d2152 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ea178f7b3594564b56b22ae0d7381ef'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:10.681329 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:10.683827 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-36151eb7-dde9-497f-b6aa-922a784d2152 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ea178f7b3594564b56b22ae0d7381ef'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:10.684637 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-36151eb7-dde9-497f-b6aa-922a784d2152 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ea178f7b3594564b56b22ae0d7381ef'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:10.685472 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-36151eb7-dde9-497f-b6aa-922a784d2152 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ea178f7b3594564b56b22ae0d7381ef'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:10.687732 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-a1fa4409-f411-4f19-9449-c2860b26eb36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e3c32db9cd5491fbc3c793c50953d3e'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:10.693842 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-36151eb7-dde9-497f-b6aa-922a784d2152 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ea178f7b3594564b56b22ae0d7381ef'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:10.712577 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1325/2644] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:58:10 2022] DELETE /identity/v3/users/2ea178f7b3594564b56b22ae0d7381ef => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:10.713713 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36151eb7-dde9-497f-b6aa-922a784d2152 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:10.715368 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-36151eb7-dde9-497f-b6aa-922a784d2152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:10.754178 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:10.768266 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-a1fa4409-f411-4f19-9449-c2860b26eb36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e3c32db9cd5491fbc3c793c50953d3e'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:10.768898 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-a1fa4409-f411-4f19-9449-c2860b26eb36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e3c32db9cd5491fbc3c793c50953d3e'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:10.769765 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-a1fa4409-f411-4f19-9449-c2860b26eb36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e3c32db9cd5491fbc3c793c50953d3e'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:10.778737 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-a1fa4409-f411-4f19-9449-c2860b26eb36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e3c32db9cd5491fbc3c793c50953d3e'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:10.791094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36151eb7-dde9-497f-b6aa-922a784d2152 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:10.795851 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae0ac0-c656-4a52-860b-8fbaf2fa13b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:10.796476 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae0ac0-c656-4a52-860b-8fbaf2fa13b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:10.796818 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae0ac0-c656-4a52-860b-8fbaf2fa13b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:10.797232 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae0ac0-c656-4a52-860b-8fbaf2fa13b6 admin admin] PATH_INFO: `/v3/projects/e470043d92b54005a3acf246b092eafa` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:10.798178 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1320/2645] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:58:10 2022] DELETE /identity/v3/users/2e3c32db9cd5491fbc3c793c50953d3e => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:10.799571 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec65e8-8b85-42ba-91eb-d468f85e25b4 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:10.800988 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec65e8-8b85-42ba-91eb-d468f85e25b4 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:10.800988 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec65e8-8b85-42ba-91eb-d468f85e25b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:10.802280 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae0ac0-c656-4a52-860b-8fbaf2fa13b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e470043d92b54005a3acf246b092eafa)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:10.811313 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae0ac0-c656-4a52-860b-8fbaf2fa13b6 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:10.821445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-f1ec65e8-8b85-42ba-91eb-d468f85e25b4 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:10.822455 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-f1ec65e8-8b85-42ba-91eb-d468f85e25b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:10.896263 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1321/2646] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:10.910230 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec65e8-8b85-42ba-91eb-d468f85e25b4 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:10.911667 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-f1ec65e8-8b85-42ba-91eb-d468f85e25b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:10.958319 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-97ae0ac0-c656-4a52-860b-8fbaf2fa13b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e470043d92b54005a3acf246b092eafa', 'request_id': 'req-97ae0ac0-c656-4a52-860b-8fbaf2fa13b6'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:10.967438 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-97ae0ac0-c656-4a52-860b-8fbaf2fa13b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e470043d92b54005a3acf246b092eafa', 'request_id': 'req-97ae0ac0-c656-4a52-860b-8fbaf2fa13b6'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:10.977545 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec65e8-8b85-42ba-91eb-d468f85e25b4 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:11.031154 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697ded3-36b5-4592-a440-e6173b3046a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:11.033133 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697ded3-36b5-4592-a440-e6173b3046a7 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:11.033427 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697ded3-36b5-4592-a440-e6173b3046a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:11.033710 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697ded3-36b5-4592-a440-e6173b3046a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:11.059911 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-97ae0ac0-c656-4a52-860b-8fbaf2fa13b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e470043d92b54005a3acf246b092eafa', 'request_id': 'req-97ae0ac0-c656-4a52-860b-8fbaf2fa13b6'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:11.062617 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:11.080475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-97ae0ac0-c656-4a52-860b-8fbaf2fa13b6 admin admin] The token cache is being invalidate because project e470043d92b54005a3acf246b092eafa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:58:11.080775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-97ae0ac0-c656-4a52-860b-8fbaf2fa13b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:11.082499 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-97ae0ac0-c656-4a52-860b-8fbaf2fa13b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:11.084815 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1326/2647] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:58:10 2022] DELETE /identity/v3/projects/e470043d92b54005a3acf246b092eafa => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:11.092064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e30ba-68de-4037-bfcd-73328b378da6 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:11.092352 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e30ba-68de-4037-bfcd-73328b378da6 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:11.092622 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e30ba-68de-4037-bfcd-73328b378da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:11.111489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697ded3-36b5-4592-a440-e6173b3046a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:11.112974 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697ded3-36b5-4592-a440-e6173b3046a7 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:11.114749 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-491e30ba-68de-4037-bfcd-73328b378da6 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:11.115969 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-491e30ba-68de-4037-bfcd-73328b378da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:11.124225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1322/2648] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:58:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:58:11.125934 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1327/2649] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:11.134872 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37677a0c-ca49-4553-954b-1d1bc9ed4ff8 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:11.139106 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37677a0c-ca49-4553-954b-1d1bc9ed4ff8 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:11.139106 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37677a0c-ca49-4553-954b-1d1bc9ed4ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:11.158414 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-37677a0c-ca49-4553-954b-1d1bc9ed4ff8 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:11.161925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-37677a0c-ca49-4553-954b-1d1bc9ed4ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:11.170980 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1323/2650] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:11.175507 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e30ba-68de-4037-bfcd-73328b378da6 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:11.186292 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e30ba-68de-4037-bfcd-73328b378da6 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:11.195807 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec04dcb-a88f-4303-8eca-65fe7b5a2692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:11.195807 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec04dcb-a88f-4303-8eca-65fe7b5a2692 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:11.195807 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec04dcb-a88f-4303-8eca-65fe7b5a2692 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:11.195807 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec04dcb-a88f-4303-8eca-65fe7b5a2692 admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:11.196397 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec04dcb-a88f-4303-8eca-65fe7b5a2692 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:58:11.196397 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec04dcb-a88f-4303-8eca-65fe7b5a2692 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:11.196397 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec04dcb-a88f-4303-8eca-65fe7b5a2692 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:11.209060 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1328/2651] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:58:11.214807 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37677a0c-ca49-4553-954b-1d1bc9ed4ff8 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:11.226045 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37677a0c-ca49-4553-954b-1d1bc9ed4ff8 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:11.231701 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1260ea3-1d7c-4c71-8daf-401b6932241a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:11.232304 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1260ea3-1d7c-4c71-8daf-401b6932241a admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:11.232581 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1260ea3-1d7c-4c71-8daf-401b6932241a admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:11.232874 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1260ea3-1d7c-4c71-8daf-401b6932241a admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:11.233525 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1260ea3-1d7c-4c71-8daf-401b6932241a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:11.235533 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1260ea3-1d7c-4c71-8daf-401b6932241a admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:11.332018 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1324/2652] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:58:11 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:58:11.336968 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec04dcb-a88f-4303-8eca-65fe7b5a2692 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:11.348214 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec04dcb-a88f-4303-8eca-65fe7b5a2692 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:11.359451 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1260ea3-1d7c-4c71-8daf-401b6932241a admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:11.361582 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-c1260ea3-1d7c-4c71-8daf-401b6932241a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:11.441352 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeaa69e-8095-4074-9fbc-317a5b4eff8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:11.441972 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeaa69e-8095-4074-9fbc-317a5b4eff8c admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:11.442250 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeaa69e-8095-4074-9fbc-317a5b4eff8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:11.442524 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeaa69e-8095-4074-9fbc-317a5b4eff8c admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:11.443167 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeaa69e-8095-4074-9fbc-317a5b4eff8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:11.446220 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeaa69e-8095-4074-9fbc-317a5b4eff8c admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:11.449009 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1260ea3-1d7c-4c71-8daf-401b6932241a admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:11.454644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea8274-9a01-4836-a828-30f5e58e5bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:11.455614 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea8274-9a01-4836-a828-30f5e58e5bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:11.456664 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea8274-9a01-4836-a828-30f5e58e5bea admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:11.456664 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea8274-9a01-4836-a828-30f5e58e5bea admin admin] PATH_INFO: `/v3/projects/8bdec3d739784107bf3c004ed236c6a8` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:11.457964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea8274-9a01-4836-a828-30f5e58e5bea admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bdec3d739784107bf3c004ed236c6a8)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:11.460334 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea8274-9a01-4836-a828-30f5e58e5bea admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:11.551667 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1329/2653] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:58:11 2022] POST /identity/v3/users => generated 289 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:58:11.556181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeaa69e-8095-4074-9fbc-317a5b4eff8c admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:11.566920 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeaa69e-8095-4074-9fbc-317a5b4eff8c admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:11.572845 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90a1a0-402e-4045-9a47-4e1de893f62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:11.573480 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90a1a0-402e-4045-9a47-4e1de893f62e admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:11.573765 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90a1a0-402e-4045-9a47-4e1de893f62e admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:11.574040 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90a1a0-402e-4045-9a47-4e1de893f62e admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:11.574692 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90a1a0-402e-4045-9a47-4e1de893f62e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:11.576299 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90a1a0-402e-4045-9a47-4e1de893f62e admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:11.587515 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1330/2654] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:58:11.591663 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90a1a0-402e-4045-9a47-4e1de893f62e admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:11.594114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-74ea8274-9a01-4836-a828-30f5e58e5bea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bdec3d739784107bf3c004ed236c6a8', 'request_id': 'req-74ea8274-9a01-4836-a828-30f5e58e5bea'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:11.597546 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-74ea8274-9a01-4836-a828-30f5e58e5bea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bdec3d739784107bf3c004ed236c6a8', 'request_id': 'req-74ea8274-9a01-4836-a828-30f5e58e5bea'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:11.602136 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90a1a0-402e-4045-9a47-4e1de893f62e admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:11.620551 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:11.659327 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277eb53-c369-42b6-9d40-ba61bd7ba7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:11.659934 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277eb53-c369-42b6-9d40-ba61bd7ba7d9 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:11.660218 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277eb53-c369-42b6-9d40-ba61bd7ba7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:11.660493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277eb53-c369-42b6-9d40-ba61bd7ba7d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:11.661163 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9277eb53-c369-42b6-9d40-ba61bd7ba7d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:11.662750 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9277eb53-c369-42b6-9d40-ba61bd7ba7d9 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:11.666386 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-74ea8274-9a01-4836-a828-30f5e58e5bea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bdec3d739784107bf3c004ed236c6a8', 'request_id': 'req-74ea8274-9a01-4836-a828-30f5e58e5bea'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:11.676750 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1331/2655] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:58:11.677676 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277eb53-c369-42b6-9d40-ba61bd7ba7d9 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:11.680038 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-9277eb53-c369-42b6-9d40-ba61bd7ba7d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:11.689258 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-74ea8274-9a01-4836-a828-30f5e58e5bea admin admin] The token cache is being invalidate because project 8bdec3d739784107bf3c004ed236c6a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:58:11.689560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-74ea8274-9a01-4836-a828-30f5e58e5bea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:11.690245 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-74ea8274-9a01-4836-a828-30f5e58e5bea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:11.691855 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1325/2656] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:58:11 2022] DELETE /identity/v3/projects/8bdec3d739784107bf3c004ed236c6a8 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:58:11.696521 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea8274-9a01-4836-a828-30f5e58e5bea admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:11.696673 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277eb53-c369-42b6-9d40-ba61bd7ba7d9 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:11.696783 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-74ea8274-9a01-4836-a828-30f5e58e5bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:11.701468 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d879549-b4e6-4c73-bd97-7db4c7b8631c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:11.702216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d879549-b4e6-4c73-bd97-7db4c7b8631c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:11.702605 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d879549-b4e6-4c73-bd97-7db4c7b8631c admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:11.702989 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d879549-b4e6-4c73-bd97-7db4c7b8631c admin admin] PATH_INFO: `/v3/projects/b925ca5657e047f1908b5390eaed5c38` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:11.704262 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d879549-b4e6-4c73-bd97-7db4c7b8631c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b925ca5657e047f1908b5390eaed5c38)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:11.706795 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d879549-b4e6-4c73-bd97-7db4c7b8631c admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:11.709976 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea8274-9a01-4836-a828-30f5e58e5bea admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:11.715553 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54932a5b-7d9c-48dc-9b16-40a2046d70e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:11.715870 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54932a5b-7d9c-48dc-9b16-40a2046d70e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:11.716155 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54932a5b-7d9c-48dc-9b16-40a2046d70e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:11.716503 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54932a5b-7d9c-48dc-9b16-40a2046d70e0 admin admin] PATH_INFO: `/v3/projects/938aa23c401444569cdc7ee8032a84cb/users/e9110c348af540e5a871424ef10ad18b/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:11.734113 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54932a5b-7d9c-48dc-9b16-40a2046d70e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=938aa23c401444569cdc7ee8032a84cb, user_id=e9110c348af540e5a871424ef10ad18b, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:11.736754 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54932a5b-7d9c-48dc-9b16-40a2046d70e0 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:11.844887 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:11.849741 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1326/2657] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:58:11 2022] PUT /identity/v3/projects/938aa23c401444569cdc7ee8032a84cb/users/e9110c348af540e5a871424ef10ad18b/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:11.851028 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d97fde-e421-4a48-a977-399018e6f644 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:11.851785 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d97fde-e421-4a48-a977-399018e6f644 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:11.852057 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d97fde-e421-4a48-a977-399018e6f644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:11.859668 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-3d879549-b4e6-4c73-bd97-7db4c7b8631c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b925ca5657e047f1908b5390eaed5c38', 'request_id': 'req-3d879549-b4e6-4c73-bd97-7db4c7b8631c'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:11.866130 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-3d879549-b4e6-4c73-bd97-7db4c7b8631c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b925ca5657e047f1908b5390eaed5c38', 'request_id': 'req-3d879549-b4e6-4c73-bd97-7db4c7b8631c'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:11.872524 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-28d97fde-e421-4a48-a977-399018e6f644 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:11.873814 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-28d97fde-e421-4a48-a977-399018e6f644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:11.932719 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1327/2658] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:11.934014 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5a7f2-2bbe-415f-a70f-5c35cbb2f3d8 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:11.934401 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5a7f2-2bbe-415f-a70f-5c35cbb2f3d8 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:11.934690 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5a7f2-2bbe-415f-a70f-5c35cbb2f3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:11.945517 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-3d879549-b4e6-4c73-bd97-7db4c7b8631c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b925ca5657e047f1908b5390eaed5c38', 'request_id': 'req-3d879549-b4e6-4c73-bd97-7db4c7b8631c'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:11.957872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-3d879549-b4e6-4c73-bd97-7db4c7b8631c admin admin] The token cache is being invalidate because project b925ca5657e047f1908b5390eaed5c38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:58:11.958242 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-3d879549-b4e6-4c73-bd97-7db4c7b8631c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:11.959025 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-3d879549-b4e6-4c73-bd97-7db4c7b8631c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:11.961992 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1332/2659] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:58:11 2022] DELETE /identity/v3/projects/b925ca5657e047f1908b5390eaed5c38 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:11.962621 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da576ce4-65c3-474e-9aa5-d39027f382eb None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:11.962982 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da576ce4-65c3-474e-9aa5-d39027f382eb None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:11.963389 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da576ce4-65c3-474e-9aa5-d39027f382eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:11.966152 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-7cf5a7f2-2bbe-415f-a70f-5c35cbb2f3d8 None None] MFA Rules not processed for user `e9110c348af540e5a871424ef10ad18b`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:11.967491 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-7cf5a7f2-2bbe-415f-a70f-5c35cbb2f3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:11.984058 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-da576ce4-65c3-474e-9aa5-d39027f382eb None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:11.986351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-da576ce4-65c3-474e-9aa5-d39027f382eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:11.994865 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1333/2660] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:11.995703 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da576ce4-65c3-474e-9aa5-d39027f382eb None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:11.996939 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-da576ce4-65c3-474e-9aa5-d39027f382eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:12.008725 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da576ce4-65c3-474e-9aa5-d39027f382eb None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:12.013478 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481415e-ec0f-4bb6-9f2c-2528a0b38921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:12.014093 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481415e-ec0f-4bb6-9f2c-2528a0b38921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:12.014374 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481415e-ec0f-4bb6-9f2c-2528a0b38921 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:12.014649 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481415e-ec0f-4bb6-9f2c-2528a0b38921 admin admin] PATH_INFO: `/v3/users/e8faac3e5034402b8a06b974f36b1233` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:12.015779 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3481415e-ec0f-4bb6-9f2c-2528a0b38921 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8faac3e5034402b8a06b974f36b1233)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:12.017705 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3481415e-ec0f-4bb6-9f2c-2528a0b38921 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:12.034381 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1328/2661] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:12.035297 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5a7f2-2bbe-415f-a70f-5c35cbb2f3d8 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:12.046703 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5a7f2-2bbe-415f-a70f-5c35cbb2f3d8 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:12.051372 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8438ec-0134-46da-839b-f84e96fdbb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:12.054952 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8438ec-0134-46da-839b-f84e96fdbb27 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:12.054952 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8438ec-0134-46da-839b-f84e96fdbb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:12.054952 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8438ec-0134-46da-839b-f84e96fdbb27 admin admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:12.054952 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8438ec-0134-46da-839b-f84e96fdbb27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:58:12.054952 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8438ec-0134-46da-839b-f84e96fdbb27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:12.055443 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8438ec-0134-46da-839b-f84e96fdbb27 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:12.067192 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1329/2662] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:58:12.068039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8438ec-0134-46da-839b-f84e96fdbb27 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:12.069803 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-6c8438ec-0134-46da-839b-f84e96fdbb27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:12.129016 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8438ec-0134-46da-839b-f84e96fdbb27 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:12.132720 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b21a8-c96d-4ef8-a508-5c90ec1489d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:12.133425 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b21a8-c96d-4ef8-a508-5c90ec1489d5 service cinder] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:12.133702 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b21a8-c96d-4ef8-a508-5c90ec1489d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:12.133968 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b21a8-c96d-4ef8-a508-5c90ec1489d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:12.142278 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b21a8-c96d-4ef8-a508-5c90ec1489d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:12.143701 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b21a8-c96d-4ef8-a508-5c90ec1489d5 service cinder] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:12.152886 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1330/2663] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:58:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:58:12.153761 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b21a8-c96d-4ef8-a508-5c90ec1489d5 service cinder] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:12.165040 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b21a8-c96d-4ef8-a508-5c90ec1489d5 service cinder] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:12.169856 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fd07e-d2ce-4679-94bb-d31ab8ca16f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:12.170450 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fd07e-d2ce-4679-94bb-d31ab8ca16f8 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:12.170725 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fd07e-d2ce-4679-94bb-d31ab8ca16f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:12.171114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fd07e-d2ce-4679-94bb-d31ab8ca16f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:12.171742 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351fd07e-d2ce-4679-94bb-d31ab8ca16f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:12.173655 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351fd07e-d2ce-4679-94bb-d31ab8ca16f8 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:12.179419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-3481415e-ec0f-4bb6-9f2c-2528a0b38921 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8faac3e5034402b8a06b974f36b1233'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:12.305747 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-3481415e-ec0f-4bb6-9f2c-2528a0b38921 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8faac3e5034402b8a06b974f36b1233'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:12.306607 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-3481415e-ec0f-4bb6-9f2c-2528a0b38921 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8faac3e5034402b8a06b974f36b1233'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:12.307258 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-3481415e-ec0f-4bb6-9f2c-2528a0b38921 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8faac3e5034402b8a06b974f36b1233'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:12.314797 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-3481415e-ec0f-4bb6-9f2c-2528a0b38921 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8faac3e5034402b8a06b974f36b1233'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:12.333008 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1334/2664] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:58:11 2022] DELETE /identity/v3/users/e8faac3e5034402b8a06b974f36b1233 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:12.335153 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:12.344268 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1331/2665] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:58:12 2022] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:58:12.348608 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481415e-ec0f-4bb6-9f2c-2528a0b38921 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:12.350177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-3481415e-ec0f-4bb6-9f2c-2528a0b38921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:12.360487 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:12.420040 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481415e-ec0f-4bb6-9f2c-2528a0b38921 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:12.478694 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a06a2b-1a62-46d6-a54b-e1f41eaa6b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:12.479237 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a06a2b-1a62-46d6-a54b-e1f41eaa6b7f admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:12.479518 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a06a2b-1a62-46d6-a54b-e1f41eaa6b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:12.479790 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a06a2b-1a62-46d6-a54b-e1f41eaa6b7f admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:12.480436 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a06a2b-1a62-46d6-a54b-e1f41eaa6b7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:12.482455 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a06a2b-1a62-46d6-a54b-e1f41eaa6b7f admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:12.594567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1335/2666] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:58:12 2022] POST /identity/v3/users => generated 292 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:58:12.598661 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fd07e-d2ce-4679-94bb-d31ab8ca16f8 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:12.609228 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fd07e-d2ce-4679-94bb-d31ab8ca16f8 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:12.614426 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21326ed-3c94-459b-8661-13169f338719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:12.614950 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21326ed-3c94-459b-8661-13169f338719 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:12.615299 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21326ed-3c94-459b-8661-13169f338719 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:12.615696 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21326ed-3c94-459b-8661-13169f338719 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:12.616399 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21326ed-3c94-459b-8661-13169f338719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:12.618537 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21326ed-3c94-459b-8661-13169f338719 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:12.630171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1332/2667] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:58:12.635314 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a06a2b-1a62-46d6-a54b-e1f41eaa6b7f admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:12.645406 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a06a2b-1a62-46d6-a54b-e1f41eaa6b7f admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:12.650991 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928f75b-1bd0-4e1c-891a-49421bbf0559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:12.651594 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928f75b-1bd0-4e1c-891a-49421bbf0559 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:12.651871 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928f75b-1bd0-4e1c-891a-49421bbf0559 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:12.652167 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928f75b-1bd0-4e1c-891a-49421bbf0559 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:12.652844 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b928f75b-1bd0-4e1c-891a-49421bbf0559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:12.654461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b928f75b-1bd0-4e1c-891a-49421bbf0559 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:12.667932 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1336/2668] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:58:12.669421 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21326ed-3c94-459b-8661-13169f338719 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:12.679787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21326ed-3c94-459b-8661-13169f338719 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:12.684991 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2363a3-801f-46a2-a1cf-4c8e6daa12b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:12.685663 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2363a3-801f-46a2-a1cf-4c8e6daa12b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:12.685941 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2363a3-801f-46a2-a1cf-4c8e6daa12b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:12.686212 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2363a3-801f-46a2-a1cf-4c8e6daa12b5 admin admin] PATH_INFO: `/v3/projects/1c7f3f3e978e43a0a4e4e92e36141038/users/bbf4e40a31654f988ce0c891831e58df/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:12.702270 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2363a3-801f-46a2-a1cf-4c8e6daa12b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c7f3f3e978e43a0a4e4e92e36141038, user_id=bbf4e40a31654f988ce0c891831e58df, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:12.704946 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2363a3-801f-46a2-a1cf-4c8e6daa12b5 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:12.826682 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1333/2669] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:58:12 2022] PUT /identity/v3/projects/1c7f3f3e978e43a0a4e4e92e36141038/users/bbf4e40a31654f988ce0c891831e58df/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:12.830903 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928f75b-1bd0-4e1c-891a-49421bbf0559 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:12.833598 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-b928f75b-1bd0-4e1c-891a-49421bbf0559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:12.840516 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be121f-1e8e-44ec-9942-dce09561980e None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:12.840895 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be121f-1e8e-44ec-9942-dce09561980e None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:12.841257 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be121f-1e8e-44ec-9942-dce09561980e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:12.863302 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928f75b-1bd0-4e1c-891a-49421bbf0559 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:12.876688 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-67be121f-1e8e-44ec-9942-dce09561980e None None] MFA Rules not processed for user `bbf4e40a31654f988ce0c891831e58df`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:12.878222 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-67be121f-1e8e-44ec-9942-dce09561980e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:12.948191 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52927616-0a67-47ee-a69e-a7bd380a2871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:12.948817 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52927616-0a67-47ee-a69e-a7bd380a2871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:12.949149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52927616-0a67-47ee-a69e-a7bd380a2871 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:12.949423 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52927616-0a67-47ee-a69e-a7bd380a2871 admin admin] PATH_INFO: `/v3/projects/070fd92e541040e1910ccea8caf3214a` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:12.950738 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52927616-0a67-47ee-a69e-a7bd380a2871 admin admin] RBAC: Authorizing `identity:delete_project(project_id=070fd92e541040e1910ccea8caf3214a)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:12.954219 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52927616-0a67-47ee-a69e-a7bd380a2871 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:12.955790 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1334/2670] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:58:12.960566 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be121f-1e8e-44ec-9942-dce09561980e None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:12.971778 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be121f-1e8e-44ec-9942-dce09561980e None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:12.976883 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb113e2-2f9e-4210-9b53-4b0a4f46ce71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:12.977508 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb113e2-2f9e-4210-9b53-4b0a4f46ce71 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:12.977787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb113e2-2f9e-4210-9b53-4b0a4f46ce71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:12.978064 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb113e2-2f9e-4210-9b53-4b0a4f46ce71 admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:12.978717 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb113e2-2f9e-4210-9b53-4b0a4f46ce71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:12.980607 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb113e2-2f9e-4210-9b53-4b0a4f46ce71 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:13.039647 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:13.049192 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-52927616-0a67-47ee-a69e-a7bd380a2871 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '070fd92e541040e1910ccea8caf3214a', 'request_id': 'req-52927616-0a67-47ee-a69e-a7bd380a2871'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:13.055470 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-52927616-0a67-47ee-a69e-a7bd380a2871 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '070fd92e541040e1910ccea8caf3214a', 'request_id': 'req-52927616-0a67-47ee-a69e-a7bd380a2871'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:13.062189 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1335/2671] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:58:12 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:58:13.062189 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb113e2-2f9e-4210-9b53-4b0a4f46ce71 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:13.118392 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-52927616-0a67-47ee-a69e-a7bd380a2871 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '070fd92e541040e1910ccea8caf3214a', 'request_id': 'req-52927616-0a67-47ee-a69e-a7bd380a2871'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:13.123635 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb113e2-2f9e-4210-9b53-4b0a4f46ce71 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:13.131241 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debf309-1286-4256-967b-949ea8833053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:13.131241 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debf309-1286-4256-967b-949ea8833053 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:13.131241 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debf309-1286-4256-967b-949ea8833053 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:13.131241 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debf309-1286-4256-967b-949ea8833053 admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:13.131614 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-52927616-0a67-47ee-a69e-a7bd380a2871 admin admin] The token cache is being invalidate because project 070fd92e541040e1910ccea8caf3214a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:58:13.131614 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-52927616-0a67-47ee-a69e-a7bd380a2871 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:13.131805 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debf309-1286-4256-967b-949ea8833053 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:13.131890 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-52927616-0a67-47ee-a69e-a7bd380a2871 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:13.132416 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debf309-1286-4256-967b-949ea8833053 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:13.132594 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1337/2672] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:58:12 2022] DELETE /identity/v3/projects/070fd92e541040e1910ccea8caf3214a => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:58:13.137058 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc22b1-735a-430c-a0b6-6c5ccf387f88 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:13.137340 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc22b1-735a-430c-a0b6-6c5ccf387f88 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:13.137629 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc22b1-735a-430c-a0b6-6c5ccf387f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:13.156703 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-4ecc22b1-735a-430c-a0b6-6c5ccf387f88 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:13.159811 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-4ecc22b1-735a-430c-a0b6-6c5ccf387f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:13.166931 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1338/2673] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:13.174615 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18350bcd-af03-4a37-bd83-5a05a4dcc2b9 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:13.174895 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18350bcd-af03-4a37-bd83-5a05a4dcc2b9 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:13.175163 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18350bcd-af03-4a37-bd83-5a05a4dcc2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:13.195252 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-18350bcd-af03-4a37-bd83-5a05a4dcc2b9 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:13.199973 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-18350bcd-af03-4a37-bd83-5a05a4dcc2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:13.206295 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1339/2674] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:58:13.211336 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18350bcd-af03-4a37-bd83-5a05a4dcc2b9 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:13.220606 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18350bcd-af03-4a37-bd83-5a05a4dcc2b9 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:13.225361 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd88bf-64b7-42a9-a16c-8a4a3024afa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:13.231371 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1336/2675] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:58:13 2022] POST /identity/v3/users => generated 294 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:58:13.231494 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd88bf-64b7-42a9-a16c-8a4a3024afa2 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:13.231494 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd88bf-64b7-42a9-a16c-8a4a3024afa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:13.231494 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd88bf-64b7-42a9-a16c-8a4a3024afa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:13.231494 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd88bf-64b7-42a9-a16c-8a4a3024afa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:58:13.231494 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd88bf-64b7-42a9-a16c-8a4a3024afa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:13.231494 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd88bf-64b7-42a9-a16c-8a4a3024afa2 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:13.232410 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debf309-1286-4256-967b-949ea8833053 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:13.234097 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-8debf309-1286-4256-967b-949ea8833053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:13.245618 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1340/2676] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:58:13.246869 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd88bf-64b7-42a9-a16c-8a4a3024afa2 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:13.246994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debf309-1286-4256-967b-949ea8833053 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:13.251640 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4787ea-5aeb-4c59-87da-58226b53f9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:13.252272 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4787ea-5aeb-4c59-87da-58226b53f9c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:13.252558 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4787ea-5aeb-4c59-87da-58226b53f9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:13.252832 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4787ea-5aeb-4c59-87da-58226b53f9c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:13.253507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4787ea-5aeb-4c59-87da-58226b53f9c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:13.255130 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4787ea-5aeb-4c59-87da-58226b53f9c4 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:13.256973 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd88bf-64b7-42a9-a16c-8a4a3024afa2 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:13.261924 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25650989-2852-4de2-9b0f-98dd19a40e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:13.262520 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25650989-2852-4de2-9b0f-98dd19a40e44 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:13.262804 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25650989-2852-4de2-9b0f-98dd19a40e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:13.263080 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25650989-2852-4de2-9b0f-98dd19a40e44 admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:13.263700 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25650989-2852-4de2-9b0f-98dd19a40e44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:13.265656 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1337/2677] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:58:13.268610 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25650989-2852-4de2-9b0f-98dd19a40e44 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:13.269552 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4787ea-5aeb-4c59-87da-58226b53f9c4 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:13.279241 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4787ea-5aeb-4c59-87da-58226b53f9c4 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:13.283767 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980f759-f721-4c5b-8103-d41cf14081ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:13.284357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980f759-f721-4c5b-8103-d41cf14081ff admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:13.284636 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980f759-f721-4c5b-8103-d41cf14081ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:13.284910 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980f759-f721-4c5b-8103-d41cf14081ff admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:13.285583 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980f759-f721-4c5b-8103-d41cf14081ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:13.287212 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980f759-f721-4c5b-8103-d41cf14081ff admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:13.289829 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:13.298624 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1338/2678] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:58:13.302820 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980f759-f721-4c5b-8103-d41cf14081ff admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:13.313451 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980f759-f721-4c5b-8103-d41cf14081ff admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:13.318069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4459e7e-b782-4277-a641-03c99adb7fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:13.318680 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4459e7e-b782-4277-a641-03c99adb7fc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:13.318958 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4459e7e-b782-4277-a641-03c99adb7fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:13.319225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4459e7e-b782-4277-a641-03c99adb7fc4 admin admin] PATH_INFO: `/v3/projects/c4568160439b4cd1800ce343915750df/users/438d809e50a0440d90a7edaa791ad06c/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:13.334615 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4459e7e-b782-4277-a641-03c99adb7fc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4568160439b4cd1800ce343915750df, user_id=438d809e50a0440d90a7edaa791ad06c, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:13.338220 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4459e7e-b782-4277-a641-03c99adb7fc4 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:13.353940 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1341/2679] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:58:13 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:58:13.358821 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25650989-2852-4de2-9b0f-98dd19a40e44 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:13.422573 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1339/2680] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:58:13 2022] PUT /identity/v3/projects/c4568160439b4cd1800ce343915750df/users/438d809e50a0440d90a7edaa791ad06c/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:58:13.431388 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25650989-2852-4de2-9b0f-98dd19a40e44 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:13.432811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144da1a-54fe-4b9c-acae-345242d6f133 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:13.433146 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144da1a-54fe-4b9c-acae-345242d6f133 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:13.433450 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144da1a-54fe-4b9c-acae-345242d6f133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:13.463131 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-c144da1a-54fe-4b9c-acae-345242d6f133 None None] MFA Rules not processed for user `438d809e50a0440d90a7edaa791ad06c`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:13.464401 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-c144da1a-54fe-4b9c-acae-345242d6f133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:13.487889 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f1d33-b059-4714-a0d3-3512d2e8f35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:13.489067 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f1d33-b059-4714-a0d3-3512d2e8f35c admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:13.489636 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f1d33-b059-4714-a0d3-3512d2e8f35c admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:13.489927 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f1d33-b059-4714-a0d3-3512d2e8f35c admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:13.490952 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f1d33-b059-4714-a0d3-3512d2e8f35c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:13.493491 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f1d33-b059-4714-a0d3-3512d2e8f35c admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:13.533188 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1340/2681] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:58:13.537561 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144da1a-54fe-4b9c-acae-345242d6f133 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:13.555804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144da1a-54fe-4b9c-acae-345242d6f133 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:13.560559 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716e008-2f26-4a41-9750-9815c2ca67dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:13.561240 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716e008-2f26-4a41-9750-9815c2ca67dc admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:13.561530 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716e008-2f26-4a41-9750-9815c2ca67dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:13.561808 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716e008-2f26-4a41-9750-9815c2ca67dc admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:13.562445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716e008-2f26-4a41-9750-9815c2ca67dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:13.564351 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716e008-2f26-4a41-9750-9815c2ca67dc admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:13.571056 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1342/2682] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:58:13 2022] POST /identity/v3/users => generated 286 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:58:13.576107 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f1d33-b059-4714-a0d3-3512d2e8f35c admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:13.587206 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f1d33-b059-4714-a0d3-3512d2e8f35c admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:13.592250 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e66320e-0ff6-4818-b702-39e692b95677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:13.592848 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66320e-0ff6-4818-b702-39e692b95677 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:13.593163 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66320e-0ff6-4818-b702-39e692b95677 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:13.593435 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66320e-0ff6-4818-b702-39e692b95677 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:13.594104 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e66320e-0ff6-4818-b702-39e692b95677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:13.595733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e66320e-0ff6-4818-b702-39e692b95677 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:13.602375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:13.607268 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1343/2683] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:58:13.611279 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e66320e-0ff6-4818-b702-39e692b95677 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:13.621169 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e66320e-0ff6-4818-b702-39e692b95677 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:13.625820 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560edbd-24c9-4cb8-8509-807c2b3d838b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:13.626375 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560edbd-24c9-4cb8-8509-807c2b3d838b admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:13.627438 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560edbd-24c9-4cb8-8509-807c2b3d838b admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:13.627438 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560edbd-24c9-4cb8-8509-807c2b3d838b admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:13.627636 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560edbd-24c9-4cb8-8509-807c2b3d838b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:13.629146 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560edbd-24c9-4cb8-8509-807c2b3d838b admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:13.640364 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1344/2684] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:58:13.644122 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560edbd-24c9-4cb8-8509-807c2b3d838b admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:13.646504 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1341/2685] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:58:13 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:58:13.653163 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716e008-2f26-4a41-9750-9815c2ca67dc admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:13.654942 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560edbd-24c9-4cb8-8509-807c2b3d838b admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:13.711462 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4573878-4d1e-43b6-923c-94c931d80014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:13.712131 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4573878-4d1e-43b6-923c-94c931d80014 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:13.712580 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4573878-4d1e-43b6-923c-94c931d80014 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:13.713357 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4573878-4d1e-43b6-923c-94c931d80014 admin admin] PATH_INFO: `/v3/projects/bbdf338f50ce4561b4cd8a58f74afa4c/users/a14bb489554e4a0f98470e4335eaadcd/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:13.716970 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716e008-2f26-4a41-9750-9815c2ca67dc admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:13.721899 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224c471-b678-4edc-af12-f5f6acc5a179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:13.722569 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224c471-b678-4edc-af12-f5f6acc5a179 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:13.722859 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224c471-b678-4edc-af12-f5f6acc5a179 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:13.723150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224c471-b678-4edc-af12-f5f6acc5a179 admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:13.723781 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224c471-b678-4edc-af12-f5f6acc5a179 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:13.725728 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224c471-b678-4edc-af12-f5f6acc5a179 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:13.727922 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4573878-4d1e-43b6-923c-94c931d80014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbdf338f50ce4561b4cd8a58f74afa4c, user_id=a14bb489554e4a0f98470e4335eaadcd, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:13.730580 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4573878-4d1e-43b6-923c-94c931d80014 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:13.814212 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1345/2686] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:58:13 2022] PUT /identity/v3/projects/bbdf338f50ce4561b4cd8a58f74afa4c/users/a14bb489554e4a0f98470e4335eaadcd/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:58:13.823605 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1342/2687] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:58:13 2022] POST /identity/v3/users => generated 299 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:58:13.824680 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224c471-b678-4edc-af12-f5f6acc5a179 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:13.825002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8160d-32c1-4351-987e-21be75017519 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:13.825321 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8160d-32c1-4351-987e-21be75017519 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:13.825602 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8160d-32c1-4351-987e-21be75017519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:13.834657 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224c471-b678-4edc-af12-f5f6acc5a179 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:13.855799 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-00f8160d-32c1-4351-987e-21be75017519 None None] MFA Rules not processed for user `a14bb489554e4a0f98470e4335eaadcd`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:13.857353 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-00f8160d-32c1-4351-987e-21be75017519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:13.865587 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:13.897561 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74eb70-781c-4f4e-ba87-eb1aa694afc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:13.898278 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74eb70-781c-4f4e-ba87-eb1aa694afc2 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:13.898641 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74eb70-781c-4f4e-ba87-eb1aa694afc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:13.899313 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74eb70-781c-4f4e-ba87-eb1aa694afc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:13.900339 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74eb70-781c-4f4e-ba87-eb1aa694afc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:13.902859 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74eb70-781c-4f4e-ba87-eb1aa694afc2 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:13.915333 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1343/2688] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:58:13.919392 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74eb70-781c-4f4e-ba87-eb1aa694afc2 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:13.938723 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74eb70-781c-4f4e-ba87-eb1aa694afc2 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:13.938868 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1346/2689] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:13.938973 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe314e4d-ac93-45dc-b273-45dcdb0a675a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:13.939110 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8160d-32c1-4351-987e-21be75017519 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:13.939210 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe314e4d-ac93-45dc-b273-45dcdb0a675a admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:13.939210 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe314e4d-ac93-45dc-b273-45dcdb0a675a admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:13.939210 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe314e4d-ac93-45dc-b273-45dcdb0a675a admin admin] PATH_INFO: `/v3/projects/8b7f0558783f43a98cddb229b6ce41af/users/5e8b6a317e764c378c68de4d39478d79/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:13.946977 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8160d-32c1-4351-987e-21be75017519 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:13.951872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3842fc2-97c0-40c9-ab9f-4d73e132ce5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:13.952484 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3842fc2-97c0-40c9-ab9f-4d73e132ce5f admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:13.952770 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3842fc2-97c0-40c9-ab9f-4d73e132ce5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:13.953075 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3842fc2-97c0-40c9-ab9f-4d73e132ce5f admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:13.953691 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3842fc2-97c0-40c9-ab9f-4d73e132ce5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:13.955602 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3842fc2-97c0-40c9-ab9f-4d73e132ce5f admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:13.956467 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe314e4d-ac93-45dc-b273-45dcdb0a675a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b7f0558783f43a98cddb229b6ce41af, user_id=5e8b6a317e764c378c68de4d39478d79, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:13.959366 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe314e4d-ac93-45dc-b273-45dcdb0a675a admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:14.055279 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1344/2690] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:58:13 2022] PUT /identity/v3/projects/8b7f0558783f43a98cddb229b6ce41af/users/5e8b6a317e764c378c68de4d39478d79/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:58:14.059303 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe314e4d-ac93-45dc-b273-45dcdb0a675a admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:14.087851 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1347/2691] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:58:13 2022] POST /identity/v3/projects => generated 371 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:58:14.091742 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3842fc2-97c0-40c9-ab9f-4d73e132ce5f admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:14.128335 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe314e4d-ac93-45dc-b273-45dcdb0a675a admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:14.135810 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:14.155856 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3842fc2-97c0-40c9-ab9f-4d73e132ce5f admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:14.160739 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2b0cc-afbf-4bbe-a5da-979f03673b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:14.161397 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2b0cc-afbf-4bbe-a5da-979f03673b0f admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:14.161650 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2b0cc-afbf-4bbe-a5da-979f03673b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:14.161921 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2b0cc-afbf-4bbe-a5da-979f03673b0f admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:14.162542 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2b0cc-afbf-4bbe-a5da-979f03673b0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:14.165201 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2b0cc-afbf-4bbe-a5da-979f03673b0f admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:14.189497 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edb612-be5e-4f66-ad0c-200702b4a06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:14.190173 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edb612-be5e-4f66-ad0c-200702b4a06b admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:14.190457 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edb612-be5e-4f66-ad0c-200702b4a06b admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:14.190733 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edb612-be5e-4f66-ad0c-200702b4a06b admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:14.191427 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33edb612-be5e-4f66-ad0c-200702b4a06b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:14.193166 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33edb612-be5e-4f66-ad0c-200702b4a06b admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:14.203054 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1345/2692] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:58:14.207434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edb612-be5e-4f66-ad0c-200702b4a06b admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:14.217934 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edb612-be5e-4f66-ad0c-200702b4a06b admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:14.222553 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12e3c1-dee9-4656-bc57-636ef8ce2f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:14.223168 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12e3c1-dee9-4656-bc57-636ef8ce2f91 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:14.223475 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12e3c1-dee9-4656-bc57-636ef8ce2f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:14.223752 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12e3c1-dee9-4656-bc57-636ef8ce2f91 admin admin] PATH_INFO: `/v3/projects/8b7f0558783f43a98cddb229b6ce41af/users/5e8b6a317e764c378c68de4d39478d79/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:14.225685 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc12e3c1-dee9-4656-bc57-636ef8ce2f91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b7f0558783f43a98cddb229b6ce41af, user_id=5e8b6a317e764c378c68de4d39478d79, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:14.229282 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc12e3c1-dee9-4656-bc57-636ef8ce2f91 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:14.239541 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1346/2693] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:58:14 2022] PUT /identity/v3/projects/8b7f0558783f43a98cddb229b6ce41af/users/5e8b6a317e764c378c68de4d39478d79/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:58:14.243002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1348/2694] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:58:14 2022] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:58:14.249179 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12e3c1-dee9-4656-bc57-636ef8ce2f91 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:14.251091 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96fe54-b86c-4a38-a46b-77056bbba5e3 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:14.251380 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96fe54-b86c-4a38-a46b-77056bbba5e3 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:14.251654 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96fe54-b86c-4a38-a46b-77056bbba5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:14.286776 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-5c96fe54-b86c-4a38-a46b-77056bbba5e3 None None] MFA Rules not processed for user `5e8b6a317e764c378c68de4d39478d79`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:14.287993 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-5c96fe54-b86c-4a38-a46b-77056bbba5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:14.289590 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:14.317637 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12e3c1-dee9-4656-bc57-636ef8ce2f91 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:14.322771 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e15f20-9dd7-432a-b933-875a7b9b422c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:14.323401 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e15f20-9dd7-432a-b933-875a7b9b422c admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:14.323744 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e15f20-9dd7-432a-b933-875a7b9b422c admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:14.323999 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e15f20-9dd7-432a-b933-875a7b9b422c admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:14.324644 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e15f20-9dd7-432a-b933-875a7b9b422c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:14.326302 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e15f20-9dd7-432a-b933-875a7b9b422c admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:14.337242 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1347/2695] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:58:14.347303 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e15f20-9dd7-432a-b933-875a7b9b422c admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:14.352101 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e15f20-9dd7-432a-b933-875a7b9b422c admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:14.357090 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ae259-b22c-4f4f-9316-fed32ca2f125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:14.357739 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ae259-b22c-4f4f-9316-fed32ca2f125 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:14.358020 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ae259-b22c-4f4f-9316-fed32ca2f125 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:14.358297 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ae259-b22c-4f4f-9316-fed32ca2f125 admin admin] PATH_INFO: `/v3/projects/bdcd390685d94566a6d1db5719de111b/users/f46d5093b4c2431588d783323cd79bfd/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:14.362746 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1349/2696] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:14 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:14.370292 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96fe54-b86c-4a38-a46b-77056bbba5e3 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:14.372031 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-5c96fe54-b86c-4a38-a46b-77056bbba5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:14.375130 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ae259-b22c-4f4f-9316-fed32ca2f125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdcd390685d94566a6d1db5719de111b, user_id=f46d5093b4c2431588d783323cd79bfd, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:14.378261 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ae259-b22c-4f4f-9316-fed32ca2f125 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:14.437277 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96fe54-b86c-4a38-a46b-77056bbba5e3 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:14.440905 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa3dbe-5647-4733-b3b1-b55ead0da293 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:14.441929 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa3dbe-5647-4733-b3b1-b55ead0da293 service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:14.441929 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa3dbe-5647-4733-b3b1-b55ead0da293 service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:14.442116 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa3dbe-5647-4733-b3b1-b55ead0da293 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:14.451164 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa3dbe-5647-4733-b3b1-b55ead0da293 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:14.452587 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa3dbe-5647-4733-b3b1-b55ead0da293 service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:14.462792 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1350/2697] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:58:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:58:14.467191 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1348/2698] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:58:14 2022] PUT /identity/v3/projects/bdcd390685d94566a6d1db5719de111b/users/f46d5093b4c2431588d783323cd79bfd/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:58:14.471228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa3dbe-5647-4733-b3b1-b55ead0da293 service cinder] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:14.482339 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa3dbe-5647-4733-b3b1-b55ead0da293 service cinder] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:14.537449 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:14.543953 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b0540-6720-4b6f-9c6a-087cc5434ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:14.544597 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b0540-6720-4b6f-9c6a-087cc5434ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:14.544874 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b0540-6720-4b6f-9c6a-087cc5434ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:14.545179 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b0540-6720-4b6f-9c6a-087cc5434ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:14.545823 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b0540-6720-4b6f-9c6a-087cc5434ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:14.547407 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b0540-6720-4b6f-9c6a-087cc5434ee9 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:14.558624 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1351/2699] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:58:14.562838 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ae259-b22c-4f4f-9316-fed32ca2f125 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:14.573917 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ae259-b22c-4f4f-9316-fed32ca2f125 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:14.579975 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd918926-047e-4c73-8533-260b2ea93367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:14.580650 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd918926-047e-4c73-8533-260b2ea93367 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:14.580985 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd918926-047e-4c73-8533-260b2ea93367 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:14.581285 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd918926-047e-4c73-8533-260b2ea93367 admin admin] PATH_INFO: `/v3/projects/bdcd390685d94566a6d1db5719de111b/users/f46d5093b4c2431588d783323cd79bfd/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:14.583276 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd918926-047e-4c73-8533-260b2ea93367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdcd390685d94566a6d1db5719de111b, user_id=f46d5093b4c2431588d783323cd79bfd, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:14.586591 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd918926-047e-4c73-8533-260b2ea93367 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:14.597551 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1349/2700] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:58:14 2022] PUT /identity/v3/projects/bdcd390685d94566a6d1db5719de111b/users/f46d5093b4c2431588d783323cd79bfd/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:14.610343 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e43716-433b-4099-ab14-ba9598aa308e None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:14.610630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e43716-433b-4099-ab14-ba9598aa308e None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:14.610905 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e43716-433b-4099-ab14-ba9598aa308e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:14.639260 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-24e43716-433b-4099-ab14-ba9598aa308e None None] MFA Rules not processed for user `f46d5093b4c2431588d783323cd79bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:14.640483 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-24e43716-433b-4099-ab14-ba9598aa308e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:14.714074 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1352/2701] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:14.726918 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd918926-047e-4c73-8533-260b2ea93367 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:14.785526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd918926-047e-4c73-8533-260b2ea93367 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:14.789586 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b287b-2bb7-4292-9c41-0a05349077b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:14.790391 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b287b-2bb7-4292-9c41-0a05349077b6 service cinder] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:14.790750 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b287b-2bb7-4292-9c41-0a05349077b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:14.791101 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b287b-2bb7-4292-9c41-0a05349077b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:14.809185 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b287b-2bb7-4292-9c41-0a05349077b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:14.809185 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b287b-2bb7-4292-9c41-0a05349077b6 service cinder] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:14.814138 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1350/2702] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:58:14 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:58:15.673789 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e43716-433b-4099-ab14-ba9598aa308e None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:15.675234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-24e43716-433b-4099-ab14-ba9598aa308e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:15.688439 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e43716-433b-4099-ab14-ba9598aa308e None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:15.692085 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b705c1-3680-4964-b131-39f2dcad6415 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:15.692721 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b705c1-3680-4964-b131-39f2dcad6415 service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:15.693001 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b705c1-3680-4964-b131-39f2dcad6415 service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:15.693306 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b705c1-3680-4964-b131-39f2dcad6415 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:15.695005 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-f9b705c1-3680-4964-b131-39f2dcad6415 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:15.756480 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b705c1-3680-4964-b131-39f2dcad6415 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:15.758002 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b705c1-3680-4964-b131-39f2dcad6415 service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:15.767413 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1353/2703] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:58:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:58:15.990997 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b287b-2bb7-4292-9c41-0a05349077b6 service cinder] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:16.056009 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b287b-2bb7-4292-9c41-0a05349077b6 service cinder] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:16.060559 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95bffb4-da94-4246-ac82-e8697db79175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:16.061225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bffb4-da94-4246-ac82-e8697db79175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:16.061512 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bffb4-da94-4246-ac82-e8697db79175 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:16.061791 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bffb4-da94-4246-ac82-e8697db79175 admin admin] PATH_INFO: `/v3/users/a14bb489554e4a0f98470e4335eaadcd` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:16.062917 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95bffb4-da94-4246-ac82-e8697db79175 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a14bb489554e4a0f98470e4335eaadcd)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:16.064878 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95bffb4-da94-4246-ac82-e8697db79175 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:16.277327 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:16.285610 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e95bffb4-da94-4246-ac82-e8697db79175 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a14bb489554e4a0f98470e4335eaadcd'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:16.362478 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e95bffb4-da94-4246-ac82-e8697db79175 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a14bb489554e4a0f98470e4335eaadcd'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:16.363109 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e95bffb4-da94-4246-ac82-e8697db79175 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a14bb489554e4a0f98470e4335eaadcd'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:16.363726 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e95bffb4-da94-4246-ac82-e8697db79175 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a14bb489554e4a0f98470e4335eaadcd'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:16.371096 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-e95bffb4-da94-4246-ac82-e8697db79175 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a14bb489554e4a0f98470e4335eaadcd'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:16.388761 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1351/2704] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:58:15 2022] DELETE /identity/v3/users/a14bb489554e4a0f98470e4335eaadcd => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:16.394909 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7381b-df11-49a2-a215-905bce09ec95 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:16.395439 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7381b-df11-49a2-a215-905bce09ec95 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:16.395721 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7381b-df11-49a2-a215-905bce09ec95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:16.417818 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-97f7381b-df11-49a2-a215-905bce09ec95 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:16.419306 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-97f7381b-df11-49a2-a215-905bce09ec95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:16.481943 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1354/2705] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:16.491856 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95bffb4-da94-4246-ac82-e8697db79175 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:16.494285 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-e95bffb4-da94-4246-ac82-e8697db79175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:16.558220 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95bffb4-da94-4246-ac82-e8697db79175 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:16.561947 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b33cc5-9e3a-46e6-9196-7327ee937399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:16.562587 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b33cc5-9e3a-46e6-9196-7327ee937399 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:16.562866 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b33cc5-9e3a-46e6-9196-7327ee937399 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:16.563143 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b33cc5-9e3a-46e6-9196-7327ee937399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:16.572924 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b33cc5-9e3a-46e6-9196-7327ee937399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:16.574377 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b33cc5-9e3a-46e6-9196-7327ee937399 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:16.584215 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1352/2706] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:58:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:58:16.982109 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7381b-df11-49a2-a215-905bce09ec95 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:16.983533 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-97f7381b-df11-49a2-a215-905bce09ec95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:17.016671 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7381b-df11-49a2-a215-905bce09ec95 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:17.016671 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845751d3-cfad-47e0-87a6-d988cb4bc952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:17.016671 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845751d3-cfad-47e0-87a6-d988cb4bc952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:17.016671 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845751d3-cfad-47e0-87a6-d988cb4bc952 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:17.017740 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845751d3-cfad-47e0-87a6-d988cb4bc952 admin admin] PATH_INFO: `/v3/projects/bbdf338f50ce4561b4cd8a58f74afa4c` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:17.017740 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845751d3-cfad-47e0-87a6-d988cb4bc952 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbdf338f50ce4561b4cd8a58f74afa4c)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:17.017740 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845751d3-cfad-47e0-87a6-d988cb4bc952 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:17.019985 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=100 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:17.152099 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-845751d3-cfad-47e0-87a6-d988cb4bc952 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbdf338f50ce4561b4cd8a58f74afa4c', 'request_id': 'req-845751d3-cfad-47e0-87a6-d988cb4bc952'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:17.157886 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-845751d3-cfad-47e0-87a6-d988cb4bc952 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbdf338f50ce4561b4cd8a58f74afa4c', 'request_id': 'req-845751d3-cfad-47e0-87a6-d988cb4bc952'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:17.259442 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-845751d3-cfad-47e0-87a6-d988cb4bc952 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbdf338f50ce4561b4cd8a58f74afa4c', 'request_id': 'req-845751d3-cfad-47e0-87a6-d988cb4bc952'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:17.271596 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-845751d3-cfad-47e0-87a6-d988cb4bc952 admin admin] The token cache is being invalidate because project bbdf338f50ce4561b4cd8a58f74afa4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:58:17.271888 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-845751d3-cfad-47e0-87a6-d988cb4bc952 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:17.272520 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-845751d3-cfad-47e0-87a6-d988cb4bc952 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:17.274659 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1355/2707] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:58:16 2022] DELETE /identity/v3/projects/bbdf338f50ce4561b4cd8a58f74afa4c => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:17.278695 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b33cc5-9e3a-46e6-9196-7327ee937399 service neutron] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:17.288450 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b33cc5-9e3a-46e6-9196-7327ee937399 service neutron] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:17.345989 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81c255-b446-4a4d-bf68-3a09053d05b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:17.346646 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81c255-b446-4a4d-bf68-3a09053d05b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:17.347586 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81c255-b446-4a4d-bf68-3a09053d05b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:17.347866 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81c255-b446-4a4d-bf68-3a09053d05b6 admin admin] PATH_INFO: `/v3/users/f46d5093b4c2431588d783323cd79bfd` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:17.356691 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81c255-b446-4a4d-bf68-3a09053d05b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f46d5093b4c2431588d783323cd79bfd)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:17.356691 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81c255-b446-4a4d-bf68-3a09053d05b6 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:17.537368 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-2c81c255-b446-4a4d-bf68-3a09053d05b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f46d5093b4c2431588d783323cd79bfd'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:17.603027 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-2c81c255-b446-4a4d-bf68-3a09053d05b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f46d5093b4c2431588d783323cd79bfd'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:17.603648 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-2c81c255-b446-4a4d-bf68-3a09053d05b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f46d5093b4c2431588d783323cd79bfd'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:17.604291 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-2c81c255-b446-4a4d-bf68-3a09053d05b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f46d5093b4c2431588d783323cd79bfd'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:17.610120 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:17.613333 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-2c81c255-b446-4a4d-bf68-3a09053d05b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f46d5093b4c2431588d783323cd79bfd'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:17.634646 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1353/2708] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:58:17 2022] DELETE /identity/v3/users/f46d5093b4c2431588d783323cd79bfd => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:18.079878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845751d3-cfad-47e0-87a6-d988cb4bc952 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:18.081735 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-845751d3-cfad-47e0-87a6-d988cb4bc952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:18.096085 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845751d3-cfad-47e0-87a6-d988cb4bc952 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:18.155316 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bb821-d7ab-4d9c-9d35-7413d5a3de95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:18.155969 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bb821-d7ab-4d9c-9d35-7413d5a3de95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:18.156292 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bb821-d7ab-4d9c-9d35-7413d5a3de95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:18.156609 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bb821-d7ab-4d9c-9d35-7413d5a3de95 admin admin] PATH_INFO: `/v3/projects/bdcd390685d94566a6d1db5719de111b` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:18.157787 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2bb821-d7ab-4d9c-9d35-7413d5a3de95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdcd390685d94566a6d1db5719de111b)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:18.159748 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2bb821-d7ab-4d9c-9d35-7413d5a3de95 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:18.266601 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-de2bb821-d7ab-4d9c-9d35-7413d5a3de95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdcd390685d94566a6d1db5719de111b', 'request_id': 'req-de2bb821-d7ab-4d9c-9d35-7413d5a3de95'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:18.272407 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-de2bb821-d7ab-4d9c-9d35-7413d5a3de95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdcd390685d94566a6d1db5719de111b', 'request_id': 'req-de2bb821-d7ab-4d9c-9d35-7413d5a3de95'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:18.333751 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-de2bb821-d7ab-4d9c-9d35-7413d5a3de95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdcd390685d94566a6d1db5719de111b', 'request_id': 'req-de2bb821-d7ab-4d9c-9d35-7413d5a3de95'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:18.345830 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-de2bb821-d7ab-4d9c-9d35-7413d5a3de95 admin admin] The token cache is being invalidate because project bdcd390685d94566a6d1db5719de111b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:58:18.346121 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-de2bb821-d7ab-4d9c-9d35-7413d5a3de95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:18.346788 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-de2bb821-d7ab-4d9c-9d35-7413d5a3de95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:18.348282 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1356/2709] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:58:18 2022] DELETE /identity/v3/projects/bdcd390685d94566a6d1db5719de111b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:18.353924 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08532e-ec42-4e1c-af5c-d1bd03a2bf5c None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:18.354437 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08532e-ec42-4e1c-af5c-d1bd03a2bf5c None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:18.354571 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08532e-ec42-4e1c-af5c-d1bd03a2bf5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:18.375377 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-1b08532e-ec42-4e1c-af5c-d1bd03a2bf5c None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:18.376594 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-1b08532e-ec42-4e1c-af5c-d1bd03a2bf5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:18.439743 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1354/2710] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:18.447925 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb6e25-b3ec-4de8-83f5-53354700e778 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:18.448213 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb6e25-b3ec-4de8-83f5-53354700e778 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:18.448556 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb6e25-b3ec-4de8-83f5-53354700e778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:18.468101 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-55cb6e25-b3ec-4de8-83f5-53354700e778 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:18.469341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-55cb6e25-b3ec-4de8-83f5-53354700e778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:18.478334 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1357/2711] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:18.482961 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08532e-ec42-4e1c-af5c-d1bd03a2bf5c None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:18.492303 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08532e-ec42-4e1c-af5c-d1bd03a2bf5c None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:18.497926 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c922d-da87-45c3-9c4d-2163af223baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:18.498521 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c922d-da87-45c3-9c4d-2163af223baf admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:18.498805 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c922d-da87-45c3-9c4d-2163af223baf admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:18.499078 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c922d-da87-45c3-9c4d-2163af223baf admin admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:18.499730 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c922d-da87-45c3-9c4d-2163af223baf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:58:18.500070 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c922d-da87-45c3-9c4d-2163af223baf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:18.501744 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c922d-da87-45c3-9c4d-2163af223baf admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:18.513695 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1355/2712] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:58:18.518074 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb6e25-b3ec-4de8-83f5-53354700e778 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:18.527893 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb6e25-b3ec-4de8-83f5-53354700e778 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:18.535015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1f4d8-ac48-47a9-a57e-87f611be635e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:18.535015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1f4d8-ac48-47a9-a57e-87f611be635e admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:18.535015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1f4d8-ac48-47a9-a57e-87f611be635e admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:18.535015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1f4d8-ac48-47a9-a57e-87f611be635e admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:18.535410 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd1f4d8-ac48-47a9-a57e-87f611be635e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:18.536502 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd1f4d8-ac48-47a9-a57e-87f611be635e admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:18.627865 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1358/2713] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:58:18 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:58:18.631701 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c922d-da87-45c3-9c4d-2163af223baf admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:18.642150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c922d-da87-45c3-9c4d-2163af223baf admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:18.701606 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244ffa3-59b7-4a16-9ccc-ea787ebd0504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:18.702214 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244ffa3-59b7-4a16-9ccc-ea787ebd0504 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:18.702498 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244ffa3-59b7-4a16-9ccc-ea787ebd0504 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:18.702775 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244ffa3-59b7-4a16-9ccc-ea787ebd0504 admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:18.703407 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244ffa3-59b7-4a16-9ccc-ea787ebd0504 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:18.705502 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244ffa3-59b7-4a16-9ccc-ea787ebd0504 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:18.780228 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1356/2714] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:58:18 2022] POST /identity/v3/users => generated 290 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:58:18.784594 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1f4d8-ac48-47a9-a57e-87f611be635e admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:18.791225 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:18.796709 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1f4d8-ac48-47a9-a57e-87f611be635e admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:18.801395 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c90905-f30a-44f6-85b6-8df7b4830e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:18.802123 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c90905-f30a-44f6-85b6-8df7b4830e29 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:18.802252 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c90905-f30a-44f6-85b6-8df7b4830e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:18.802525 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c90905-f30a-44f6-85b6-8df7b4830e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:18.803190 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c90905-f30a-44f6-85b6-8df7b4830e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:18.804769 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c90905-f30a-44f6-85b6-8df7b4830e29 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:18.815542 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1359/2715] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:58:18.819552 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244ffa3-59b7-4a16-9ccc-ea787ebd0504 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:18.829859 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244ffa3-59b7-4a16-9ccc-ea787ebd0504 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:18.834574 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e50b4-93ee-483f-bf7d-13ea630f9dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:18.835165 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e50b4-93ee-483f-bf7d-13ea630f9dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:18.835715 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e50b4-93ee-483f-bf7d-13ea630f9dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:18.835852 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e50b4-93ee-483f-bf7d-13ea630f9dd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:18.836932 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e50b4-93ee-483f-bf7d-13ea630f9dd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:18.838716 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e50b4-93ee-483f-bf7d-13ea630f9dd3 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:18.849638 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1357/2716] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:58:18.854997 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c90905-f30a-44f6-85b6-8df7b4830e29 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:18.864697 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c90905-f30a-44f6-85b6-8df7b4830e29 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:18.869769 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe51e7-462c-4c64-a8a8-57b48e971ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:18.870398 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe51e7-462c-4c64-a8a8-57b48e971ed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:18.870676 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe51e7-462c-4c64-a8a8-57b48e971ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:18.870944 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe51e7-462c-4c64-a8a8-57b48e971ed5 admin admin] PATH_INFO: `/v3/projects/ed0fa571ab314fadb9cb16c8904581d2/users/90a663a72c534996a7d8363b3ffebc9a/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:18.889238 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe51e7-462c-4c64-a8a8-57b48e971ed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed0fa571ab314fadb9cb16c8904581d2, user_id=90a663a72c534996a7d8363b3ffebc9a, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:18.892017 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe51e7-462c-4c64-a8a8-57b48e971ed5 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:18.965505 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1360/2717] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:58:18 2022] PUT /identity/v3/projects/ed0fa571ab314fadb9cb16c8904581d2/users/90a663a72c534996a7d8363b3ffebc9a/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:18.975654 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186816e-9e0a-458f-b2c6-89010b68e119 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:18.975943 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186816e-9e0a-458f-b2c6-89010b68e119 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:18.976221 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186816e-9e0a-458f-b2c6-89010b68e119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:19.005425 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-6186816e-9e0a-458f-b2c6-89010b68e119 None None] MFA Rules not processed for user `90a663a72c534996a7d8363b3ffebc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:19.006639 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-6186816e-9e0a-458f-b2c6-89010b68e119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:19.037094 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:19.072463 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1358/2718] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:58:19.077050 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe51e7-462c-4c64-a8a8-57b48e971ed5 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:19.138768 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe51e7-462c-4c64-a8a8-57b48e971ed5 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:19.143598 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37918035-feec-4b9a-8e6e-ca855b83b05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:19.144284 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37918035-feec-4b9a-8e6e-ca855b83b05f admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:19.144631 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37918035-feec-4b9a-8e6e-ca855b83b05f admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:19.144972 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37918035-feec-4b9a-8e6e-ca855b83b05f admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:19.145706 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37918035-feec-4b9a-8e6e-ca855b83b05f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:19.147801 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37918035-feec-4b9a-8e6e-ca855b83b05f admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:19.226620 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1361/2719] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:58:19 2022] POST /identity/v3/projects => generated 379 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:58:19.230826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186816e-9e0a-458f-b2c6-89010b68e119 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:19.241392 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186816e-9e0a-458f-b2c6-89010b68e119 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:19.303258 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730dc802-0b0f-4187-acf1-6e81fc2f71ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:19.305186 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730dc802-0b0f-4187-acf1-6e81fc2f71ab admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:19.305511 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730dc802-0b0f-4187-acf1-6e81fc2f71ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:19.305511 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730dc802-0b0f-4187-acf1-6e81fc2f71ab admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:19.306472 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730dc802-0b0f-4187-acf1-6e81fc2f71ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:19.311952 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730dc802-0b0f-4187-acf1-6e81fc2f71ab admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:19.386735 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1359/2720] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:58:19 2022] POST /identity/v3/users => generated 296 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:58:19.390791 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37918035-feec-4b9a-8e6e-ca855b83b05f admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:19.402576 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37918035-feec-4b9a-8e6e-ca855b83b05f admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:19.407232 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021cf39b-110f-4da7-a9df-839af77be257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:19.407829 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021cf39b-110f-4da7-a9df-839af77be257 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:19.408134 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021cf39b-110f-4da7-a9df-839af77be257 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:19.408399 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021cf39b-110f-4da7-a9df-839af77be257 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:19.409049 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021cf39b-110f-4da7-a9df-839af77be257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:19.410630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021cf39b-110f-4da7-a9df-839af77be257 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:19.421902 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1362/2721] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:58:19.426228 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730dc802-0b0f-4187-acf1-6e81fc2f71ab admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:19.437137 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730dc802-0b0f-4187-acf1-6e81fc2f71ab admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:19.441804 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178bf03-a49c-42f9-a6f8-c6246185508c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:19.442451 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178bf03-a49c-42f9-a6f8-c6246185508c admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:19.442753 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178bf03-a49c-42f9-a6f8-c6246185508c admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:19.443023 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178bf03-a49c-42f9-a6f8-c6246185508c admin admin] PATH_INFO: `/v3/projects/167510af90f14dba826a8f6574308e8a/users/15da5efd3afb48f1a2a41ffafccc2777/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:19.458541 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178bf03-a49c-42f9-a6f8-c6246185508c admin admin] RBAC: Authorizing `identity:create_grant(project_id=167510af90f14dba826a8f6574308e8a, user_id=15da5efd3afb48f1a2a41ffafccc2777, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:19.461253 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178bf03-a49c-42f9-a6f8-c6246185508c admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:19.551513 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1360/2722] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:58:19 2022] PUT /identity/v3/projects/167510af90f14dba826a8f6574308e8a/users/15da5efd3afb48f1a2a41ffafccc2777/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:19.555916 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021cf39b-110f-4da7-a9df-839af77be257 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:19.566231 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021cf39b-110f-4da7-a9df-839af77be257 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:19.625930 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ba6e4-6068-4926-8103-d667ccea8b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:19.626563 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ba6e4-6068-4926-8103-d667ccea8b2a admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:19.626839 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ba6e4-6068-4926-8103-d667ccea8b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:19.627108 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ba6e4-6068-4926-8103-d667ccea8b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:19.627768 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ba6e4-6068-4926-8103-d667ccea8b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:19.629382 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ba6e4-6068-4926-8103-d667ccea8b2a admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:19.640286 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1363/2723] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:58:19.644689 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178bf03-a49c-42f9-a6f8-c6246185508c admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:19.655950 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178bf03-a49c-42f9-a6f8-c6246185508c admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:19.660677 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519a255-2973-4445-900b-6dfb9a275428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:19.661349 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519a255-2973-4445-900b-6dfb9a275428 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:19.661629 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519a255-2973-4445-900b-6dfb9a275428 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:19.661898 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519a255-2973-4445-900b-6dfb9a275428 admin admin] PATH_INFO: `/v3/projects/167510af90f14dba826a8f6574308e8a/users/15da5efd3afb48f1a2a41ffafccc2777/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:19.663843 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519a255-2973-4445-900b-6dfb9a275428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=167510af90f14dba826a8f6574308e8a, user_id=15da5efd3afb48f1a2a41ffafccc2777, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:19.666547 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519a255-2973-4445-900b-6dfb9a275428 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:19.676873 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1361/2724] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:58:19 2022] PUT /identity/v3/projects/167510af90f14dba826a8f6574308e8a/users/15da5efd3afb48f1a2a41ffafccc2777/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:19.688485 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b4e09-20cf-4e5a-9c9d-2e062a5a3653 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:19.688776 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b4e09-20cf-4e5a-9c9d-2e062a5a3653 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:19.689050 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b4e09-20cf-4e5a-9c9d-2e062a5a3653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:19.717067 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-2c8b4e09-20cf-4e5a-9c9d-2e062a5a3653 None None] MFA Rules not processed for user `15da5efd3afb48f1a2a41ffafccc2777`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:19.718305 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-2c8b4e09-20cf-4e5a-9c9d-2e062a5a3653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:19.744863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:19.785160 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1364/2725] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:20.623623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519a255-2973-4445-900b-6dfb9a275428 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:20.625448 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-a519a255-2973-4445-900b-6dfb9a275428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:20.684143 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519a255-2973-4445-900b-6dfb9a275428 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:20.687992 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185e23f-2824-484f-97de-a9f5e2a4c3c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:20.688591 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185e23f-2824-484f-97de-a9f5e2a4c3c2 service cinder] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:20.688872 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185e23f-2824-484f-97de-a9f5e2a4c3c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:20.689182 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185e23f-2824-484f-97de-a9f5e2a4c3c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:20.690924 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-8185e23f-2824-484f-97de-a9f5e2a4c3c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:20.731737 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:20.750555 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185e23f-2824-484f-97de-a9f5e2a4c3c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:20.751919 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185e23f-2824-484f-97de-a9f5e2a4c3c2 service cinder] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:20.761284 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1362/2726] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:58:20 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:58:24.721211 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b4e09-20cf-4e5a-9c9d-2e062a5a3653 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:24.722635 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-2c8b4e09-20cf-4e5a-9c9d-2e062a5a3653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:24.761273 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185e23f-2824-484f-97de-a9f5e2a4c3c2 service cinder] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:24.762885 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-8185e23f-2824-484f-97de-a9f5e2a4c3c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:24.774498 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185e23f-2824-484f-97de-a9f5e2a4c3c2 service cinder] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:24.778424 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9410bbd-6164-462c-9ff3-fbd1e6052b63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:24.779300 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9410bbd-6164-462c-9ff3-fbd1e6052b63 service cinder] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:24.779589 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9410bbd-6164-462c-9ff3-fbd1e6052b63 service cinder] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:24.779911 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9410bbd-6164-462c-9ff3-fbd1e6052b63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:24.790032 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9410bbd-6164-462c-9ff3-fbd1e6052b63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:24.790194 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b4e09-20cf-4e5a-9c9d-2e062a5a3653 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:24.791490 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9410bbd-6164-462c-9ff3-fbd1e6052b63 service cinder] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:24.795358 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefefbd-af03-4f78-8ee3-ff2a6d157308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:24.795978 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefefbd-af03-4f78-8ee3-ff2a6d157308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:24.796278 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefefbd-af03-4f78-8ee3-ff2a6d157308 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:24.796545 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefefbd-af03-4f78-8ee3-ff2a6d157308 admin admin] PATH_INFO: `/v3/users/bbf4e40a31654f988ce0c891831e58df` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:24.797712 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccefefbd-af03-4f78-8ee3-ff2a6d157308 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbf4e40a31654f988ce0c891831e58df)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:24.799606 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccefefbd-af03-4f78-8ee3-ff2a6d157308 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:24.802120 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1363/2727] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:58:24 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:58:24.983115 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-ccefefbd-af03-4f78-8ee3-ff2a6d157308 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbf4e40a31654f988ce0c891831e58df'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:25.036168 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-ccefefbd-af03-4f78-8ee3-ff2a6d157308 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbf4e40a31654f988ce0c891831e58df'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:25.036808 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-ccefefbd-af03-4f78-8ee3-ff2a6d157308 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbf4e40a31654f988ce0c891831e58df'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:25.037442 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-ccefefbd-af03-4f78-8ee3-ff2a6d157308 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbf4e40a31654f988ce0c891831e58df'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:25.045383 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-ccefefbd-af03-4f78-8ee3-ff2a6d157308 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbf4e40a31654f988ce0c891831e58df'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:25.064996 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1365/2728] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:58:24 2022] DELETE /identity/v3/users/bbf4e40a31654f988ce0c891831e58df => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:25.069711 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bded1-fe9e-4347-8306-98fa3b70453c None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:25.069993 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bded1-fe9e-4347-8306-98fa3b70453c None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:25.070261 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bded1-fe9e-4347-8306-98fa3b70453c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:25.090334 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-e95bded1-fe9e-4347-8306-98fa3b70453c None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:25.090513 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-e95bded1-fe9e-4347-8306-98fa3b70453c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:25.150229 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1364/2729] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:25.160137 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefefbd-af03-4f78-8ee3-ff2a6d157308 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:25.161869 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-ccefefbd-af03-4f78-8ee3-ff2a6d157308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:25.208350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:25.220747 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefefbd-af03-4f78-8ee3-ff2a6d157308 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:25.224420 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacedfe8-d32c-461e-847c-bfd248073a0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:25.225012 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacedfe8-d32c-461e-847c-bfd248073a0c service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:25.225332 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacedfe8-d32c-461e-847c-bfd248073a0c service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:25.225603 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacedfe8-d32c-461e-847c-bfd248073a0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:25.235557 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacedfe8-d32c-461e-847c-bfd248073a0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:25.237000 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacedfe8-d32c-461e-847c-bfd248073a0c service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:25.246542 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1366/2730] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:58:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:58:25.661963 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95bded1-fe9e-4347-8306-98fa3b70453c None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:25.663895 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-e95bded1-fe9e-4347-8306-98fa3b70453c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:25.680727 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95bded1-fe9e-4347-8306-98fa3b70453c None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:25.686345 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192bb58-22c4-4d45-8a99-f1441a1b677a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:25.689063 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192bb58-22c4-4d45-8a99-f1441a1b677a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:25.689063 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192bb58-22c4-4d45-8a99-f1441a1b677a admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:25.689063 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192bb58-22c4-4d45-8a99-f1441a1b677a admin admin] PATH_INFO: `/v3/projects/1c7f3f3e978e43a0a4e4e92e36141038` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:25.689063 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192bb58-22c4-4d45-8a99-f1441a1b677a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c7f3f3e978e43a0a4e4e92e36141038)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:25.692126 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192bb58-22c4-4d45-8a99-f1441a1b677a admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:25.762757 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacedfe8-d32c-461e-847c-bfd248073a0c service neutron] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:25.762757 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-eacedfe8-d32c-461e-847c-bfd248073a0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:25.818461 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacedfe8-d32c-461e-847c-bfd248073a0c service neutron] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:25.823944 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-8192bb58-22c4-4d45-8a99-f1441a1b677a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c7f3f3e978e43a0a4e4e92e36141038', 'request_id': 'req-8192bb58-22c4-4d45-8a99-f1441a1b677a'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:25.831081 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-8192bb58-22c4-4d45-8a99-f1441a1b677a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c7f3f3e978e43a0a4e4e92e36141038', 'request_id': 'req-8192bb58-22c4-4d45-8a99-f1441a1b677a'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:25.881330 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c12e9-bdf1-42da-9893-f5df07e71dd9 tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15da5efd3afb48f1a2a41ffafccc2777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '167510af90f14dba826a8f6574308e8a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:25.884955 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c12e9-bdf1-42da-9893-f5df07e71dd9 tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:25.885272 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c12e9-bdf1-42da-9893-f5df07e71dd9 tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:25.885658 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c12e9-bdf1-42da-9893-f5df07e71dd9 tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:25.886387 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c12e9-bdf1-42da-9893-f5df07e71dd9 tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:58:25.886672 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c12e9-bdf1-42da-9893-f5df07e71dd9 tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:25.891805 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c12e9-bdf1-42da-9893-f5df07e71dd9 tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:25.893948 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-8192bb58-22c4-4d45-8a99-f1441a1b677a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c7f3f3e978e43a0a4e4e92e36141038', 'request_id': 'req-8192bb58-22c4-4d45-8a99-f1441a1b677a'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:25.907906 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1367/2731] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:58:25.911844 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-8192bb58-22c4-4d45-8a99-f1441a1b677a admin admin] The token cache is being invalidate because project 1c7f3f3e978e43a0a4e4e92e36141038 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:58:25.911844 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-8192bb58-22c4-4d45-8a99-f1441a1b677a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:25.911844 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-8192bb58-22c4-4d45-8a99-f1441a1b677a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:25.911844 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1365/2732] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:58:25 2022] DELETE /identity/v3/projects/1c7f3f3e978e43a0a4e4e92e36141038 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:25.912342 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c12e9-bdf1-42da-9893-f5df07e71dd9 tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:25.915135 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-c70c12e9-bdf1-42da-9893-f5df07e71dd9 tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:25.915311 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192bb58-22c4-4d45-8a99-f1441a1b677a admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:25.916676 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-8192bb58-22c4-4d45-8a99-f1441a1b677a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:25.928765 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c12e9-bdf1-42da-9893-f5df07e71dd9 tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:25.934209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293cdb1-3ba3-41e0-a688-3c6cbf3f7604 tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15da5efd3afb48f1a2a41ffafccc2777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '167510af90f14dba826a8f6574308e8a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:25.935260 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293cdb1-3ba3-41e0-a688-3c6cbf3f7604 tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:25.935574 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293cdb1-3ba3-41e0-a688-3c6cbf3f7604 tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:25.935841 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293cdb1-3ba3-41e0-a688-3c6cbf3f7604 tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:25.936475 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b293cdb1-3ba3-41e0-a688-3c6cbf3f7604 tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:25.938645 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b293cdb1-3ba3-41e0-a688-3c6cbf3f7604 tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:25.974427 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:25.989487 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192bb58-22c4-4d45-8a99-f1441a1b677a admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:25.994286 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796e711-b4f0-4da0-bc7e-201a0c597d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:25.994909 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796e711-b4f0-4da0-bc7e-201a0c597d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:25.995191 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796e711-b4f0-4da0-bc7e-201a0c597d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:25.995461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796e711-b4f0-4da0-bc7e-201a0c597d16 admin admin] PATH_INFO: `/v3/users/438d809e50a0440d90a7edaa791ad06c` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:25.996595 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796e711-b4f0-4da0-bc7e-201a0c597d16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=438d809e50a0440d90a7edaa791ad06c)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:25.998677 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796e711-b4f0-4da0-bc7e-201a0c597d16 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:26.038023 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1368/2733] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:58:25 2022] POST /identity/v3/projects => generated 354 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:58:26.042443 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293cdb1-3ba3-41e0-a688-3c6cbf3f7604 tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:26.105306 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293cdb1-3ba3-41e0-a688-3c6cbf3f7604 tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:26.111169 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eeb56c-41ce-4d88-9853-a2f83be2c4eb tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15da5efd3afb48f1a2a41ffafccc2777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '167510af90f14dba826a8f6574308e8a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:26.111767 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eeb56c-41ce-4d88-9853-a2f83be2c4eb tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:26.112075 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eeb56c-41ce-4d88-9853-a2f83be2c4eb tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:26.112353 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eeb56c-41ce-4d88-9853-a2f83be2c4eb tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:26.113005 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eeb56c-41ce-4d88-9853-a2f83be2c4eb tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:58:26.113345 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eeb56c-41ce-4d88-9853-a2f83be2c4eb tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:26.115157 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eeb56c-41ce-4d88-9853-a2f83be2c4eb tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:26.121822 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:26.127193 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1369/2734] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:58:26.164969 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eeb56c-41ce-4d88-9853-a2f83be2c4eb tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:26.175773 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eeb56c-41ce-4d88-9853-a2f83be2c4eb tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:26.180434 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2172a-5ef6-4a3f-838f-135c94d28955 tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15da5efd3afb48f1a2a41ffafccc2777', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '167510af90f14dba826a8f6574308e8a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:26.181052 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2172a-5ef6-4a3f-838f-135c94d28955 tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:26.181358 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2172a-5ef6-4a3f-838f-135c94d28955 tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:26.181630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2172a-5ef6-4a3f-838f-135c94d28955 tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] PATH_INFO: `/v3/projects/3e5819a5fc0041ccb209837fba6865aa` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:26.182747 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e2172a-5ef6-4a3f-838f-135c94d28955 tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3e5819a5fc0041ccb209837fba6865aa)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:26.184630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e2172a-5ef6-4a3f-838f-135c94d28955 tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:26.202660 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-1796e711-b4f0-4da0-bc7e-201a0c597d16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '438d809e50a0440d90a7edaa791ad06c'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:26.287570 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-1796e711-b4f0-4da0-bc7e-201a0c597d16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '438d809e50a0440d90a7edaa791ad06c'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:26.288188 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-1796e711-b4f0-4da0-bc7e-201a0c597d16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '438d809e50a0440d90a7edaa791ad06c'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:26.288825 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-1796e711-b4f0-4da0-bc7e-201a0c597d16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '438d809e50a0440d90a7edaa791ad06c'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:26.296771 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-1796e711-b4f0-4da0-bc7e-201a0c597d16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '438d809e50a0440d90a7edaa791ad06c'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:26.314035 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1366/2735] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:58:25 2022] DELETE /identity/v3/users/438d809e50a0440d90a7edaa791ad06c => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:58:26.340959 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-52e2172a-5ef6-4a3f-838f-135c94d28955 tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e5819a5fc0041ccb209837fba6865aa', 'request_id': 'req-52e2172a-5ef6-4a3f-838f-135c94d28955'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:26.347369 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-52e2172a-5ef6-4a3f-838f-135c94d28955 tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e5819a5fc0041ccb209837fba6865aa', 'request_id': 'req-52e2172a-5ef6-4a3f-838f-135c94d28955'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:26.442504 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-52e2172a-5ef6-4a3f-838f-135c94d28955 tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e5819a5fc0041ccb209837fba6865aa', 'request_id': 'req-52e2172a-5ef6-4a3f-838f-135c94d28955'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:26.455020 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-52e2172a-5ef6-4a3f-838f-135c94d28955 tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] The token cache is being invalidate because project 3e5819a5fc0041ccb209837fba6865aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:58:26.455302 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-52e2172a-5ef6-4a3f-838f-135c94d28955 tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:26.455940 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-52e2172a-5ef6-4a3f-838f-135c94d28955 tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:26.457474 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1370/2736] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:58:26 2022] DELETE /identity/v3/projects/3e5819a5fc0041ccb209837fba6865aa => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:58:26.753211 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796e711-b4f0-4da0-bc7e-201a0c597d16 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:26.754763 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-1796e711-b4f0-4da0-bc7e-201a0c597d16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:26.828925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796e711-b4f0-4da0-bc7e-201a0c597d16 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:26.886198 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07279d-f1f9-48ef-b1f7-a65b8647cf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:26.886914 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07279d-f1f9-48ef-b1f7-a65b8647cf28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:26.887193 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07279d-f1f9-48ef-b1f7-a65b8647cf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:26.887465 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07279d-f1f9-48ef-b1f7-a65b8647cf28 admin admin] PATH_INFO: `/v3/projects/c4568160439b4cd1800ce343915750df` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:26.889693 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad07279d-f1f9-48ef-b1f7-a65b8647cf28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4568160439b4cd1800ce343915750df)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:26.891616 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad07279d-f1f9-48ef-b1f7-a65b8647cf28 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:26.909195 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:26.992979 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-ad07279d-f1f9-48ef-b1f7-a65b8647cf28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4568160439b4cd1800ce343915750df', 'request_id': 'req-ad07279d-f1f9-48ef-b1f7-a65b8647cf28'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:26.999603 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-ad07279d-f1f9-48ef-b1f7-a65b8647cf28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4568160439b4cd1800ce343915750df', 'request_id': 'req-ad07279d-f1f9-48ef-b1f7-a65b8647cf28'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:27.053168 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2172a-5ef6-4a3f-838f-135c94d28955 tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:27.053656 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-ad07279d-f1f9-48ef-b1f7-a65b8647cf28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4568160439b4cd1800ce343915750df', 'request_id': 'req-ad07279d-f1f9-48ef-b1f7-a65b8647cf28'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:27.054777 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-52e2172a-5ef6-4a3f-838f-135c94d28955 tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:27.067441 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-ad07279d-f1f9-48ef-b1f7-a65b8647cf28 admin admin] The token cache is being invalidate because project c4568160439b4cd1800ce343915750df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:58:27.067781 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-ad07279d-f1f9-48ef-b1f7-a65b8647cf28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:27.068583 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-ad07279d-f1f9-48ef-b1f7-a65b8647cf28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:27.070360 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1367/2737] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:58:26 2022] DELETE /identity/v3/projects/c4568160439b4cd1800ce343915750df => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:27.070879 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2172a-5ef6-4a3f-838f-135c94d28955 tempest-VolumeQuotaClassesTest-592552582 tempest-VolumeQuotaClassesTest-592552582-project-admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:27.074247 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07279d-f1f9-48ef-b1f7-a65b8647cf28 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:27.078507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-ad07279d-f1f9-48ef-b1f7-a65b8647cf28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:27.130149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6ece1-6a73-4b1d-9cd0-be73a3702a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:27.130762 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6ece1-6a73-4b1d-9cd0-be73a3702a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:27.131047 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6ece1-6a73-4b1d-9cd0-be73a3702a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:27.131322 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6ece1-6a73-4b1d-9cd0-be73a3702a96 admin admin] PATH_INFO: `/v3/users/90a663a72c534996a7d8363b3ffebc9a` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:27.132568 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6ece1-6a73-4b1d-9cd0-be73a3702a96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90a663a72c534996a7d8363b3ffebc9a)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:27.134550 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6ece1-6a73-4b1d-9cd0-be73a3702a96 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:27.144677 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07279d-f1f9-48ef-b1f7-a65b8647cf28 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:27.149465 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17055a40-7bc6-46db-aba2-4d9f7dfc0588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:27.150091 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17055a40-7bc6-46db-aba2-4d9f7dfc0588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:27.150367 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17055a40-7bc6-46db-aba2-4d9f7dfc0588 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:27.150639 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17055a40-7bc6-46db-aba2-4d9f7dfc0588 admin admin] PATH_INFO: `/v3/users/5e8b6a317e764c378c68de4d39478d79` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:27.151809 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17055a40-7bc6-46db-aba2-4d9f7dfc0588 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e8b6a317e764c378c68de4d39478d79)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:27.153798 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17055a40-7bc6-46db-aba2-4d9f7dfc0588 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:27.261470 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-e4d6ece1-6a73-4b1d-9cd0-be73a3702a96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90a663a72c534996a7d8363b3ffebc9a'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:27.278309 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-17055a40-7bc6-46db-aba2-4d9f7dfc0588 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e8b6a317e764c378c68de4d39478d79'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:27.327630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-e4d6ece1-6a73-4b1d-9cd0-be73a3702a96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90a663a72c534996a7d8363b3ffebc9a'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:27.328254 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-e4d6ece1-6a73-4b1d-9cd0-be73a3702a96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90a663a72c534996a7d8363b3ffebc9a'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:27.328866 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-e4d6ece1-6a73-4b1d-9cd0-be73a3702a96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90a663a72c534996a7d8363b3ffebc9a'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:27.336499 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-e4d6ece1-6a73-4b1d-9cd0-be73a3702a96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90a663a72c534996a7d8363b3ffebc9a'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:27.350016 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:27.354396 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1371/2738] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:58:27 2022] DELETE /identity/v3/users/90a663a72c534996a7d8363b3ffebc9a => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:27.358797 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6ece1-6a73-4b1d-9cd0-be73a3702a96 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:27.358797 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-e4d6ece1-6a73-4b1d-9cd0-be73a3702a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:27.367937 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-17055a40-7bc6-46db-aba2-4d9f7dfc0588 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e8b6a317e764c378c68de4d39478d79'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:27.368669 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-17055a40-7bc6-46db-aba2-4d9f7dfc0588 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e8b6a317e764c378c68de4d39478d79'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:27.369361 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-17055a40-7bc6-46db-aba2-4d9f7dfc0588 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e8b6a317e764c378c68de4d39478d79'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:27.378249 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-17055a40-7bc6-46db-aba2-4d9f7dfc0588 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e8b6a317e764c378c68de4d39478d79'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:27.397375 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1368/2739] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:58:27 2022] DELETE /identity/v3/users/5e8b6a317e764c378c68de4d39478d79 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:58:27.401905 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d24b4c-2acf-465a-982f-4286f68b7d40 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:27.402259 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d24b4c-2acf-465a-982f-4286f68b7d40 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:27.402600 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d24b4c-2acf-465a-982f-4286f68b7d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:27.426700 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-83d24b4c-2acf-465a-982f-4286f68b7d40 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:27.427916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-83d24b4c-2acf-465a-982f-4286f68b7d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:27.431565 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6ece1-6a73-4b1d-9cd0-be73a3702a96 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:27.449114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:27.498378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1369/2740] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:27.501795 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413c3a5-cbe9-43ef-9896-c6902e53308e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:27.502347 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413c3a5-cbe9-43ef-9896-c6902e53308e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:27.502630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413c3a5-cbe9-43ef-9896-c6902e53308e admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:27.502898 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413c3a5-cbe9-43ef-9896-c6902e53308e admin admin] PATH_INFO: `/v3/users/e9110c348af540e5a871424ef10ad18b` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:27.504144 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413c3a5-cbe9-43ef-9896-c6902e53308e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9110c348af540e5a871424ef10ad18b)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:27.506166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413c3a5-cbe9-43ef-9896-c6902e53308e admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:27.511115 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d24b4c-2acf-465a-982f-4286f68b7d40 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:27.513021 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-83d24b4c-2acf-465a-982f-4286f68b7d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:27.572048 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d24b4c-2acf-465a-982f-4286f68b7d40 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:27.575825 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1516b-ecd4-4b05-b2a6-bc217181cbcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:27.576458 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1516b-ecd4-4b05-b2a6-bc217181cbcf service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:27.576739 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1516b-ecd4-4b05-b2a6-bc217181cbcf service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:27.577013 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1516b-ecd4-4b05-b2a6-bc217181cbcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:27.587407 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b1516b-ecd4-4b05-b2a6-bc217181cbcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:27.588930 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b1516b-ecd4-4b05-b2a6-bc217181cbcf service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:27.604002 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1370/2741] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:58:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:58:27.673166 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-7413c3a5-cbe9-43ef-9896-c6902e53308e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9110c348af540e5a871424ef10ad18b'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:27.722547 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-7413c3a5-cbe9-43ef-9896-c6902e53308e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9110c348af540e5a871424ef10ad18b'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:27.723183 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-7413c3a5-cbe9-43ef-9896-c6902e53308e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9110c348af540e5a871424ef10ad18b'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:27.723875 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-7413c3a5-cbe9-43ef-9896-c6902e53308e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9110c348af540e5a871424ef10ad18b'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:27.731206 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-7413c3a5-cbe9-43ef-9896-c6902e53308e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9110c348af540e5a871424ef10ad18b'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:27.750143 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1372/2742] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:58:27 2022] DELETE /identity/v3/users/e9110c348af540e5a871424ef10ad18b => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:27.754595 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e70fc-0eaa-4511-b98a-1b264dea65c6 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:27.754967 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e70fc-0eaa-4511-b98a-1b264dea65c6 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:27.755303 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e70fc-0eaa-4511-b98a-1b264dea65c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:27.775502 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-0a0e70fc-0eaa-4511-b98a-1b264dea65c6 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:27.776049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-0a0e70fc-0eaa-4511-b98a-1b264dea65c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:27.807227 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413c3a5-cbe9-43ef-9896-c6902e53308e admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:27.810688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-7413c3a5-cbe9-43ef-9896-c6902e53308e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:27.852470 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1371/2743] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:27.859499 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:27.865762 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e70fc-0eaa-4511-b98a-1b264dea65c6 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:27.867264 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-0a0e70fc-0eaa-4511-b98a-1b264dea65c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:27.900731 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413c3a5-cbe9-43ef-9896-c6902e53308e admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:27.907493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f87f09-cbed-4aa3-8716-17b27e7ac1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:27.908169 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f87f09-cbed-4aa3-8716-17b27e7ac1b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:27.908445 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f87f09-cbed-4aa3-8716-17b27e7ac1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:27.908716 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f87f09-cbed-4aa3-8716-17b27e7ac1b4 admin admin] PATH_INFO: `/v3/projects/8b7f0558783f43a98cddb229b6ce41af` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:27.909976 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f87f09-cbed-4aa3-8716-17b27e7ac1b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b7f0558783f43a98cddb229b6ce41af)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:27.912377 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f87f09-cbed-4aa3-8716-17b27e7ac1b4 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:27.939143 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e70fc-0eaa-4511-b98a-1b264dea65c6 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:27.943090 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9f943-048b-4305-9b28-405997c2f33d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:27.943731 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9f943-048b-4305-9b28-405997c2f33d service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:27.944004 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9f943-048b-4305-9b28-405997c2f33d service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:27.944272 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9f943-048b-4305-9b28-405997c2f33d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:27.954636 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9f943-048b-4305-9b28-405997c2f33d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:27.956094 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9f943-048b-4305-9b28-405997c2f33d service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:27.966121 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1372/2744] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:58:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:58:27.989795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9f943-048b-4305-9b28-405997c2f33d service neutron] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:27.999266 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-09e9f943-048b-4305-9b28-405997c2f33d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:28.014089 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-01f87f09-cbed-4aa3-8716-17b27e7ac1b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b7f0558783f43a98cddb229b6ce41af', 'request_id': 'req-01f87f09-cbed-4aa3-8716-17b27e7ac1b4'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:28.016956 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9f943-048b-4305-9b28-405997c2f33d service neutron] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:28.021616 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-01f87f09-cbed-4aa3-8716-17b27e7ac1b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b7f0558783f43a98cddb229b6ce41af', 'request_id': 'req-01f87f09-cbed-4aa3-8716-17b27e7ac1b4'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:28.029910 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:28.080902 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a0c0f-e126-4acf-8021-89cfee039fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:28.081580 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a0c0f-e126-4acf-8021-89cfee039fb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:28.081864 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a0c0f-e126-4acf-8021-89cfee039fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:28.082132 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a0c0f-e126-4acf-8021-89cfee039fb7 admin admin] PATH_INFO: `/v3/projects/ed0fa571ab314fadb9cb16c8904581d2` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:28.083251 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a0c0f-e126-4acf-8021-89cfee039fb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed0fa571ab314fadb9cb16c8904581d2)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:28.085262 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a0c0f-e126-4acf-8021-89cfee039fb7 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:28.093354 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-01f87f09-cbed-4aa3-8716-17b27e7ac1b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b7f0558783f43a98cddb229b6ce41af', 'request_id': 'req-01f87f09-cbed-4aa3-8716-17b27e7ac1b4'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:28.105294 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-01f87f09-cbed-4aa3-8716-17b27e7ac1b4 admin admin] The token cache is being invalidate because project 8b7f0558783f43a98cddb229b6ce41af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:58:28.105584 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-01f87f09-cbed-4aa3-8716-17b27e7ac1b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:28.106234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-01f87f09-cbed-4aa3-8716-17b27e7ac1b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:28.108600 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1373/2745] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:58:27 2022] DELETE /identity/v3/projects/8b7f0558783f43a98cddb229b6ce41af => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:58:28.114492 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5645b8-e052-49a6-b576-53595fe23fa0 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:28.114940 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5645b8-e052-49a6-b576-53595fe23fa0 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:28.115133 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5645b8-e052-49a6-b576-53595fe23fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:28.135358 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-9c5645b8-e052-49a6-b576-53595fe23fa0 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:28.136579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-9c5645b8-e052-49a6-b576-53595fe23fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:28.144894 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1374/2746] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:58:28.153324 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541cb36-d45e-4763-b1d6-5560857ab7b1 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:28.153651 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541cb36-d45e-4763-b1d6-5560857ab7b1 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:28.154112 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541cb36-d45e-4763-b1d6-5560857ab7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:28.176659 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-c541cb36-d45e-4763-b1d6-5560857ab7b1 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:28.178016 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-c541cb36-d45e-4763-b1d6-5560857ab7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:28.184109 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-d39a0c0f-e126-4acf-8021-89cfee039fb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed0fa571ab314fadb9cb16c8904581d2', 'request_id': 'req-d39a0c0f-e126-4acf-8021-89cfee039fb7'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:28.194317 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-d39a0c0f-e126-4acf-8021-89cfee039fb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed0fa571ab314fadb9cb16c8904581d2', 'request_id': 'req-d39a0c0f-e126-4acf-8021-89cfee039fb7'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:28.251614 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1375/2747] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:58:28.255736 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541cb36-d45e-4763-b1d6-5560857ab7b1 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:28.264926 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541cb36-d45e-4763-b1d6-5560857ab7b1 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:28.269966 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a19db4-3335-4dc1-967e-46629b6db086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:28.273220 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a19db4-3335-4dc1-967e-46629b6db086 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:28.273220 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a19db4-3335-4dc1-967e-46629b6db086 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:28.273220 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a19db4-3335-4dc1-967e-46629b6db086 admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:28.273220 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a19db4-3335-4dc1-967e-46629b6db086 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:58:28.273220 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a19db4-3335-4dc1-967e-46629b6db086 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:28.273796 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a19db4-3335-4dc1-967e-46629b6db086 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:28.286558 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1376/2748] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:58:28.288395 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-d39a0c0f-e126-4acf-8021-89cfee039fb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed0fa571ab314fadb9cb16c8904581d2', 'request_id': 'req-d39a0c0f-e126-4acf-8021-89cfee039fb7'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:28.293337 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a19db4-3335-4dc1-967e-46629b6db086 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:28.302944 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-d39a0c0f-e126-4acf-8021-89cfee039fb7 admin admin] The token cache is being invalidate because project ed0fa571ab314fadb9cb16c8904581d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:58:28.303236 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-d39a0c0f-e126-4acf-8021-89cfee039fb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:28.303988 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-d39a0c0f-e126-4acf-8021-89cfee039fb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:28.304900 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a19db4-3335-4dc1-967e-46629b6db086 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:28.305682 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1373/2749] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:58:27 2022] DELETE /identity/v3/projects/ed0fa571ab314fadb9cb16c8904581d2 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:28.322052 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a0c0f-e126-4acf-8021-89cfee039fb7 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:28.322223 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08caa526-ceef-4b49-a789-3a259533ac01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:28.322223 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08caa526-ceef-4b49-a789-3a259533ac01 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:28.322223 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08caa526-ceef-4b49-a789-3a259533ac01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:28.322500 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-d39a0c0f-e126-4acf-8021-89cfee039fb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:28.322592 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08caa526-ceef-4b49-a789-3a259533ac01 admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:28.322592 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08caa526-ceef-4b49-a789-3a259533ac01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:28.322592 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08caa526-ceef-4b49-a789-3a259533ac01 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:28.326477 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a0c0f-e126-4acf-8021-89cfee039fb7 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:28.332261 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b672bc4-6177-4861-a67e-2d1cc61da0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:28.332904 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b672bc4-6177-4861-a67e-2d1cc61da0a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:28.333227 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b672bc4-6177-4861-a67e-2d1cc61da0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:28.333500 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b672bc4-6177-4861-a67e-2d1cc61da0a7 admin admin] PATH_INFO: `/v3/users/15da5efd3afb48f1a2a41ffafccc2777` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:28.334668 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b672bc4-6177-4861-a67e-2d1cc61da0a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15da5efd3afb48f1a2a41ffafccc2777)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:28.336641 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b672bc4-6177-4861-a67e-2d1cc61da0a7 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:28.375353 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1377/2750] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:58:28 2022] POST /identity/v3/projects => generated 367 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:58:28.379546 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08caa526-ceef-4b49-a789-3a259533ac01 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:28.381183 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-08caa526-ceef-4b49-a789-3a259533ac01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:28.416621 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:28.457888 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08caa526-ceef-4b49-a789-3a259533ac01 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:28.462145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-8b672bc4-6177-4861-a67e-2d1cc61da0a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15da5efd3afb48f1a2a41ffafccc2777'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:28.462798 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67a573-4940-4e19-aab4-9a7103981e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:28.463400 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67a573-4940-4e19-aab4-9a7103981e7a admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:28.463724 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67a573-4940-4e19-aab4-9a7103981e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:28.463977 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67a573-4940-4e19-aab4-9a7103981e7a admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:28.464591 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67a573-4940-4e19-aab4-9a7103981e7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:28.468005 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67a573-4940-4e19-aab4-9a7103981e7a admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:28.505165 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-8b672bc4-6177-4861-a67e-2d1cc61da0a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15da5efd3afb48f1a2a41ffafccc2777'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:28.505811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-8b672bc4-6177-4861-a67e-2d1cc61da0a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15da5efd3afb48f1a2a41ffafccc2777'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:28.506464 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-8b672bc4-6177-4861-a67e-2d1cc61da0a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15da5efd3afb48f1a2a41ffafccc2777'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:28.513862 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-8b672bc4-6177-4861-a67e-2d1cc61da0a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15da5efd3afb48f1a2a41ffafccc2777'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:28.531868 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1374/2751] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:58:28 2022] DELETE /identity/v3/users/15da5efd3afb48f1a2a41ffafccc2777 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:58:28.532742 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b672bc4-6177-4861-a67e-2d1cc61da0a7 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:28.534037 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-8b672bc4-6177-4861-a67e-2d1cc61da0a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:28.543415 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1378/2752] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:58:28 2022] POST /identity/v3/users => generated 284 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:58:28.545405 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67a573-4940-4e19-aab4-9a7103981e7a admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:28.547934 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-cf67a573-4940-4e19-aab4-9a7103981e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:28.550560 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:28.563642 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67a573-4940-4e19-aab4-9a7103981e7a admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:28.608391 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b672bc4-6177-4861-a67e-2d1cc61da0a7 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:28.614154 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a5380-aee4-496c-a120-4c257fcfbbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:28.614781 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a5380-aee4-496c-a120-4c257fcfbbd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:28.615063 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a5380-aee4-496c-a120-4c257fcfbbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:28.615336 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a5380-aee4-496c-a120-4c257fcfbbd6 admin admin] PATH_INFO: `/v3/projects/938aa23c401444569cdc7ee8032a84cb` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:28.616668 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a5380-aee4-496c-a120-4c257fcfbbd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=938aa23c401444569cdc7ee8032a84cb)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:28.618727 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a5380-aee4-496c-a120-4c257fcfbbd6 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:28.628053 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077d900-908b-469c-b0bb-4054268649a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:28.628876 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077d900-908b-469c-b0bb-4054268649a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:28.629392 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077d900-908b-469c-b0bb-4054268649a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:28.629743 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077d900-908b-469c-b0bb-4054268649a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:28.630471 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077d900-908b-469c-b0bb-4054268649a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:28.632264 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077d900-908b-469c-b0bb-4054268649a1 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:28.645974 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1379/2753] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:58:28.647172 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077d900-908b-469c-b0bb-4054268649a1 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:28.657848 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077d900-908b-469c-b0bb-4054268649a1 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:28.662494 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec51318-732c-477e-94d0-a5f8f1f0aabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:28.663081 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec51318-732c-477e-94d0-a5f8f1f0aabf admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:28.666764 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec51318-732c-477e-94d0-a5f8f1f0aabf admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:28.666764 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec51318-732c-477e-94d0-a5f8f1f0aabf admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:28.666764 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec51318-732c-477e-94d0-a5f8f1f0aabf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:28.666764 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec51318-732c-477e-94d0-a5f8f1f0aabf admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:28.676878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1380/2754] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:58:28.681120 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec51318-732c-477e-94d0-a5f8f1f0aabf admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:28.692325 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec51318-732c-477e-94d0-a5f8f1f0aabf admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:28.697214 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f02c0-a359-4f43-9cbe-0293f2f5d389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:28.697872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f02c0-a359-4f43-9cbe-0293f2f5d389 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:28.698153 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f02c0-a359-4f43-9cbe-0293f2f5d389 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:28.698427 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f02c0-a359-4f43-9cbe-0293f2f5d389 admin admin] PATH_INFO: `/v3/projects/870c94e2a6bc4c55a566c9191ae68bb6/users/6d329ad6313447a8970e90effc042df9/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:28.715809 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f02c0-a359-4f43-9cbe-0293f2f5d389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=870c94e2a6bc4c55a566c9191ae68bb6, user_id=6d329ad6313447a8970e90effc042df9, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:28.718891 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f02c0-a359-4f43-9cbe-0293f2f5d389 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:28.732313 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-fa7a5380-aee4-496c-a120-4c257fcfbbd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '938aa23c401444569cdc7ee8032a84cb', 'request_id': 'req-fa7a5380-aee4-496c-a120-4c257fcfbbd6'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:28.738753 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-fa7a5380-aee4-496c-a120-4c257fcfbbd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '938aa23c401444569cdc7ee8032a84cb', 'request_id': 'req-fa7a5380-aee4-496c-a120-4c257fcfbbd6'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:28.824936 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-fa7a5380-aee4-496c-a120-4c257fcfbbd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '938aa23c401444569cdc7ee8032a84cb', 'request_id': 'req-fa7a5380-aee4-496c-a120-4c257fcfbbd6'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:28.840549 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1381/2755] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:58:28 2022] PUT /identity/v3/projects/870c94e2a6bc4c55a566c9191ae68bb6/users/6d329ad6313447a8970e90effc042df9/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:58:28.843520 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4bf69-3150-47f6-aea6-c0cc1a70583d None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:28.843803 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4bf69-3150-47f6-aea6-c0cc1a70583d None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:28.844078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4bf69-3150-47f6-aea6-c0cc1a70583d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:28.848806 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-fa7a5380-aee4-496c-a120-4c257fcfbbd6 admin admin] The token cache is being invalidate because project 938aa23c401444569cdc7ee8032a84cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:58:28.849409 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-fa7a5380-aee4-496c-a120-4c257fcfbbd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:28.850773 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-fa7a5380-aee4-496c-a120-4c257fcfbbd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:28.853532 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1375/2756] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:58:28 2022] DELETE /identity/v3/projects/938aa23c401444569cdc7ee8032a84cb => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:28.859152 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4988bc-8839-43ae-91f8-d629c4ae7d3f None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:28.859771 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4988bc-8839-43ae-91f8-d629c4ae7d3f None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:28.860270 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4988bc-8839-43ae-91f8-d629c4ae7d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:28.874896 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-94c4bf69-3150-47f6-aea6-c0cc1a70583d None None] MFA Rules not processed for user `6d329ad6313447a8970e90effc042df9`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:28.876176 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-94c4bf69-3150-47f6-aea6-c0cc1a70583d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:28.884821 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-7d4988bc-8839-43ae-91f8-d629c4ae7d3f None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:28.890092 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-7d4988bc-8839-43ae-91f8-d629c4ae7d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:28.939121 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:28.948214 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1382/2757] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:58:28.955936 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1376/2758] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:28.956219 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4bf69-3150-47f6-aea6-c0cc1a70583d None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:28.956219 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-94c4bf69-3150-47f6-aea6-c0cc1a70583d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:28.958913 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf492c6-9fef-40ac-a79c-f6dafd9d4506 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:28.959197 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf492c6-9fef-40ac-a79c-f6dafd9d4506 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:28.959495 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf492c6-9fef-40ac-a79c-f6dafd9d4506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:28.969157 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4bf69-3150-47f6-aea6-c0cc1a70583d None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:28.975254 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e62f2-16f1-43ab-8643-37a3341af413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:28.975923 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e62f2-16f1-43ab-8643-37a3341af413 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:28.976539 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e62f2-16f1-43ab-8643-37a3341af413 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:28.976817 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e62f2-16f1-43ab-8643-37a3341af413 admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:28.978779 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e62f2-16f1-43ab-8643-37a3341af413 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:28.980203 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-5bf492c6-9fef-40ac-a79c-f6dafd9d4506 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:28.981078 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e62f2-16f1-43ab-8643-37a3341af413 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:28.982418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-5bf492c6-9fef-40ac-a79c-f6dafd9d4506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:28.994077 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1377/2759] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:58:28.994077 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf492c6-9fef-40ac-a79c-f6dafd9d4506 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:28.994077 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-5bf492c6-9fef-40ac-a79c-f6dafd9d4506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:29.013909 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf492c6-9fef-40ac-a79c-f6dafd9d4506 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:29.016075 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c32be-b67e-47ed-8b5e-ead54b9ee0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:29.016698 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c32be-b67e-47ed-8b5e-ead54b9ee0da admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:29.016981 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c32be-b67e-47ed-8b5e-ead54b9ee0da admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:29.017281 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c32be-b67e-47ed-8b5e-ead54b9ee0da admin admin] PATH_INFO: `/v3/projects/167510af90f14dba826a8f6574308e8a` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:29.018465 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c32be-b67e-47ed-8b5e-ead54b9ee0da admin admin] RBAC: Authorizing `identity:delete_project(project_id=167510af90f14dba826a8f6574308e8a)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:29.020483 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c32be-b67e-47ed-8b5e-ead54b9ee0da admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:29.096115 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1383/2760] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:58:28 2022] POST /identity/v3/projects => generated 367 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:58:29.096887 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e62f2-16f1-43ab-8643-37a3341af413 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:29.116958 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:29.130095 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-b86c32be-b67e-47ed-8b5e-ead54b9ee0da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '167510af90f14dba826a8f6574308e8a', 'request_id': 'req-b86c32be-b67e-47ed-8b5e-ead54b9ee0da'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:29.135903 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-b86c32be-b67e-47ed-8b5e-ead54b9ee0da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '167510af90f14dba826a8f6574308e8a', 'request_id': 'req-b86c32be-b67e-47ed-8b5e-ead54b9ee0da'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:29.161584 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e62f2-16f1-43ab-8643-37a3341af413 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:29.184743 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-b86c32be-b67e-47ed-8b5e-ead54b9ee0da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '167510af90f14dba826a8f6574308e8a', 'request_id': 'req-b86c32be-b67e-47ed-8b5e-ead54b9ee0da'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:29.197703 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-b86c32be-b67e-47ed-8b5e-ead54b9ee0da admin admin] The token cache is being invalidate because project 167510af90f14dba826a8f6574308e8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:58:29.197991 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-b86c32be-b67e-47ed-8b5e-ead54b9ee0da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:29.198652 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-b86c32be-b67e-47ed-8b5e-ead54b9ee0da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:29.200168 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1378/2761] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:58:28 2022] DELETE /identity/v3/projects/167510af90f14dba826a8f6574308e8a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:29.200958 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c32be-b67e-47ed-8b5e-ead54b9ee0da admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:29.202337 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-b86c32be-b67e-47ed-8b5e-ead54b9ee0da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:29.220455 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede42d2-0d10-4bea-894e-079313d45995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:29.221150 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede42d2-0d10-4bea-894e-079313d45995 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:29.221456 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede42d2-0d10-4bea-894e-079313d45995 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:29.221727 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede42d2-0d10-4bea-894e-079313d45995 admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:29.222370 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede42d2-0d10-4bea-894e-079313d45995 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:58:29.222671 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede42d2-0d10-4bea-894e-079313d45995 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:29.224578 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede42d2-0d10-4bea-894e-079313d45995 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:29.236858 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1384/2762] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:58:29.238087 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e7705-7710-4f34-bbaf-13679f1970eb None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:29.238399 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e7705-7710-4f34-bbaf-13679f1970eb None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:29.238673 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e7705-7710-4f34-bbaf-13679f1970eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:29.258019 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-f68e7705-7710-4f34-bbaf-13679f1970eb None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:29.259214 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-f68e7705-7710-4f34-bbaf-13679f1970eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:29.267723 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1385/2763] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:29.267913 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c32be-b67e-47ed-8b5e-ead54b9ee0da admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:29.268270 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e7705-7710-4f34-bbaf-13679f1970eb None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:29.269514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-f68e7705-7710-4f34-bbaf-13679f1970eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:29.278223 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438974c-b966-4f2b-8489-07c1d2087ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:29.279423 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438974c-b966-4f2b-8489-07c1d2087ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:29.279693 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438974c-b966-4f2b-8489-07c1d2087ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:29.279975 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438974c-b966-4f2b-8489-07c1d2087ca2 admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:29.280605 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438974c-b966-4f2b-8489-07c1d2087ca2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:29.282149 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e7705-7710-4f34-bbaf-13679f1970eb None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:29.282603 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438974c-b966-4f2b-8489-07c1d2087ca2 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:29.286714 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22356b9-d764-450b-9367-f6863632578a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:29.287293 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22356b9-d764-450b-9367-f6863632578a admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:29.287569 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22356b9-d764-450b-9367-f6863632578a admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:29.287836 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22356b9-d764-450b-9367-f6863632578a admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:29.288446 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22356b9-d764-450b-9367-f6863632578a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:29.290403 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22356b9-d764-450b-9367-f6863632578a admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:29.357432 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1379/2764] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:58:29 2022] POST /identity/v3/users => generated 290 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:58:29.358675 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56874e02-10c6-4f39-8030-923a42357b6b None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:29.358964 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56874e02-10c6-4f39-8030-923a42357b6b None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:29.359240 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56874e02-10c6-4f39-8030-923a42357b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:29.367012 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1386/2765] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:58:29 2022] POST /identity/v3/projects => generated 397 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:58:29.368989 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22356b9-d764-450b-9367-f6863632578a admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:29.378910 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-56874e02-10c6-4f39-8030-923a42357b6b None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:29.380145 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-56874e02-10c6-4f39-8030-923a42357b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:29.423812 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:29.437972 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22356b9-d764-450b-9367-f6863632578a admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:29.442745 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327846b-1bda-4222-9dbd-a207b8c47708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:29.443019 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1380/2766] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:29.443349 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327846b-1bda-4222-9dbd-a207b8c47708 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:29.443630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327846b-1bda-4222-9dbd-a207b8c47708 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:29.443810 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56874e02-10c6-4f39-8030-923a42357b6b None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:29.443915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327846b-1bda-4222-9dbd-a207b8c47708 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:29.444529 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f327846b-1bda-4222-9dbd-a207b8c47708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:29.446151 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f327846b-1bda-4222-9dbd-a207b8c47708 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:29.456012 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56874e02-10c6-4f39-8030-923a42357b6b None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:29.462775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1387/2767] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:58:29.462775 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327846b-1bda-4222-9dbd-a207b8c47708 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:29.462994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7691ca6-856c-4a1f-a6b8-cb60421cf00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:29.462994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7691ca6-856c-4a1f-a6b8-cb60421cf00f admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:29.462994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7691ca6-856c-4a1f-a6b8-cb60421cf00f admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:29.463273 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7691ca6-856c-4a1f-a6b8-cb60421cf00f admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:29.463735 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7691ca6-856c-4a1f-a6b8-cb60421cf00f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:29.466736 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7691ca6-856c-4a1f-a6b8-cb60421cf00f admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:29.469861 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327846b-1bda-4222-9dbd-a207b8c47708 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:29.474392 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044b4c5-f7ca-4fb9-9b56-b381be5711a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:29.474968 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044b4c5-f7ca-4fb9-9b56-b381be5711a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:29.475244 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044b4c5-f7ca-4fb9-9b56-b381be5711a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:29.475514 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044b4c5-f7ca-4fb9-9b56-b381be5711a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:29.476151 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044b4c5-f7ca-4fb9-9b56-b381be5711a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:58:29.476448 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044b4c5-f7ca-4fb9-9b56-b381be5711a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:29.478065 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044b4c5-f7ca-4fb9-9b56-b381be5711a7 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:29.491211 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1388/2768] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:58:29.492101 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044b4c5-f7ca-4fb9-9b56-b381be5711a7 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:29.501607 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044b4c5-f7ca-4fb9-9b56-b381be5711a7 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:29.506667 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b998c-1887-4cd9-84d4-999b1262232b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:29.507280 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b998c-1887-4cd9-84d4-999b1262232b admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:29.507604 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b998c-1887-4cd9-84d4-999b1262232b admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:29.507885 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b998c-1887-4cd9-84d4-999b1262232b admin admin] PATH_INFO: `/v3/projects/fbdb37465b7644a38e1bdf19a544373e/users/c2709a6ccc384d2cacf568af2d295aa3/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:29.522941 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b998c-1887-4cd9-84d4-999b1262232b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbdb37465b7644a38e1bdf19a544373e, user_id=c2709a6ccc384d2cacf568af2d295aa3, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:29.525638 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b998c-1887-4cd9-84d4-999b1262232b admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:29.541079 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1381/2769] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:58:29 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:58:29.541079 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7691ca6-856c-4a1f-a6b8-cb60421cf00f admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:29.551790 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7691ca6-856c-4a1f-a6b8-cb60421cf00f admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:29.556694 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b2805-3b9a-4c12-ab9e-ee86457957b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:29.557330 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b2805-3b9a-4c12-ab9e-ee86457957b6 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:29.557616 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b2805-3b9a-4c12-ab9e-ee86457957b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:29.557890 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b2805-3b9a-4c12-ab9e-ee86457957b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:29.558571 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b2805-3b9a-4c12-ab9e-ee86457957b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:29.560767 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b2805-3b9a-4c12-ab9e-ee86457957b6 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:29.613924 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1389/2770] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:58:29 2022] PUT /identity/v3/projects/fbdb37465b7644a38e1bdf19a544373e/users/c2709a6ccc384d2cacf568af2d295aa3/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:29.614690 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b998c-1887-4cd9-84d4-999b1262232b admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:29.633180 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1382/2771] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:58:29 2022] POST /identity/v3/projects => generated 381 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:58:29.633180 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b2805-3b9a-4c12-ab9e-ee86457957b6 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:29.647814 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=87,keystone:DELETE=5,keystone:INSERT=8 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:29.677709 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b998c-1887-4cd9-84d4-999b1262232b admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:29.697996 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b2805-3b9a-4c12-ab9e-ee86457957b6 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:29.703439 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b47af9-e97e-48b7-bd45-f428efb121ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:29.704124 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b47af9-e97e-48b7-bd45-f428efb121ef admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:29.704795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b47af9-e97e-48b7-bd45-f428efb121ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:29.705355 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b47af9-e97e-48b7-bd45-f428efb121ef admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:29.706726 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b47af9-e97e-48b7-bd45-f428efb121ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:29.708388 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b47af9-e97e-48b7-bd45-f428efb121ef admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:29.719373 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1383/2772] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:58:29.720317 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b47af9-e97e-48b7-bd45-f428efb121ef admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:29.730286 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b47af9-e97e-48b7-bd45-f428efb121ef admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:29.736164 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99067dd8-51f8-4032-a559-91bed81e70da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:29.736745 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99067dd8-51f8-4032-a559-91bed81e70da admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:29.737047 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99067dd8-51f8-4032-a559-91bed81e70da admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:29.737392 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99067dd8-51f8-4032-a559-91bed81e70da admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:29.738017 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99067dd8-51f8-4032-a559-91bed81e70da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:29.739187 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c424fb-6f73-49f7-9b17-3f786655ae0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:29.739785 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c424fb-6f73-49f7-9b17-3f786655ae0d admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:29.739893 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99067dd8-51f8-4032-a559-91bed81e70da admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:29.740062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c424fb-6f73-49f7-9b17-3f786655ae0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:29.740335 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c424fb-6f73-49f7-9b17-3f786655ae0d admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:29.740964 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c424fb-6f73-49f7-9b17-3f786655ae0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:29.742554 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c424fb-6f73-49f7-9b17-3f786655ae0d admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:29.753006 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1390/2773] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:58:29.753953 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c424fb-6f73-49f7-9b17-3f786655ae0d admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:29.764177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c424fb-6f73-49f7-9b17-3f786655ae0d admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:29.769021 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046f767-2f46-4822-b7cc-7143445c330d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:29.769668 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046f767-2f46-4822-b7cc-7143445c330d admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:29.769952 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046f767-2f46-4822-b7cc-7143445c330d admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:29.770229 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046f767-2f46-4822-b7cc-7143445c330d admin admin] PATH_INFO: `/v3/projects/fbdb37465b7644a38e1bdf19a544373e/users/c2709a6ccc384d2cacf568af2d295aa3/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:29.772208 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046f767-2f46-4822-b7cc-7143445c330d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbdb37465b7644a38e1bdf19a544373e, user_id=c2709a6ccc384d2cacf568af2d295aa3, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:29.775028 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046f767-2f46-4822-b7cc-7143445c330d admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:29.785816 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1391/2774] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:58:29 2022] PUT /identity/v3/projects/fbdb37465b7644a38e1bdf19a544373e/users/c2709a6ccc384d2cacf568af2d295aa3/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:29.786648 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046f767-2f46-4822-b7cc-7143445c330d admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:29.808176 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1384/2775] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:58:29 2022] POST /identity/v3/users => generated 291 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:58:29.810292 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845edef-a5ea-4e0c-805d-849a657d4428 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:29.811020 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845edef-a5ea-4e0c-805d-849a657d4428 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:29.811303 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845edef-a5ea-4e0c-805d-849a657d4428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:29.830440 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:29.839765 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-6845edef-a5ea-4e0c-805d-849a657d4428 None None] MFA Rules not processed for user `c2709a6ccc384d2cacf568af2d295aa3`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:29.841806 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-6845edef-a5ea-4e0c-805d-849a657d4428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:29.853210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046f767-2f46-4822-b7cc-7143445c330d admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:29.857868 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f63175-76a6-4c83-bb54-42db897218a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:29.858472 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f63175-76a6-4c83-bb54-42db897218a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:29.858752 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f63175-76a6-4c83-bb54-42db897218a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:29.859029 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f63175-76a6-4c83-bb54-42db897218a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:29.859667 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f63175-76a6-4c83-bb54-42db897218a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:29.861303 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f63175-76a6-4c83-bb54-42db897218a7 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:29.871161 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1392/2776] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:58:29.871906 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f63175-76a6-4c83-bb54-42db897218a7 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:29.881806 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f63175-76a6-4c83-bb54-42db897218a7 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:29.886722 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095e701-5689-4ca4-b35f-892b2fc7e7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:29.887317 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095e701-5689-4ca4-b35f-892b2fc7e7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:29.888617 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095e701-5689-4ca4-b35f-892b2fc7e7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:29.889167 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095e701-5689-4ca4-b35f-892b2fc7e7d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:29.889989 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095e701-5689-4ca4-b35f-892b2fc7e7d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:29.892064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095e701-5689-4ca4-b35f-892b2fc7e7d0 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:29.901700 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1393/2777] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:58:29.907186 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095e701-5689-4ca4-b35f-892b2fc7e7d0 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:29.912108 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095e701-5689-4ca4-b35f-892b2fc7e7d0 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:29.917084 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1385/2778] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:29.917557 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963cbda4-b659-4118-85f9-e57350de345d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:29.917863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963cbda4-b659-4118-85f9-e57350de345d admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:29.918205 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845edef-a5ea-4e0c-805d-849a657d4428 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:29.918685 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963cbda4-b659-4118-85f9-e57350de345d admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:29.918965 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963cbda4-b659-4118-85f9-e57350de345d admin admin] PATH_INFO: `/v3/projects/4793d14234ee48ecb55720255710e1d7/users/f7a350ec368d4141a27bbd4eb4cf3752/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:29.929333 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845edef-a5ea-4e0c-805d-849a657d4428 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:29.933901 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddced0c-f5b7-4b1a-9018-68f52097300a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:29.934490 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddced0c-f5b7-4b1a-9018-68f52097300a admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:29.935220 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963cbda4-b659-4118-85f9-e57350de345d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4793d14234ee48ecb55720255710e1d7, user_id=f7a350ec368d4141a27bbd4eb4cf3752, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:29.935348 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddced0c-f5b7-4b1a-9018-68f52097300a admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:29.936178 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddced0c-f5b7-4b1a-9018-68f52097300a admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:29.936823 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddced0c-f5b7-4b1a-9018-68f52097300a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:29.938025 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963cbda4-b659-4118-85f9-e57350de345d admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:29.938435 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddced0c-f5b7-4b1a-9018-68f52097300a admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:29.948562 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1386/2779] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:58:29.949378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddced0c-f5b7-4b1a-9018-68f52097300a admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:29.952121 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-0ddced0c-f5b7-4b1a-9018-68f52097300a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:30.008177 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddced0c-f5b7-4b1a-9018-68f52097300a admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:30.014822 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1394/2780] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:58:29 2022] PUT /identity/v3/projects/4793d14234ee48ecb55720255710e1d7/users/f7a350ec368d4141a27bbd4eb4cf3752/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:30.015719 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963cbda4-b659-4118-85f9-e57350de345d admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:30.025541 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:30.058568 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52b0ce-eed7-46fd-b34b-62824aceebf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:30.059144 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52b0ce-eed7-46fd-b34b-62824aceebf2 service cinder] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:30.059421 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52b0ce-eed7-46fd-b34b-62824aceebf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:30.060231 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52b0ce-eed7-46fd-b34b-62824aceebf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:30.086961 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963cbda4-b659-4118-85f9-e57350de345d admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:30.092390 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300487b5-5e5f-406b-9851-d19ca461d055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:30.092859 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300487b5-5e5f-406b-9851-d19ca461d055 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:30.093172 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300487b5-5e5f-406b-9851-d19ca461d055 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:30.093452 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300487b5-5e5f-406b-9851-d19ca461d055 admin admin] PATH_INFO: `/v3/projects/b4772bc75f6e4450a4449379c9558afb/users/52f48a3239364061b5ee2fb37219b99f/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:30.108402 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300487b5-5e5f-406b-9851-d19ca461d055 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4772bc75f6e4450a4449379c9558afb, user_id=52f48a3239364061b5ee2fb37219b99f, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:30.111189 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300487b5-5e5f-406b-9851-d19ca461d055 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:30.125912 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52b0ce-eed7-46fd-b34b-62824aceebf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:30.125912 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52b0ce-eed7-46fd-b34b-62824aceebf2 service cinder] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:30.134772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1387/2781] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:58:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:58:30.135957 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603d7e0-1b2f-402a-9cf5-5f81c1acce87 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:30.136240 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603d7e0-1b2f-402a-9cf5-5f81c1acce87 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:30.136513 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603d7e0-1b2f-402a-9cf5-5f81c1acce87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:30.164797 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-a603d7e0-1b2f-402a-9cf5-5f81c1acce87 None None] MFA Rules not processed for user `f7a350ec368d4141a27bbd4eb4cf3752`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:30.166048 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-a603d7e0-1b2f-402a-9cf5-5f81c1acce87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:30.173890 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1395/2782] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:58:30 2022] PUT /identity/v3/projects/b4772bc75f6e4450a4449379c9558afb/users/52f48a3239364061b5ee2fb37219b99f/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:30.186044 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3badd-79b4-4fb3-a920-0a36954239c3 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:30.186379 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3badd-79b4-4fb3-a920-0a36954239c3 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:30.186666 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3badd-79b4-4fb3-a920-0a36954239c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:30.216916 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-5fa3badd-79b4-4fb3-a920-0a36954239c3 None None] MFA Rules not processed for user `52f48a3239364061b5ee2fb37219b99f`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:30.218308 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-5fa3badd-79b4-4fb3-a920-0a36954239c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:30.237881 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1388/2783] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:30 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:30.249942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603d7e0-1b2f-402a-9cf5-5f81c1acce87 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:30.251396 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-a603d7e0-1b2f-402a-9cf5-5f81c1acce87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:30.315136 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1396/2784] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:30.318450 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603d7e0-1b2f-402a-9cf5-5f81c1acce87 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:30.319842 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3badd-79b4-4fb3-a920-0a36954239c3 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:30.322212 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d5c4d-f680-49fa-a53d-e58619a9c497 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:30.322816 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d5c4d-f680-49fa-a53d-e58619a9c497 service cinder] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:30.323096 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d5c4d-f680-49fa-a53d-e58619a9c497 service cinder] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:30.323366 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d5c4d-f680-49fa-a53d-e58619a9c497 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:30.329548 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:30.333154 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d5c4d-f680-49fa-a53d-e58619a9c497 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:30.334623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d5c4d-f680-49fa-a53d-e58619a9c497 service cinder] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:30.344769 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1389/2785] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:58:30 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:58:30.383022 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d5c4d-f680-49fa-a53d-e58619a9c497 service cinder] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:30.389019 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3badd-79b4-4fb3-a920-0a36954239c3 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:30.389808 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:30.393337 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d5c4d-f680-49fa-a53d-e58619a9c497 service cinder] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:30.401126 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c5a19c-448c-4b91-974e-e4f89e700252 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:30.401783 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5a19c-448c-4b91-974e-e4f89e700252 service cinder] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:30.402014 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5a19c-448c-4b91-974e-e4f89e700252 service cinder] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:30.402565 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5a19c-448c-4b91-974e-e4f89e700252 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:30.402670 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363cc3a-83bf-49bf-ae4f-2e3fdc76e14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:30.403480 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363cc3a-83bf-49bf-ae4f-2e3fdc76e14e admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:30.404824 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363cc3a-83bf-49bf-ae4f-2e3fdc76e14e admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:30.405209 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363cc3a-83bf-49bf-ae4f-2e3fdc76e14e admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:30.405326 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-b1c5a19c-448c-4b91-974e-e4f89e700252 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:30.405983 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363cc3a-83bf-49bf-ae4f-2e3fdc76e14e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:30.408283 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363cc3a-83bf-49bf-ae4f-2e3fdc76e14e admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:30.487191 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c5a19c-448c-4b91-974e-e4f89e700252 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:30.487191 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c5a19c-448c-4b91-974e-e4f89e700252 service cinder] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:30.493891 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1390/2786] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:58:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:58:30.513963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1397/2787] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:58:30 2022] POST /identity/v3/projects => generated 383 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:58:30.518114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c5a19c-448c-4b91-974e-e4f89e700252 service cinder] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:30.531168 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c5a19c-448c-4b91-974e-e4f89e700252 service cinder] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:30.607783 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef1b51e-d464-4727-b81f-ac52c5d01b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:30.608512 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1b51e-d464-4727-b81f-ac52c5d01b14 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:30.609414 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1b51e-d464-4727-b81f-ac52c5d01b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:30.609414 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1b51e-d464-4727-b81f-ac52c5d01b14 admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:30.609747 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef1b51e-d464-4727-b81f-ac52c5d01b14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:30.612836 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef1b51e-d464-4727-b81f-ac52c5d01b14 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:30.715823 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1391/2788] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:58:30 2022] POST /identity/v3/users => generated 298 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:58:30.717520 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363cc3a-83bf-49bf-ae4f-2e3fdc76e14e admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:30.727710 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363cc3a-83bf-49bf-ae4f-2e3fdc76e14e admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:30.732457 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af2a2b-0d85-4878-a5df-eaa09c26fb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:30.733634 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af2a2b-0d85-4878-a5df-eaa09c26fb60 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:30.733634 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af2a2b-0d85-4878-a5df-eaa09c26fb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:30.733634 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af2a2b-0d85-4878-a5df-eaa09c26fb60 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:30.734285 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af2a2b-0d85-4878-a5df-eaa09c26fb60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:30.735872 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af2a2b-0d85-4878-a5df-eaa09c26fb60 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:30.746481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1398/2789] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:58:30.751324 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef1b51e-d464-4727-b81f-ac52c5d01b14 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:30.761558 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef1b51e-d464-4727-b81f-ac52c5d01b14 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:30.767276 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52a277-54c4-4914-a162-c3afee57e749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:30.773877 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52a277-54c4-4914-a162-c3afee57e749 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:30.773877 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52a277-54c4-4914-a162-c3afee57e749 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:30.773877 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52a277-54c4-4914-a162-c3afee57e749 admin admin] PATH_INFO: `/v3/projects/a46a0ed1d0994526a4eacad0eb73c050/users/d0d91c7d512d426cb0f8d11f7553de03/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:30.783708 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52a277-54c4-4914-a162-c3afee57e749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a46a0ed1d0994526a4eacad0eb73c050, user_id=d0d91c7d512d426cb0f8d11f7553de03, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:30.786407 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52a277-54c4-4914-a162-c3afee57e749 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:30.888459 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1392/2790] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:58:30 2022] PUT /identity/v3/projects/a46a0ed1d0994526a4eacad0eb73c050/users/d0d91c7d512d426cb0f8d11f7553de03/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:30.892468 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af2a2b-0d85-4878-a5df-eaa09c26fb60 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:30.902334 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af2a2b-0d85-4878-a5df-eaa09c26fb60 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:30.963088 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f23a1e-6671-4b71-a6f5-02dfecc0b6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:30.963685 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f23a1e-6671-4b71-a6f5-02dfecc0b6ad admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:30.963963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f23a1e-6671-4b71-a6f5-02dfecc0b6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:30.964232 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f23a1e-6671-4b71-a6f5-02dfecc0b6ad admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:30.964902 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f23a1e-6671-4b71-a6f5-02dfecc0b6ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:30.969742 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f23a1e-6671-4b71-a6f5-02dfecc0b6ad admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:30.978073 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1399/2791] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:58:30.982315 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52a277-54c4-4914-a162-c3afee57e749 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:30.993604 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52a277-54c4-4914-a162-c3afee57e749 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:30.998622 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f37086-e063-4f72-9b76-c4fa5e34198e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:30.999271 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f37086-e063-4f72-9b76-c4fa5e34198e admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:30.999552 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f37086-e063-4f72-9b76-c4fa5e34198e admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:30.999825 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f37086-e063-4f72-9b76-c4fa5e34198e admin admin] PATH_INFO: `/v3/projects/a46a0ed1d0994526a4eacad0eb73c050/users/d0d91c7d512d426cb0f8d11f7553de03/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:31.001789 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f37086-e063-4f72-9b76-c4fa5e34198e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a46a0ed1d0994526a4eacad0eb73c050, user_id=d0d91c7d512d426cb0f8d11f7553de03, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:31.004452 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f37086-e063-4f72-9b76-c4fa5e34198e admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:31.015577 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1393/2792] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:58:30 2022] PUT /identity/v3/projects/a46a0ed1d0994526a4eacad0eb73c050/users/d0d91c7d512d426cb0f8d11f7553de03/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:31.083059 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfcf73-df78-435a-9381-d09d590e0f7a None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:31.083355 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfcf73-df78-435a-9381-d09d590e0f7a None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:31.083635 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfcf73-df78-435a-9381-d09d590e0f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:31.112710 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-d8cfcf73-df78-435a-9381-d09d590e0f7a None None] MFA Rules not processed for user `d0d91c7d512d426cb0f8d11f7553de03`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:31.113965 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-d8cfcf73-df78-435a-9381-d09d590e0f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:31.202189 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1400/2793] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:31 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:31.214886 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f37086-e063-4f72-9b76-c4fa5e34198e admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:31.274404 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f37086-e063-4f72-9b76-c4fa5e34198e admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:31.278225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b060147-3614-434d-9156-89a67592c3a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:31.279836 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b060147-3614-434d-9156-89a67592c3a0 service cinder] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:31.280117 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b060147-3614-434d-9156-89a67592c3a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:31.280392 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b060147-3614-434d-9156-89a67592c3a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:31.289161 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:31.291553 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b060147-3614-434d-9156-89a67592c3a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:31.293164 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b060147-3614-434d-9156-89a67592c3a0 service cinder] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:31.303117 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1394/2794] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:58:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:58:31.409966 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfcf73-df78-435a-9381-d09d590e0f7a None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:31.416137 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:31.420433 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfcf73-df78-435a-9381-d09d590e0f7a None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:31.424011 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0bf02-8fc9-442c-a1bf-b7ccd41a9cb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:31.424607 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0bf02-8fc9-442c-a1bf-b7ccd41a9cb1 service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:31.424886 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0bf02-8fc9-442c-a1bf-b7ccd41a9cb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:31.425181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0bf02-8fc9-442c-a1bf-b7ccd41a9cb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:31.483201 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0bf02-8fc9-442c-a1bf-b7ccd41a9cb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:31.484632 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0bf02-8fc9-442c-a1bf-b7ccd41a9cb1 service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:31.493689 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1401/2795] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:58:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:58:34.479320 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b060147-3614-434d-9156-89a67592c3a0 service cinder] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:34.544504 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b060147-3614-434d-9156-89a67592c3a0 service cinder] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:34.549336 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4335aa-4110-428e-96a4-66a2879b90ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:34.549993 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4335aa-4110-428e-96a4-66a2879b90ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:34.553471 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4335aa-4110-428e-96a4-66a2879b90ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:34.553471 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4335aa-4110-428e-96a4-66a2879b90ae admin admin] PATH_INFO: `/v3/users/52f48a3239364061b5ee2fb37219b99f` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:34.553471 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4335aa-4110-428e-96a4-66a2879b90ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=52f48a3239364061b5ee2fb37219b99f)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:34.553755 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4335aa-4110-428e-96a4-66a2879b90ae admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:34.753970 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-5f4335aa-4110-428e-96a4-66a2879b90ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52f48a3239364061b5ee2fb37219b99f'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:34.807591 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-5f4335aa-4110-428e-96a4-66a2879b90ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52f48a3239364061b5ee2fb37219b99f'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:34.808383 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-5f4335aa-4110-428e-96a4-66a2879b90ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52f48a3239364061b5ee2fb37219b99f'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:34.808948 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-5f4335aa-4110-428e-96a4-66a2879b90ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52f48a3239364061b5ee2fb37219b99f'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:34.817055 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-5f4335aa-4110-428e-96a4-66a2879b90ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52f48a3239364061b5ee2fb37219b99f'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:34.835013 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1395/2796] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:58:34 2022] DELETE /identity/v3/users/52f48a3239364061b5ee2fb37219b99f => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:58:34.839554 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76a0bd-553e-40f0-a89a-2727df6bbe90 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:34.840020 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76a0bd-553e-40f0-a89a-2727df6bbe90 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:34.840399 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76a0bd-553e-40f0-a89a-2727df6bbe90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:34.859940 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-eb76a0bd-553e-40f0-a89a-2727df6bbe90 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:34.861178 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-eb76a0bd-553e-40f0-a89a-2727df6bbe90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:34.922596 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1402/2797] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:58:34.932410 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4335aa-4110-428e-96a4-66a2879b90ae admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:34.934150 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-5f4335aa-4110-428e-96a4-66a2879b90ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:34.999752 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4335aa-4110-428e-96a4-66a2879b90ae admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:35.001442 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa83155-68d6-46f9-9a1e-240e9ac8cc4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:35.002048 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa83155-68d6-46f9-9a1e-240e9ac8cc4d service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:35.002332 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa83155-68d6-46f9-9a1e-240e9ac8cc4d service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:35.002608 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa83155-68d6-46f9-9a1e-240e9ac8cc4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:35.011933 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa83155-68d6-46f9-9a1e-240e9ac8cc4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:35.013394 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa83155-68d6-46f9-9a1e-240e9ac8cc4d service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:35.028930 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1396/2798] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:58:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:58:35.414489 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76a0bd-553e-40f0-a89a-2727df6bbe90 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:35.417157 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-eb76a0bd-553e-40f0-a89a-2727df6bbe90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:35.433541 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76a0bd-553e-40f0-a89a-2727df6bbe90 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:35.440084 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78fdbc-e0e6-4df4-90df-248de261bc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:35.440528 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78fdbc-e0e6-4df4-90df-248de261bc88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:35.440897 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78fdbc-e0e6-4df4-90df-248de261bc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:35.441211 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78fdbc-e0e6-4df4-90df-248de261bc88 admin admin] PATH_INFO: `/v3/projects/b4772bc75f6e4450a4449379c9558afb` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:35.442369 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78fdbc-e0e6-4df4-90df-248de261bc88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4772bc75f6e4450a4449379c9558afb)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:35.444287 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78fdbc-e0e6-4df4-90df-248de261bc88 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:35.579999 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-ca78fdbc-e0e6-4df4-90df-248de261bc88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4772bc75f6e4450a4449379c9558afb', 'request_id': 'req-ca78fdbc-e0e6-4df4-90df-248de261bc88'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:35.585430 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-ca78fdbc-e0e6-4df4-90df-248de261bc88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4772bc75f6e4450a4449379c9558afb', 'request_id': 'req-ca78fdbc-e0e6-4df4-90df-248de261bc88'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:35.676126 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-ca78fdbc-e0e6-4df4-90df-248de261bc88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4772bc75f6e4450a4449379c9558afb', 'request_id': 'req-ca78fdbc-e0e6-4df4-90df-248de261bc88'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:35.700537 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-ca78fdbc-e0e6-4df4-90df-248de261bc88 admin admin] The token cache is being invalidate because project b4772bc75f6e4450a4449379c9558afb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:58:35.700829 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-ca78fdbc-e0e6-4df4-90df-248de261bc88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:35.701509 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-ca78fdbc-e0e6-4df4-90df-248de261bc88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:35.702995 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1403/2799] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:58:35 2022] DELETE /identity/v3/projects/b4772bc75f6e4450a4449379c9558afb => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:35.707141 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa83155-68d6-46f9-9a1e-240e9ac8cc4d service neutron] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:35.725283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:35.760976 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa83155-68d6-46f9-9a1e-240e9ac8cc4d service neutron] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:35.818201 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c1153-fb78-44f5-8ce7-d805befd566c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:35.818744 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c1153-fb78-44f5-8ce7-d805befd566c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:35.819023 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c1153-fb78-44f5-8ce7-d805befd566c admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:35.819293 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c1153-fb78-44f5-8ce7-d805befd566c admin admin] PATH_INFO: `/v3/users/d0d91c7d512d426cb0f8d11f7553de03` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:35.820465 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c1153-fb78-44f5-8ce7-d805befd566c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0d91c7d512d426cb0f8d11f7553de03)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:35.822418 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c1153-fb78-44f5-8ce7-d805befd566c admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:35.952712 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-9f6c1153-fb78-44f5-8ce7-d805befd566c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0d91c7d512d426cb0f8d11f7553de03'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:35.990227 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-9f6c1153-fb78-44f5-8ce7-d805befd566c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0d91c7d512d426cb0f8d11f7553de03'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:35.990841 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-9f6c1153-fb78-44f5-8ce7-d805befd566c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0d91c7d512d426cb0f8d11f7553de03'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:35.991440 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-9f6c1153-fb78-44f5-8ce7-d805befd566c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0d91c7d512d426cb0f8d11f7553de03'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:35.999590 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-9f6c1153-fb78-44f5-8ce7-d805befd566c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0d91c7d512d426cb0f8d11f7553de03'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:36.018345 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1397/2800] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:58:35 2022] DELETE /identity/v3/users/d0d91c7d512d426cb0f8d11f7553de03 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:36.200630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78fdbc-e0e6-4df4-90df-248de261bc88 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:36.202839 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-ca78fdbc-e0e6-4df4-90df-248de261bc88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:36.223977 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:36.265220 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78fdbc-e0e6-4df4-90df-248de261bc88 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:36.326792 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef284cd6-1ac8-43f9-a56c-79c3d8a96e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:36.327557 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef284cd6-1ac8-43f9-a56c-79c3d8a96e50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:36.327863 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef284cd6-1ac8-43f9-a56c-79c3d8a96e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:36.328135 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef284cd6-1ac8-43f9-a56c-79c3d8a96e50 admin admin] PATH_INFO: `/v3/users/f7a350ec368d4141a27bbd4eb4cf3752` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:36.329354 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef284cd6-1ac8-43f9-a56c-79c3d8a96e50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7a350ec368d4141a27bbd4eb4cf3752)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:36.331278 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef284cd6-1ac8-43f9-a56c-79c3d8a96e50 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:36.422046 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c1153-fb78-44f5-8ce7-d805befd566c admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:36.422046 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-9f6c1153-fb78-44f5-8ce7-d805befd566c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:36.435610 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c1153-fb78-44f5-8ce7-d805befd566c admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:36.455479 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0250a-7687-476c-8160-b9feb07ee330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:36.456159 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0250a-7687-476c-8160-b9feb07ee330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:36.456363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0250a-7687-476c-8160-b9feb07ee330 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:36.456665 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0250a-7687-476c-8160-b9feb07ee330 admin admin] PATH_INFO: `/v3/projects/a46a0ed1d0994526a4eacad0eb73c050` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:36.458330 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0250a-7687-476c-8160-b9feb07ee330 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a46a0ed1d0994526a4eacad0eb73c050)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:36.460686 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0250a-7687-476c-8160-b9feb07ee330 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:36.502276 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-ef284cd6-1ac8-43f9-a56c-79c3d8a96e50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7a350ec368d4141a27bbd4eb4cf3752'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:36.591243 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-ef284cd6-1ac8-43f9-a56c-79c3d8a96e50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7a350ec368d4141a27bbd4eb4cf3752'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:36.592643 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-ef284cd6-1ac8-43f9-a56c-79c3d8a96e50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7a350ec368d4141a27bbd4eb4cf3752'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:36.595487 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-ef284cd6-1ac8-43f9-a56c-79c3d8a96e50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7a350ec368d4141a27bbd4eb4cf3752'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:36.601890 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-ef284cd6-1ac8-43f9-a56c-79c3d8a96e50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7a350ec368d4141a27bbd4eb4cf3752'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:36.615444 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-35d0250a-7687-476c-8160-b9feb07ee330 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a46a0ed1d0994526a4eacad0eb73c050', 'request_id': 'req-35d0250a-7687-476c-8160-b9feb07ee330'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:36.618652 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:36.624598 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-35d0250a-7687-476c-8160-b9feb07ee330 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a46a0ed1d0994526a4eacad0eb73c050', 'request_id': 'req-35d0250a-7687-476c-8160-b9feb07ee330'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:36.625104 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1404/2801] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:58:36 2022] DELETE /identity/v3/users/f7a350ec368d4141a27bbd4eb4cf3752 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:36.629247 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed868ac-2020-4cdf-b892-b0332b1b52f9 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:36.629545 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed868ac-2020-4cdf-b892-b0332b1b52f9 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:36.629868 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed868ac-2020-4cdf-b892-b0332b1b52f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:36.659008 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-8ed868ac-2020-4cdf-b892-b0332b1b52f9 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:36.660120 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-8ed868ac-2020-4cdf-b892-b0332b1b52f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:36.702567 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:36.720284 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1405/2802] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:58:36.727775 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-35d0250a-7687-476c-8160-b9feb07ee330 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a46a0ed1d0994526a4eacad0eb73c050', 'request_id': 'req-35d0250a-7687-476c-8160-b9feb07ee330'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:36.733248 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed868ac-2020-4cdf-b892-b0332b1b52f9 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:36.734684 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-8ed868ac-2020-4cdf-b892-b0332b1b52f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:36.747339 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-35d0250a-7687-476c-8160-b9feb07ee330 admin admin] The token cache is being invalidate because project a46a0ed1d0994526a4eacad0eb73c050 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:58:36.747645 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-35d0250a-7687-476c-8160-b9feb07ee330 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:36.749020 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-35d0250a-7687-476c-8160-b9feb07ee330 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:36.754649 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1398/2803] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:58:36 2022] DELETE /identity/v3/projects/a46a0ed1d0994526a4eacad0eb73c050 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:58:36.756118 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0250a-7687-476c-8160-b9feb07ee330 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:36.759564 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-35d0250a-7687-476c-8160-b9feb07ee330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:36.816896 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed868ac-2020-4cdf-b892-b0332b1b52f9 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:36.820822 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9897c-573c-4fcc-b733-236565189f7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:36.821489 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9897c-573c-4fcc-b733-236565189f7c service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:36.821774 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9897c-573c-4fcc-b733-236565189f7c service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:36.822051 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9897c-573c-4fcc-b733-236565189f7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:36.823828 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-a7b9897c-573c-4fcc-b733-236565189f7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:36.828735 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0250a-7687-476c-8160-b9feb07ee330 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:36.833893 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00433a8a-35ad-4415-84aa-e05f7cf1e103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:36.834530 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00433a8a-35ad-4415-84aa-e05f7cf1e103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:36.835873 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00433a8a-35ad-4415-84aa-e05f7cf1e103 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:36.835873 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00433a8a-35ad-4415-84aa-e05f7cf1e103 admin admin] PATH_INFO: `/v3/users/6d329ad6313447a8970e90effc042df9` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:36.836670 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00433a8a-35ad-4415-84aa-e05f7cf1e103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d329ad6313447a8970e90effc042df9)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:36.837669 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b9897c-573c-4fcc-b733-236565189f7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:36.838631 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00433a8a-35ad-4415-84aa-e05f7cf1e103 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:36.839091 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b9897c-573c-4fcc-b733-236565189f7c service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:36.849387 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1406/2804] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:58:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:58:36.850447 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbc632-6342-402a-b222-248329453571 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:36.850750 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbc632-6342-402a-b222-248329453571 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:36.851000 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbc632-6342-402a-b222-248329453571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:36.903282 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-c6bbc632-6342-402a-b222-248329453571 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:36.904651 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-c6bbc632-6342-402a-b222-248329453571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:36.915196 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1407/2805] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:36.923795 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11bb0e-7757-4879-b114-f8f5071d943a None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:36.924161 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11bb0e-7757-4879-b114-f8f5071d943a None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:36.924438 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11bb0e-7757-4879-b114-f8f5071d943a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:36.944284 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-9f11bb0e-7757-4879-b114-f8f5071d943a None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:36.945541 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-9f11bb0e-7757-4879-b114-f8f5071d943a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:36.953841 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1408/2806] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:36.957908 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11bb0e-7757-4879-b114-f8f5071d943a None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:36.967134 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11bb0e-7757-4879-b114-f8f5071d943a None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:36.972197 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1535965-e075-4aea-9748-0880d6381caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:36.972785 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1535965-e075-4aea-9748-0880d6381caf admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:36.973094 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1535965-e075-4aea-9748-0880d6381caf admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:36.973369 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1535965-e075-4aea-9748-0880d6381caf admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:36.974013 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1535965-e075-4aea-9748-0880d6381caf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:58:36.974312 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1535965-e075-4aea-9748-0880d6381caf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:36.975910 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1535965-e075-4aea-9748-0880d6381caf admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:36.983893 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-00433a8a-35ad-4415-84aa-e05f7cf1e103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d329ad6313447a8970e90effc042df9'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:36.988728 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1409/2807] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:58:36.993161 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1535965-e075-4aea-9748-0880d6381caf admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:37.004281 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1535965-e075-4aea-9748-0880d6381caf admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:37.009255 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1af4a-03ac-43cc-9cd9-a1449480119c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:37.010052 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1af4a-03ac-43cc-9cd9-a1449480119c admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:37.010332 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1af4a-03ac-43cc-9cd9-a1449480119c admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:37.010603 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1af4a-03ac-43cc-9cd9-a1449480119c admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:37.011221 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b1af4a-03ac-43cc-9cd9-a1449480119c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:37.013428 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b1af4a-03ac-43cc-9cd9-a1449480119c admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:37.036500 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-00433a8a-35ad-4415-84aa-e05f7cf1e103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d329ad6313447a8970e90effc042df9'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:37.037462 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-00433a8a-35ad-4415-84aa-e05f7cf1e103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d329ad6313447a8970e90effc042df9'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:37.038391 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-00433a8a-35ad-4415-84aa-e05f7cf1e103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d329ad6313447a8970e90effc042df9'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:37.047754 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-00433a8a-35ad-4415-84aa-e05f7cf1e103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d329ad6313447a8970e90effc042df9'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:37.067523 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1399/2808] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:58:36 2022] DELETE /identity/v3/users/6d329ad6313447a8970e90effc042df9 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:37.071751 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02352f-691b-4d0d-b8f4-0b4470264906 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:37.072128 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02352f-691b-4d0d-b8f4-0b4470264906 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:37.072466 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02352f-691b-4d0d-b8f4-0b4470264906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:37.091883 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-2e02352f-691b-4d0d-b8f4-0b4470264906 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:37.093438 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-2e02352f-691b-4d0d-b8f4-0b4470264906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:37.097318 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1410/2809] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:58:36 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:58:37.101362 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1af4a-03ac-43cc-9cd9-a1449480119c admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:37.103458 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-b8b1af4a-03ac-43cc-9cd9-a1449480119c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:37.150400 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:37.159094 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1400/2810] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:37.171667 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02352f-691b-4d0d-b8f4-0b4470264906 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:37.172984 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-2e02352f-691b-4d0d-b8f4-0b4470264906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:37.181187 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1af4a-03ac-43cc-9cd9-a1449480119c admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:37.186476 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6c973-168d-4d38-a22d-696888b7e4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:37.187089 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6c973-168d-4d38-a22d-696888b7e4fd admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:37.187373 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6c973-168d-4d38-a22d-696888b7e4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:37.187651 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6c973-168d-4d38-a22d-696888b7e4fd admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:37.188278 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6c973-168d-4d38-a22d-696888b7e4fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:37.190321 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6c973-168d-4d38-a22d-696888b7e4fd admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:37.199244 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:37.234571 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02352f-691b-4d0d-b8f4-0b4470264906 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:37.284004 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b11003-9542-40c0-ba66-9ce9b517d815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:37.284156 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b11003-9542-40c0-ba66-9ce9b517d815 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:37.284414 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b11003-9542-40c0-ba66-9ce9b517d815 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:37.284689 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b11003-9542-40c0-ba66-9ce9b517d815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:37.295666 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b11003-9542-40c0-ba66-9ce9b517d815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:37.297148 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b11003-9542-40c0-ba66-9ce9b517d815 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:37.304875 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1411/2811] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:58:37 2022] POST /identity/v3/users => generated 294 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:58:37.304875 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6c973-168d-4d38-a22d-696888b7e4fd admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:37.306043 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-84e6c973-168d-4d38-a22d-696888b7e4fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:37.310630 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1401/2812] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:58:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:58:37.311375 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b11003-9542-40c0-ba66-9ce9b517d815 service neutron] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:37.319568 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6c973-168d-4d38-a22d-696888b7e4fd admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:37.324244 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b11003-9542-40c0-ba66-9ce9b517d815 service neutron] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:37.325637 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a76b32-470a-4e97-adeb-368a6d0f4145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:37.326316 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a76b32-470a-4e97-adeb-368a6d0f4145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:37.326646 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a76b32-470a-4e97-adeb-368a6d0f4145 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:37.326928 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a76b32-470a-4e97-adeb-368a6d0f4145 admin admin] PATH_INFO: `/v3/projects/4793d14234ee48ecb55720255710e1d7` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:37.333018 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a76b32-470a-4e97-adeb-368a6d0f4145 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4793d14234ee48ecb55720255710e1d7)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:37.333018 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a76b32-470a-4e97-adeb-368a6d0f4145 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:37.334260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933568b-fa4a-4489-a690-28c268bac391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:37.334882 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933568b-fa4a-4489-a690-28c268bac391 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:37.335170 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933568b-fa4a-4489-a690-28c268bac391 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:37.335450 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933568b-fa4a-4489-a690-28c268bac391 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:37.336102 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933568b-fa4a-4489-a690-28c268bac391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:37.338341 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933568b-fa4a-4489-a690-28c268bac391 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:37.353972 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1402/2813] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:58:37.355199 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933568b-fa4a-4489-a690-28c268bac391 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:37.366412 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933568b-fa4a-4489-a690-28c268bac391 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:37.371285 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6d337-cace-40b3-b66c-f33de6617e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:37.373655 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6d337-cace-40b3-b66c-f33de6617e63 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:37.373655 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6d337-cace-40b3-b66c-f33de6617e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:37.373655 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6d337-cace-40b3-b66c-f33de6617e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:37.373655 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6d337-cace-40b3-b66c-f33de6617e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:37.375305 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6d337-cace-40b3-b66c-f33de6617e63 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:37.390041 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1403/2814] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:58:37.391521 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6d337-cace-40b3-b66c-f33de6617e63 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:37.402126 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6d337-cace-40b3-b66c-f33de6617e63 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:37.407523 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff9d71-9651-40b2-8458-4f17e5bcb9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:37.414082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff9d71-9651-40b2-8458-4f17e5bcb9db admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:37.414082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff9d71-9651-40b2-8458-4f17e5bcb9db admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:37.414082 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff9d71-9651-40b2-8458-4f17e5bcb9db admin admin] PATH_INFO: `/v3/projects/283d9d91faa9483db73eacea73def3e4/users/2192bd1a8b784e688047a1442e114699/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:37.424487 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff9d71-9651-40b2-8458-4f17e5bcb9db admin admin] RBAC: Authorizing `identity:create_grant(project_id=283d9d91faa9483db73eacea73def3e4, user_id=2192bd1a8b784e688047a1442e114699, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:37.427100 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff9d71-9651-40b2-8458-4f17e5bcb9db admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:37.501065 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1404/2815] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:58:37 2022] PUT /identity/v3/projects/283d9d91faa9483db73eacea73def3e4/users/2192bd1a8b784e688047a1442e114699/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:58:37.511527 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-15a76b32-470a-4e97-adeb-368a6d0f4145 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4793d14234ee48ecb55720255710e1d7', 'request_id': 'req-15a76b32-470a-4e97-adeb-368a6d0f4145'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:37.512646 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37eee5e-ed52-4675-a768-e2e654f65320 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:37.512940 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37eee5e-ed52-4675-a768-e2e654f65320 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:37.513246 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37eee5e-ed52-4675-a768-e2e654f65320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:37.519008 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-15a76b32-470a-4e97-adeb-368a6d0f4145 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4793d14234ee48ecb55720255710e1d7', 'request_id': 'req-15a76b32-470a-4e97-adeb-368a6d0f4145'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:37.544262 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-d37eee5e-ed52-4675-a768-e2e654f65320 None None] MFA Rules not processed for user `2192bd1a8b784e688047a1442e114699`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:37.546005 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-d37eee5e-ed52-4675-a768-e2e654f65320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:37.608050 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-15a76b32-470a-4e97-adeb-368a6d0f4145 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4793d14234ee48ecb55720255710e1d7', 'request_id': 'req-15a76b32-470a-4e97-adeb-368a6d0f4145'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:37.620715 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1405/2816] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:37.622301 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37eee5e-ed52-4675-a768-e2e654f65320 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:37.622445 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-15a76b32-470a-4e97-adeb-368a6d0f4145 admin admin] The token cache is being invalidate because project 4793d14234ee48ecb55720255710e1d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:58:37.622645 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-15a76b32-470a-4e97-adeb-368a6d0f4145 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:37.623839 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-15a76b32-470a-4e97-adeb-368a6d0f4145 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:37.625377 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1412/2817] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:58:37 2022] DELETE /identity/v3/projects/4793d14234ee48ecb55720255710e1d7 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:37.635679 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:37.698004 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37eee5e-ed52-4675-a768-e2e654f65320 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:37.704041 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fa778-398a-40c0-955d-f6be09d73d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:37.704772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fa778-398a-40c0-955d-f6be09d73d49 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:37.705147 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fa778-398a-40c0-955d-f6be09d73d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:37.705624 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fa778-398a-40c0-955d-f6be09d73d49 admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:37.706332 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fa778-398a-40c0-955d-f6be09d73d49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:37.708390 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fa778-398a-40c0-955d-f6be09d73d49 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:37.731812 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a76b32-470a-4e97-adeb-368a6d0f4145 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:37.734616 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-15a76b32-470a-4e97-adeb-368a6d0f4145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:37.749314 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a76b32-470a-4e97-adeb-368a6d0f4145 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:37.755170 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f6ace-964e-4c7f-96bc-bed89de714c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:37.756055 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f6ace-964e-4c7f-96bc-bed89de714c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:37.756409 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f6ace-964e-4c7f-96bc-bed89de714c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:37.756762 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f6ace-964e-4c7f-96bc-bed89de714c8 admin admin] PATH_INFO: `/v3/projects/870c94e2a6bc4c55a566c9191ae68bb6` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:37.758193 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f6ace-964e-4c7f-96bc-bed89de714c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=870c94e2a6bc4c55a566c9191ae68bb6)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:37.760439 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f6ace-964e-4c7f-96bc-bed89de714c8 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:37.793551 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1406/2818] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:58:37 2022] POST /identity/v3/projects => generated 383 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:58:37.798511 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fa778-398a-40c0-955d-f6be09d73d49 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:37.802399 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-fb1fa778-398a-40c0-955d-f6be09d73d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:37.874570 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-e44f6ace-964e-4c7f-96bc-bed89de714c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '870c94e2a6bc4c55a566c9191ae68bb6', 'request_id': 'req-e44f6ace-964e-4c7f-96bc-bed89de714c8'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:37.875552 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fa778-398a-40c0-955d-f6be09d73d49 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:37.880822 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-e44f6ace-964e-4c7f-96bc-bed89de714c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '870c94e2a6bc4c55a566c9191ae68bb6', 'request_id': 'req-e44f6ace-964e-4c7f-96bc-bed89de714c8'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:37.922419 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-e44f6ace-964e-4c7f-96bc-bed89de714c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '870c94e2a6bc4c55a566c9191ae68bb6', 'request_id': 'req-e44f6ace-964e-4c7f-96bc-bed89de714c8'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:37.934434 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-e44f6ace-964e-4c7f-96bc-bed89de714c8 admin admin] The token cache is being invalidate because project 870c94e2a6bc4c55a566c9191ae68bb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:58:37.934722 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-e44f6ace-964e-4c7f-96bc-bed89de714c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:37.935425 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-e44f6ace-964e-4c7f-96bc-bed89de714c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:37.937137 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1413/2819] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:58:37 2022] DELETE /identity/v3/projects/870c94e2a6bc4c55a566c9191ae68bb6 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:58:37.938455 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaee221-ed58-44bf-9310-a19254578e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:37.939096 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaee221-ed58-44bf-9310-a19254578e0c admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:37.939378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaee221-ed58-44bf-9310-a19254578e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:37.939649 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaee221-ed58-44bf-9310-a19254578e0c admin admin] PATH_INFO: `/v3/users` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:37.940367 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaee221-ed58-44bf-9310-a19254578e0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:37.940977 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f6ace-964e-4c7f-96bc-bed89de714c8 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:37.942371 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaee221-ed58-44bf-9310-a19254578e0c admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:37.942535 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-e44f6ace-964e-4c7f-96bc-bed89de714c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:37.955899 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f6ace-964e-4c7f-96bc-bed89de714c8 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:37.960565 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832fefbc-fd0b-4b30-90db-48b439d43c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:37.961216 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fefbc-fd0b-4b30-90db-48b439d43c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:37.961545 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fefbc-fd0b-4b30-90db-48b439d43c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:37.961866 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fefbc-fd0b-4b30-90db-48b439d43c16 admin admin] PATH_INFO: `/v3/users/c2709a6ccc384d2cacf568af2d295aa3` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:37.962989 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832fefbc-fd0b-4b30-90db-48b439d43c16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2709a6ccc384d2cacf568af2d295aa3)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:37.964888 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832fefbc-fd0b-4b30-90db-48b439d43c16 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:38.003250 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1407/2820] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:58:37 2022] POST /identity/v3/users => generated 298 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:58:38.007316 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaee221-ed58-44bf-9310-a19254578e0c admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:38.008898 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-8aaee221-ed58-44bf-9310-a19254578e0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:38.021691 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaee221-ed58-44bf-9310-a19254578e0c admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:38.026661 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56616eb1-7150-4834-9c90-14782784b7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:38.027286 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56616eb1-7150-4834-9c90-14782784b7da admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:38.027567 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56616eb1-7150-4834-9c90-14782784b7da admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:38.027840 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56616eb1-7150-4834-9c90-14782784b7da admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:38.028484 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56616eb1-7150-4834-9c90-14782784b7da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:38.031108 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56616eb1-7150-4834-9c90-14782784b7da admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:38.044498 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1408/2821] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:58:38.048814 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56616eb1-7150-4834-9c90-14782784b7da admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:38.059012 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56616eb1-7150-4834-9c90-14782784b7da admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:38.065122 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad759d-4944-43d0-98ce-ade14d87579e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:38.065770 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad759d-4944-43d0-98ce-ade14d87579e admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:38.066049 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad759d-4944-43d0-98ce-ade14d87579e admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:38.066336 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad759d-4944-43d0-98ce-ade14d87579e admin admin] PATH_INFO: `/v3/projects/16622e8ade9845a88e84369104b64370/users/271668e5370f4eb899fd76384e14f430/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:38.078555 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:38.084931 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad759d-4944-43d0-98ce-ade14d87579e admin admin] RBAC: Authorizing `identity:create_grant(project_id=16622e8ade9845a88e84369104b64370, user_id=271668e5370f4eb899fd76384e14f430, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:38.085202 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad759d-4944-43d0-98ce-ade14d87579e admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:38.142474 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-832fefbc-fd0b-4b30-90db-48b439d43c16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2709a6ccc384d2cacf568af2d295aa3'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:38.146153 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:INSERT=5,keystone:SELECT=73,keystone:DELETE=22 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:38.157363 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1409/2822] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:58:38 2022] PUT /identity/v3/projects/16622e8ade9845a88e84369104b64370/users/271668e5370f4eb899fd76384e14f430/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:58:38.161361 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad759d-4944-43d0-98ce-ade14d87579e admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:38.213579 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-832fefbc-fd0b-4b30-90db-48b439d43c16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2709a6ccc384d2cacf568af2d295aa3'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:38.214228 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-832fefbc-fd0b-4b30-90db-48b439d43c16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2709a6ccc384d2cacf568af2d295aa3'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:38.214963 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-832fefbc-fd0b-4b30-90db-48b439d43c16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2709a6ccc384d2cacf568af2d295aa3'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:38.223539 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-832fefbc-fd0b-4b30-90db-48b439d43c16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2709a6ccc384d2cacf568af2d295aa3'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:38.224758 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad759d-4944-43d0-98ce-ade14d87579e admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:38.230428 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5132ed-bac4-4b1e-b545-4d013573071d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:38.231072 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5132ed-bac4-4b1e-b545-4d013573071d admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:38.231357 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5132ed-bac4-4b1e-b545-4d013573071d admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:38.231632 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5132ed-bac4-4b1e-b545-4d013573071d admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:38.232938 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5132ed-bac4-4b1e-b545-4d013573071d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:38.234625 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5132ed-bac4-4b1e-b545-4d013573071d admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:38.242578 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1414/2823] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:58:37 2022] DELETE /identity/v3/users/c2709a6ccc384d2cacf568af2d295aa3 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:58:38.249993 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1410/2824] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:58:38.252049 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832fefbc-fd0b-4b30-90db-48b439d43c16 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:38.253465 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-832fefbc-fd0b-4b30-90db-48b439d43c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:38.320739 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832fefbc-fd0b-4b30-90db-48b439d43c16 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:38.326708 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8f93e-5b3c-48e2-b6af-f5f210cd8d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:38.327281 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8f93e-5b3c-48e2-b6af-f5f210cd8d1b admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:38.327565 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8f93e-5b3c-48e2-b6af-f5f210cd8d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:38.327842 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8f93e-5b3c-48e2-b6af-f5f210cd8d1b admin admin] PATH_INFO: `/v3/projects/16622e8ade9845a88e84369104b64370/users/271668e5370f4eb899fd76384e14f430/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:38.329916 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8f93e-5b3c-48e2-b6af-f5f210cd8d1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=16622e8ade9845a88e84369104b64370, user_id=271668e5370f4eb899fd76384e14f430, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:38.332622 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8f93e-5b3c-48e2-b6af-f5f210cd8d1b admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:38.344195 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1415/2825] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:58:38 2022] PUT /identity/v3/projects/16622e8ade9845a88e84369104b64370/users/271668e5370f4eb899fd76384e14f430/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:38.354440 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d1c6a-7bad-4115-8bfe-109a57d58558 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:38.355825 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d1c6a-7bad-4115-8bfe-109a57d58558 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:38.355825 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d1c6a-7bad-4115-8bfe-109a57d58558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:38.384304 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-1b2d1c6a-7bad-4115-8bfe-109a57d58558 None None] MFA Rules not processed for user `271668e5370f4eb899fd76384e14f430`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:38.385575 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-1b2d1c6a-7bad-4115-8bfe-109a57d58558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:38.479260 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1411/2826] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:38 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:38.492348 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8f93e-5b3c-48e2-b6af-f5f210cd8d1b admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:38.494483 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-def8f93e-5b3c-48e2-b6af-f5f210cd8d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:38.560005 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8f93e-5b3c-48e2-b6af-f5f210cd8d1b admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:38.564583 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8259a-9980-4aa7-8a92-0093df7558fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:38.565350 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8259a-9980-4aa7-8a92-0093df7558fa service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:38.565636 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8259a-9980-4aa7-8a92-0093df7558fa service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:38.565909 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8259a-9980-4aa7-8a92-0093df7558fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:38.575521 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8259a-9980-4aa7-8a92-0093df7558fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:38.577393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8259a-9980-4aa7-8a92-0093df7558fa service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:38.587521 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1416/2827] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:58:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:58:38.696777 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d1c6a-7bad-4115-8bfe-109a57d58558 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:38.697172 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-1b2d1c6a-7bad-4115-8bfe-109a57d58558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:38.781253 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d1c6a-7bad-4115-8bfe-109a57d58558 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:38.785946 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f3a63-f5a6-4a67-bd38-d87de8b420b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:38.786571 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f3a63-f5a6-4a67-bd38-d87de8b420b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:38.786853 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f3a63-f5a6-4a67-bd38-d87de8b420b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:38.787127 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f3a63-f5a6-4a67-bd38-d87de8b420b6 admin admin] PATH_INFO: `/v3/projects/fbdb37465b7644a38e1bdf19a544373e` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:38.788242 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f3a63-f5a6-4a67-bd38-d87de8b420b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbdb37465b7644a38e1bdf19a544373e)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:38.790284 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f3a63-f5a6-4a67-bd38-d87de8b420b6 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:38.802658 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:38.924564 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-425f3a63-f5a6-4a67-bd38-d87de8b420b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbdb37465b7644a38e1bdf19a544373e', 'request_id': 'req-425f3a63-f5a6-4a67-bd38-d87de8b420b6'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:38.930798 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-425f3a63-f5a6-4a67-bd38-d87de8b420b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbdb37465b7644a38e1bdf19a544373e', 'request_id': 'req-425f3a63-f5a6-4a67-bd38-d87de8b420b6'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:38.996275 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-425f3a63-f5a6-4a67-bd38-d87de8b420b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbdb37465b7644a38e1bdf19a544373e', 'request_id': 'req-425f3a63-f5a6-4a67-bd38-d87de8b420b6'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:39.008995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-425f3a63-f5a6-4a67-bd38-d87de8b420b6 admin admin] The token cache is being invalidate because project fbdb37465b7644a38e1bdf19a544373e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:58:39.009301 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-425f3a63-f5a6-4a67-bd38-d87de8b420b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:39.009953 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-425f3a63-f5a6-4a67-bd38-d87de8b420b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:39.011441 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1412/2828] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:58:38 2022] DELETE /identity/v3/projects/fbdb37465b7644a38e1bdf19a544373e => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:39.016431 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c370c6f-0d8a-4a34-baa0-84594b7e13ce None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:39.016718 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c370c6f-0d8a-4a34-baa0-84594b7e13ce None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:39.016999 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c370c6f-0d8a-4a34-baa0-84594b7e13ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:39.037987 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-4c370c6f-0d8a-4a34-baa0-84594b7e13ce None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:39.039196 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-4c370c6f-0d8a-4a34-baa0-84594b7e13ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:39.100058 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1417/2829] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:58:39.114725 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c746a9-b168-4297-9e0e-98e501cb575f None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:39.115077 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c746a9-b168-4297-9e0e-98e501cb575f None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:39.115283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c746a9-b168-4297-9e0e-98e501cb575f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:39.136779 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-b9c746a9-b168-4297-9e0e-98e501cb575f None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:39.138113 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-b9c746a9-b168-4297-9e0e-98e501cb575f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:39.146818 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1413/2830] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:39.151198 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c370c6f-0d8a-4a34-baa0-84594b7e13ce None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:39.161500 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c370c6f-0d8a-4a34-baa0-84594b7e13ce None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:39.167531 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8bcc6a-2c16-4146-a2a2-e5f5cb83b4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:39.168173 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bcc6a-2c16-4146-a2a2-e5f5cb83b4ad admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:39.168497 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bcc6a-2c16-4146-a2a2-e5f5cb83b4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:39.168774 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bcc6a-2c16-4146-a2a2-e5f5cb83b4ad admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:39.169482 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8bcc6a-2c16-4146-a2a2-e5f5cb83b4ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:58:39.170367 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8bcc6a-2c16-4146-a2a2-e5f5cb83b4ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:39.173191 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8bcc6a-2c16-4146-a2a2-e5f5cb83b4ad admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:39.174879 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:39.189586 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1418/2831] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:58:39.190800 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c746a9-b168-4297-9e0e-98e501cb575f None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:39.200585 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c746a9-b168-4297-9e0e-98e501cb575f None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:39.206028 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e581d-1e5e-41e0-96ac-dfdf5e6a28f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:39.206626 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e581d-1e5e-41e0-96ac-dfdf5e6a28f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:39.206910 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e581d-1e5e-41e0-96ac-dfdf5e6a28f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:39.207183 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e581d-1e5e-41e0-96ac-dfdf5e6a28f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:39.207811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e581d-1e5e-41e0-96ac-dfdf5e6a28f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:39.209764 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e581d-1e5e-41e0-96ac-dfdf5e6a28f2 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:39.318650 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1414/2832] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:58:39 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:58:39.322706 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8bcc6a-2c16-4146-a2a2-e5f5cb83b4ad admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:39.333239 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8bcc6a-2c16-4146-a2a2-e5f5cb83b4ad admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:39.391236 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5af506-bda3-41a9-b42c-d39f04e62b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:39.391837 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5af506-bda3-41a9-b42c-d39f04e62b34 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:39.392128 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5af506-bda3-41a9-b42c-d39f04e62b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:39.392402 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5af506-bda3-41a9-b42c-d39f04e62b34 admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:39.393055 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5af506-bda3-41a9-b42c-d39f04e62b34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:39.395050 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5af506-bda3-41a9-b42c-d39f04e62b34 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:39.483441 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1419/2833] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:58:39 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:58:39.487895 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e581d-1e5e-41e0-96ac-dfdf5e6a28f2 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:39.498573 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e581d-1e5e-41e0-96ac-dfdf5e6a28f2 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:39.503035 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979f3d1-5d00-4647-b39b-58f9ac81db76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:39.503676 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979f3d1-5d00-4647-b39b-58f9ac81db76 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:39.503959 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979f3d1-5d00-4647-b39b-58f9ac81db76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:39.504226 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979f3d1-5d00-4647-b39b-58f9ac81db76 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:39.504867 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979f3d1-5d00-4647-b39b-58f9ac81db76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:39.506473 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979f3d1-5d00-4647-b39b-58f9ac81db76 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:39.517657 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1415/2834] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:58:39.521742 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5af506-bda3-41a9-b42c-d39f04e62b34 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:39.532934 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5af506-bda3-41a9-b42c-d39f04e62b34 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:39.537989 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d6bb4-c9d8-404a-8cd6-fdf6205d336c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:39.538593 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d6bb4-c9d8-404a-8cd6-fdf6205d336c admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:39.538876 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d6bb4-c9d8-404a-8cd6-fdf6205d336c admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:39.539144 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d6bb4-c9d8-404a-8cd6-fdf6205d336c admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:39.540004 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d6bb4-c9d8-404a-8cd6-fdf6205d336c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:39.541420 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d6bb4-c9d8-404a-8cd6-fdf6205d336c admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:39.556637 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1420/2835] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:58:39.557847 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979f3d1-5d00-4647-b39b-58f9ac81db76 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:39.568871 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979f3d1-5d00-4647-b39b-58f9ac81db76 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:39.575203 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7df1a1-e3ea-42ba-baa3-19c4352ec1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:39.575862 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7df1a1-e3ea-42ba-baa3-19c4352ec1f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:39.576878 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7df1a1-e3ea-42ba-baa3-19c4352ec1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:39.577512 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7df1a1-e3ea-42ba-baa3-19c4352ec1f2 admin admin] PATH_INFO: `/v3/projects/5e6b29b7e9b24b7c920333adef90b566/users/d31de727237d441d813ad49bf6c368dc/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:39.594137 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7df1a1-e3ea-42ba-baa3-19c4352ec1f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e6b29b7e9b24b7c920333adef90b566, user_id=d31de727237d441d813ad49bf6c368dc, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:39.597295 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7df1a1-e3ea-42ba-baa3-19c4352ec1f2 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:39.670825 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1416/2836] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:58:39 2022] PUT /identity/v3/projects/5e6b29b7e9b24b7c920333adef90b566/users/d31de727237d441d813ad49bf6c368dc/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:58:39.682234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8293f83-09af-4693-bd8f-36d92b270486 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:39.685857 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8293f83-09af-4693-bd8f-36d92b270486 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:39.685857 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8293f83-09af-4693-bd8f-36d92b270486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:39.711914 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-e8293f83-09af-4693-bd8f-36d92b270486 None None] MFA Rules not processed for user `d31de727237d441d813ad49bf6c368dc`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:39.713159 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-e8293f83-09af-4693-bd8f-36d92b270486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:39.745374 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7df1a1-e3ea-42ba-baa3-19c4352ec1f2 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:39.747171 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-6c7df1a1-e3ea-42ba-baa3-19c4352ec1f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:39.787301 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1421/2837] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:39.798592 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8293f83-09af-4693-bd8f-36d92b270486 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:39.800026 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-e8293f83-09af-4693-bd8f-36d92b270486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:39.819180 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7df1a1-e3ea-42ba-baa3-19c4352ec1f2 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:39.824152 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83042aa-e797-4e3c-9f27-0228a126d854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:39.824847 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83042aa-e797-4e3c-9f27-0228a126d854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:39.825225 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83042aa-e797-4e3c-9f27-0228a126d854 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:39.825434 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83042aa-e797-4e3c-9f27-0228a126d854 admin admin] PATH_INFO: `/v3/users/2192bd1a8b784e688047a1442e114699` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:39.826643 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83042aa-e797-4e3c-9f27-0228a126d854 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2192bd1a8b784e688047a1442e114699)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:39.830107 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83042aa-e797-4e3c-9f27-0228a126d854 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:39.860814 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8293f83-09af-4693-bd8f-36d92b270486 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:39.865062 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c977b173-0036-41e9-ba58-8c04dd77cda0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:39.865501 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977b173-0036-41e9-ba58-8c04dd77cda0 service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:39.865780 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977b173-0036-41e9-ba58-8c04dd77cda0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:39.866050 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977b173-0036-41e9-ba58-8c04dd77cda0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:39.874912 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c977b173-0036-41e9-ba58-8c04dd77cda0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:39.876338 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c977b173-0036-41e9-ba58-8c04dd77cda0 service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:39.885184 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1422/2838] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:58:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:58:39.905347 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c977b173-0036-41e9-ba58-8c04dd77cda0 service cinder] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:39.911873 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:39.916003 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c977b173-0036-41e9-ba58-8c04dd77cda0 service cinder] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:39.921340 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6243c3b-0c9b-44ba-ad12-90121f0ddde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:39.921952 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6243c3b-0c9b-44ba-ad12-90121f0ddde6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:39.922234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6243c3b-0c9b-44ba-ad12-90121f0ddde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:39.922510 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6243c3b-0c9b-44ba-ad12-90121f0ddde6 admin admin] PATH_INFO: `/v3/users/d31de727237d441d813ad49bf6c368dc` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:39.923672 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6243c3b-0c9b-44ba-ad12-90121f0ddde6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d31de727237d441d813ad49bf6c368dc)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:39.925616 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6243c3b-0c9b-44ba-ad12-90121f0ddde6 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:40.027349 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:40.033845 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-d83042aa-e797-4e3c-9f27-0228a126d854 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2192bd1a8b784e688047a1442e114699'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:40.128594 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-d83042aa-e797-4e3c-9f27-0228a126d854 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2192bd1a8b784e688047a1442e114699'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:40.129215 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-d83042aa-e797-4e3c-9f27-0228a126d854 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2192bd1a8b784e688047a1442e114699'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:40.129843 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-d83042aa-e797-4e3c-9f27-0228a126d854 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2192bd1a8b784e688047a1442e114699'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:40.137565 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-d83042aa-e797-4e3c-9f27-0228a126d854 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2192bd1a8b784e688047a1442e114699'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:40.142391 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-b6243c3b-0c9b-44ba-ad12-90121f0ddde6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd31de727237d441d813ad49bf6c368dc'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:40.156206 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1417/2839] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:58:39 2022] DELETE /identity/v3/users/2192bd1a8b784e688047a1442e114699 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:58:40.160545 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bce8c1-7b01-45e6-8619-f1658d92ee47 None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:40.161003 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bce8c1-7b01-45e6-8619-f1658d92ee47 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:40.161132 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bce8c1-7b01-45e6-8619-f1658d92ee47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:40.179733 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-f8bce8c1-7b01-45e6-8619-f1658d92ee47 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:40.180940 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-f8bce8c1-7b01-45e6-8619-f1658d92ee47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:40.219234 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-b6243c3b-0c9b-44ba-ad12-90121f0ddde6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd31de727237d441d813ad49bf6c368dc'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:40.219856 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-b6243c3b-0c9b-44ba-ad12-90121f0ddde6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd31de727237d441d813ad49bf6c368dc'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:40.220532 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-b6243c3b-0c9b-44ba-ad12-90121f0ddde6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd31de727237d441d813ad49bf6c368dc'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:40.228690 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-b6243c3b-0c9b-44ba-ad12-90121f0ddde6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd31de727237d441d813ad49bf6c368dc'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:40.242106 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1418/2840] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:40.249282 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1423/2841] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:58:39 2022] DELETE /identity/v3/users/d31de727237d441d813ad49bf6c368dc => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:58:40.252641 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bce8c1-7b01-45e6-8619-f1658d92ee47 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:40.254016 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-f8bce8c1-7b01-45e6-8619-f1658d92ee47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:40.254415 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c067a6-a6a7-4b15-8e86-b4b06696ea25 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:40.254697 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c067a6-a6a7-4b15-8e86-b4b06696ea25 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:40.260164 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c067a6-a6a7-4b15-8e86-b4b06696ea25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:40.277556 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-18c067a6-a6a7-4b15-8e86-b4b06696ea25 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:40.278758 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-18c067a6-a6a7-4b15-8e86-b4b06696ea25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:40.316384 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bce8c1-7b01-45e6-8619-f1658d92ee47 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:40.348252 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1424/2842] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:40.358045 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c067a6-a6a7-4b15-8e86-b4b06696ea25 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:40.366114 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1659eb-b8c9-4ca2-854f-5d82ca592527 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:40.366678 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1659eb-b8c9-4ca2-854f-5d82ca592527 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:40.366963 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1659eb-b8c9-4ca2-854f-5d82ca592527 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:40.367239 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1659eb-b8c9-4ca2-854f-5d82ca592527 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:40.377044 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1659eb-b8c9-4ca2-854f-5d82ca592527 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:40.378513 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1659eb-b8c9-4ca2-854f-5d82ca592527 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:40.388154 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1419/2843] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:58:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:58:40.423085 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c067a6-a6a7-4b15-8e86-b4b06696ea25 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:40.427096 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52670d-9109-4bb9-afbb-e79d6ee2a4e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:40.427700 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52670d-9109-4bb9-afbb-e79d6ee2a4e3 service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:40.427981 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52670d-9109-4bb9-afbb-e79d6ee2a4e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:40.428251 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52670d-9109-4bb9-afbb-e79d6ee2a4e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:40.439336 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52670d-9109-4bb9-afbb-e79d6ee2a4e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:40.440877 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52670d-9109-4bb9-afbb-e79d6ee2a4e3 service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:40.450889 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1425/2844] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:58:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:58:40.917540 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1659eb-b8c9-4ca2-854f-5d82ca592527 service neutron] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:40.918047 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52670d-9109-4bb9-afbb-e79d6ee2a4e3 service neutron] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:40.919205 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-3d1659eb-b8c9-4ca2-854f-5d82ca592527 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:40.919366 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-2e52670d-9109-4bb9-afbb-e79d6ee2a4e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:40.935883 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1659eb-b8c9-4ca2-854f-5d82ca592527 service neutron] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:40.937503 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52670d-9109-4bb9-afbb-e79d6ee2a4e3 service neutron] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:40.942768 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f83fd-57b9-4f7e-b577-528284932221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:40.942768 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f83fd-57b9-4f7e-b577-528284932221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:40.942768 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f83fd-57b9-4f7e-b577-528284932221 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:40.943508 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f83fd-57b9-4f7e-b577-528284932221 admin admin] PATH_INFO: `/v3/projects/283d9d91faa9483db73eacea73def3e4` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:40.943611 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d3ef5-f9e7-43ae-beb9-877faea6d9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:40.944050 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d3ef5-f9e7-43ae-beb9-877faea6d9a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:40.944538 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d3ef5-f9e7-43ae-beb9-877faea6d9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:40.944902 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f83fd-57b9-4f7e-b577-528284932221 admin admin] RBAC: Authorizing `identity:delete_project(project_id=283d9d91faa9483db73eacea73def3e4)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:40.945018 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d3ef5-f9e7-43ae-beb9-877faea6d9a1 admin admin] PATH_INFO: `/v3/projects/5e6b29b7e9b24b7c920333adef90b566` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:40.946509 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d3ef5-f9e7-43ae-beb9-877faea6d9a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e6b29b7e9b24b7c920333adef90b566)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:40.947947 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f83fd-57b9-4f7e-b577-528284932221 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:40.948513 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d3ef5-f9e7-43ae-beb9-877faea6d9a1 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:40.962065 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:40.972242 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:41.049267 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-960d3ef5-f9e7-43ae-beb9-877faea6d9a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e6b29b7e9b24b7c920333adef90b566', 'request_id': 'req-960d3ef5-f9e7-43ae-beb9-877faea6d9a1'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:41.054816 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-960d3ef5-f9e7-43ae-beb9-877faea6d9a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e6b29b7e9b24b7c920333adef90b566', 'request_id': 'req-960d3ef5-f9e7-43ae-beb9-877faea6d9a1'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:41.071465 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-b20f83fd-57b9-4f7e-b577-528284932221 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '283d9d91faa9483db73eacea73def3e4', 'request_id': 'req-b20f83fd-57b9-4f7e-b577-528284932221'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:41.077445 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-b20f83fd-57b9-4f7e-b577-528284932221 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '283d9d91faa9483db73eacea73def3e4', 'request_id': 'req-b20f83fd-57b9-4f7e-b577-528284932221'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:41.122192 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-960d3ef5-f9e7-43ae-beb9-877faea6d9a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e6b29b7e9b24b7c920333adef90b566', 'request_id': 'req-960d3ef5-f9e7-43ae-beb9-877faea6d9a1'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:41.133733 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-960d3ef5-f9e7-43ae-beb9-877faea6d9a1 admin admin] The token cache is being invalidate because project 5e6b29b7e9b24b7c920333adef90b566 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:58:41.134020 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-960d3ef5-f9e7-43ae-beb9-877faea6d9a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:41.134719 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-960d3ef5-f9e7-43ae-beb9-877faea6d9a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:41.136212 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1426/2845] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:58:40 2022] DELETE /identity/v3/projects/5e6b29b7e9b24b7c920333adef90b566 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:41.141847 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8a6a2-7cd9-4857-9149-dd762c56153c None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:41.142126 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8a6a2-7cd9-4857-9149-dd762c56153c None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:41.142399 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8a6a2-7cd9-4857-9149-dd762c56153c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:41.162903 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-ddf8a6a2-7cd9-4857-9149-dd762c56153c None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:41.163591 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-ddf8a6a2-7cd9-4857-9149-dd762c56153c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:41.173524 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-b20f83fd-57b9-4f7e-b577-528284932221 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '283d9d91faa9483db73eacea73def3e4', 'request_id': 'req-b20f83fd-57b9-4f7e-b577-528284932221'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:41.185424 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-b20f83fd-57b9-4f7e-b577-528284932221 admin admin] The token cache is being invalidate because project 283d9d91faa9483db73eacea73def3e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:58:41.185807 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-b20f83fd-57b9-4f7e-b577-528284932221 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:41.186455 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-b20f83fd-57b9-4f7e-b577-528284932221 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:41.187979 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1420/2846] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:58:40 2022] DELETE /identity/v3/projects/283d9d91faa9483db73eacea73def3e4 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:41.192204 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f83fd-57b9-4f7e-b577-528284932221 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:41.193689 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-b20f83fd-57b9-4f7e-b577-528284932221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:41.227628 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1427/2847] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:58:41.235896 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207c9a0-2285-4792-a8b9-ad933b9991fc None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:41.236181 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207c9a0-2285-4792-a8b9-ad933b9991fc None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:41.236460 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207c9a0-2285-4792-a8b9-ad933b9991fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:41.256391 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-7207c9a0-2285-4792-a8b9-ad933b9991fc None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:41.257667 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-7207c9a0-2285-4792-a8b9-ad933b9991fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:41.262341 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f83fd-57b9-4f7e-b577-528284932221 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:41.266130 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1428/2848] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:58:41.268089 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69738860-5e8c-4787-99e5-77ae11797042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:41.268745 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69738860-5e8c-4787-99e5-77ae11797042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:41.269132 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69738860-5e8c-4787-99e5-77ae11797042 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:41.269395 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69738860-5e8c-4787-99e5-77ae11797042 admin admin] PATH_INFO: `/v3/users/271668e5370f4eb899fd76384e14f430` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:41.270351 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207c9a0-2285-4792-a8b9-ad933b9991fc None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:41.270547 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69738860-5e8c-4787-99e5-77ae11797042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=271668e5370f4eb899fd76384e14f430)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:41.272652 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69738860-5e8c-4787-99e5-77ae11797042 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:41.280386 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207c9a0-2285-4792-a8b9-ad933b9991fc None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:41.285661 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c9cac-34b1-4415-9596-8a5c2a56c305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:41.286388 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c9cac-34b1-4415-9596-8a5c2a56c305 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:41.286692 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c9cac-34b1-4415-9596-8a5c2a56c305 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:41.286970 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c9cac-34b1-4415-9596-8a5c2a56c305 admin admin] PATH_INFO: `/v3/domains` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:41.287661 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c9cac-34b1-4415-9596-8a5c2a56c305 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:58:41.287970 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c9cac-34b1-4415-9596-8a5c2a56c305 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:41.289622 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c9cac-34b1-4415-9596-8a5c2a56c305 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:41.305064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1429/2849] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 17:58:41.307334 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c9cac-34b1-4415-9596-8a5c2a56c305 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:41.319557 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c9cac-34b1-4415-9596-8a5c2a56c305 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:41.324562 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13c570-f034-4b02-841f-8d9e5d37dcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:41.325183 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13c570-f034-4b02-841f-8d9e5d37dcae admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:41.325467 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13c570-f034-4b02-841f-8d9e5d37dcae admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:41.325773 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13c570-f034-4b02-841f-8d9e5d37dcae admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:41.326630 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13c570-f034-4b02-841f-8d9e5d37dcae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:41.328561 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13c570-f034-4b02-841f-8d9e5d37dcae admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:41.438753 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1430/2850] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:58:41 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:58:41.442552 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13c570-f034-4b02-841f-8d9e5d37dcae admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:41.474336 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-69738860-5e8c-4787-99e5-77ae11797042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '271668e5370f4eb899fd76384e14f430'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:41.506658 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13c570-f034-4b02-841f-8d9e5d37dcae admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:41.511748 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb505e47-2271-4573-873f-15fa0fa745f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:41.512363 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb505e47-2271-4573-873f-15fa0fa745f6 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:41.512644 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb505e47-2271-4573-873f-15fa0fa745f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:41.512918 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb505e47-2271-4573-873f-15fa0fa745f6 admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:41.514061 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb505e47-2271-4573-873f-15fa0fa745f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:41.516135 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb505e47-2271-4573-873f-15fa0fa745f6 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:41.525114 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:41.544850 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-69738860-5e8c-4787-99e5-77ae11797042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '271668e5370f4eb899fd76384e14f430'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:41.545794 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-69738860-5e8c-4787-99e5-77ae11797042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '271668e5370f4eb899fd76384e14f430'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:41.546461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-69738860-5e8c-4787-99e5-77ae11797042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '271668e5370f4eb899fd76384e14f430'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:41.553914 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-69738860-5e8c-4787-99e5-77ae11797042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '271668e5370f4eb899fd76384e14f430'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:41.571020 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1421/2851] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:58:41 2022] DELETE /identity/v3/users/271668e5370f4eb899fd76384e14f430 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:58:41.620491 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1431/2852] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:58:41 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:58:41.624715 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69738860-5e8c-4787-99e5-77ae11797042 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:41.628915 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-69738860-5e8c-4787-99e5-77ae11797042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:41.647691 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:41.692470 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69738860-5e8c-4787-99e5-77ae11797042 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:41.697187 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf1aa2-d85f-43c8-a531-14b30b6e96e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:41.697787 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf1aa2-d85f-43c8-a531-14b30b6e96e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:41.698070 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf1aa2-d85f-43c8-a531-14b30b6e96e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:41.698341 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf1aa2-d85f-43c8-a531-14b30b6e96e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:41.698983 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf1aa2-d85f-43c8-a531-14b30b6e96e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:41.700564 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf1aa2-d85f-43c8-a531-14b30b6e96e5 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:41.710923 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1422/2853] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:58:41.715444 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb505e47-2271-4573-873f-15fa0fa745f6 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:41.726136 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb505e47-2271-4573-873f-15fa0fa745f6 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:41.730803 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f9f29-3a73-4de8-a50d-455898f4f151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:41.731393 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f9f29-3a73-4de8-a50d-455898f4f151 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:41.731688 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f9f29-3a73-4de8-a50d-455898f4f151 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:41.731940 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f9f29-3a73-4de8-a50d-455898f4f151 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:41.733180 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f9f29-3a73-4de8-a50d-455898f4f151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:41.734778 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f9f29-3a73-4de8-a50d-455898f4f151 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:41.745455 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1432/2854] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:58:41.749531 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf1aa2-d85f-43c8-a531-14b30b6e96e5 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:41.759623 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf1aa2-d85f-43c8-a531-14b30b6e96e5 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:41.764993 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eab2b2-bfa0-4cf9-b5cd-ffd5b78b2983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:41.765757 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eab2b2-bfa0-4cf9-b5cd-ffd5b78b2983 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:41.766047 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eab2b2-bfa0-4cf9-b5cd-ffd5b78b2983 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:41.766330 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eab2b2-bfa0-4cf9-b5cd-ffd5b78b2983 admin admin] PATH_INFO: `/v3/projects/e68e96ffbd994a40a23221d0b0897db3/users/fb3ede9d5aad42aea52f44098e8cccdf/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:41.784013 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eab2b2-bfa0-4cf9-b5cd-ffd5b78b2983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e68e96ffbd994a40a23221d0b0897db3, user_id=fb3ede9d5aad42aea52f44098e8cccdf, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:41.786718 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eab2b2-bfa0-4cf9-b5cd-ffd5b78b2983 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:41.853697 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1423/2855] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:58:41 2022] PUT /identity/v3/projects/e68e96ffbd994a40a23221d0b0897db3/users/fb3ede9d5aad42aea52f44098e8cccdf/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:41.864286 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747eb8d7-7095-474c-b4f1-3f3949735bda None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:41.864573 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747eb8d7-7095-474c-b4f1-3f3949735bda None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:41.864951 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747eb8d7-7095-474c-b4f1-3f3949735bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:41.894067 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-747eb8d7-7095-474c-b4f1-3f3949735bda None None] MFA Rules not processed for user `fb3ede9d5aad42aea52f44098e8cccdf`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:41.895303 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-747eb8d7-7095-474c-b4f1-3f3949735bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:41.964208 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1433/2856] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:41.970021 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eab2b2-bfa0-4cf9-b5cd-ffd5b78b2983 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:41.979514 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-e2eab2b2-bfa0-4cf9-b5cd-ffd5b78b2983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:41.980308 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747eb8d7-7095-474c-b4f1-3f3949735bda None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:41.980308 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-747eb8d7-7095-474c-b4f1-3f3949735bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:42.040250 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747eb8d7-7095-474c-b4f1-3f3949735bda None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:42.044695 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eab2b2-bfa0-4cf9-b5cd-ffd5b78b2983 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:42.044850 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d84a7-ddfe-4ab7-bc49-cdad44c72942 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:42.045978 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d84a7-ddfe-4ab7-bc49-cdad44c72942 service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:42.046314 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d84a7-ddfe-4ab7-bc49-cdad44c72942 service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:42.046586 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d84a7-ddfe-4ab7-bc49-cdad44c72942 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:42.049856 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce7e1c-c991-4757-a37b-822b1b49b299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:42.050510 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce7e1c-c991-4757-a37b-822b1b49b299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:42.050786 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce7e1c-c991-4757-a37b-822b1b49b299 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:42.051053 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce7e1c-c991-4757-a37b-822b1b49b299 admin admin] PATH_INFO: `/v3/projects/16622e8ade9845a88e84369104b64370` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:42.052175 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce7e1c-c991-4757-a37b-822b1b49b299 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16622e8ade9845a88e84369104b64370)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:42.054207 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce7e1c-c991-4757-a37b-822b1b49b299 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:42.055151 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d84a7-ddfe-4ab7-bc49-cdad44c72942 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:42.056558 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d84a7-ddfe-4ab7-bc49-cdad44c72942 service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:42.066678 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1434/2857] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:58:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:58:42.093709 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d84a7-ddfe-4ab7-bc49-cdad44c72942 service cinder] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:42.104299 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d84a7-ddfe-4ab7-bc49-cdad44c72942 service cinder] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:42.109481 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a68a1-ea43-4b55-a245-561221da3054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:42.110089 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a68a1-ea43-4b55-a245-561221da3054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:42.110366 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a68a1-ea43-4b55-a245-561221da3054 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:42.110636 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a68a1-ea43-4b55-a245-561221da3054 admin admin] PATH_INFO: `/v3/users/fb3ede9d5aad42aea52f44098e8cccdf` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:42.111758 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a68a1-ea43-4b55-a245-561221da3054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb3ede9d5aad42aea52f44098e8cccdf)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:42.113697 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a68a1-ea43-4b55-a245-561221da3054 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:42.157354 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-02ce7e1c-c991-4757-a37b-822b1b49b299 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16622e8ade9845a88e84369104b64370', 'request_id': 'req-02ce7e1c-c991-4757-a37b-822b1b49b299'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:42.162855 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-02ce7e1c-c991-4757-a37b-822b1b49b299 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16622e8ade9845a88e84369104b64370', 'request_id': 'req-02ce7e1c-c991-4757-a37b-822b1b49b299'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:42.201656 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-02ce7e1c-c991-4757-a37b-822b1b49b299 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16622e8ade9845a88e84369104b64370', 'request_id': 'req-02ce7e1c-c991-4757-a37b-822b1b49b299'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:42.213197 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-02ce7e1c-c991-4757-a37b-822b1b49b299 admin admin] The token cache is being invalidate because project 16622e8ade9845a88e84369104b64370 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:58:42.213423 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-02ce7e1c-c991-4757-a37b-822b1b49b299 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:42.214069 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-02ce7e1c-c991-4757-a37b-822b1b49b299 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:42.215887 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1424/2858] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:58:41 2022] DELETE /identity/v3/projects/16622e8ade9845a88e84369104b64370 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:58:42.220561 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92452745-a8b1-43bd-8bcb-867ffc41e29e None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:42.220849 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92452745-a8b1-43bd-8bcb-867ffc41e29e None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:42.221153 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92452745-a8b1-43bd-8bcb-867ffc41e29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:42.241811 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-92452745-a8b1-43bd-8bcb-867ffc41e29e None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:42.243029 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-92452745-a8b1-43bd-8bcb-867ffc41e29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:42.256600 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1e4a68a1-ea43-4b55-a245-561221da3054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb3ede9d5aad42aea52f44098e8cccdf'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:42.257202 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:42.303617 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1425/2859] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:58:42.312346 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b42345-bd09-4d4e-b8ac-aa81675b564a None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:42.312625 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b42345-bd09-4d4e-b8ac-aa81675b564a None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:42.312918 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b42345-bd09-4d4e-b8ac-aa81675b564a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:42.327961 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1e4a68a1-ea43-4b55-a245-561221da3054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb3ede9d5aad42aea52f44098e8cccdf'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:42.328585 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1e4a68a1-ea43-4b55-a245-561221da3054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb3ede9d5aad42aea52f44098e8cccdf'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:42.329249 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1e4a68a1-ea43-4b55-a245-561221da3054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb3ede9d5aad42aea52f44098e8cccdf'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:42.331925 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-a7b42345-bd09-4d4e-b8ac-aa81675b564a None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:42.333222 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-a7b42345-bd09-4d4e-b8ac-aa81675b564a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:42.336552 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1e4a68a1-ea43-4b55-a245-561221da3054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb3ede9d5aad42aea52f44098e8cccdf'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:42.341652 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:42.342374 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1426/2860] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:58:42.353280 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b42345-bd09-4d4e-b8ac-aa81675b564a None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:42.355450 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1435/2861] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:58:42 2022] DELETE /identity/v3/users/fb3ede9d5aad42aea52f44098e8cccdf => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:42.360727 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933adc97-0f2a-453c-8b76-b9a8bfbcbdd6 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:42.361016 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933adc97-0f2a-453c-8b76-b9a8bfbcbdd6 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:42.361327 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933adc97-0f2a-453c-8b76-b9a8bfbcbdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:42.363216 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b42345-bd09-4d4e-b8ac-aa81675b564a None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:42.380390 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-933adc97-0f2a-453c-8b76-b9a8bfbcbdd6 None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:42.381674 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-933adc97-0f2a-453c-8b76-b9a8bfbcbdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:42.424671 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b9b59-ebaf-4fcf-842d-5ad74ef96714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:42.425305 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b9b59-ebaf-4fcf-842d-5ad74ef96714 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:42.425584 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b9b59-ebaf-4fcf-842d-5ad74ef96714 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:42.425878 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b9b59-ebaf-4fcf-842d-5ad74ef96714 admin admin] PATH_INFO: `/v3/domains` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:42.426526 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b9b59-ebaf-4fcf-842d-5ad74ef96714 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 17:58:42.426856 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b9b59-ebaf-4fcf-842d-5ad74ef96714 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:42.428512 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b9b59-ebaf-4fcf-842d-5ad74ef96714 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:42.441446 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1427/2862] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 8 17:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 17:58:42.445492 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b9b59-ebaf-4fcf-842d-5ad74ef96714 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:42.446941 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1436/2863] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 17:58:42.455772 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b9b59-ebaf-4fcf-842d-5ad74ef96714 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:42.457246 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933adc97-0f2a-453c-8b76-b9a8bfbcbdd6 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:42.458591 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-933adc97-0f2a-453c-8b76-b9a8bfbcbdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:42.460097 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2898cb-2e68-4cf8-a238-9daa93f2d47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:42.460691 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2898cb-2e68-4cf8-a238-9daa93f2d47a admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:42.460971 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2898cb-2e68-4cf8-a238-9daa93f2d47a admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:42.461276 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2898cb-2e68-4cf8-a238-9daa93f2d47a admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:42.461893 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2898cb-2e68-4cf8-a238-9daa93f2d47a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:42.464024 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2898cb-2e68-4cf8-a238-9daa93f2d47a admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:42.516335 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933adc97-0f2a-453c-8b76-b9a8bfbcbdd6 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:42.519898 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2568a0-45db-4885-ad99-e54d557ae177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:42.520493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2568a0-45db-4885-ad99-e54d557ae177 service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:42.520767 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2568a0-45db-4885-ad99-e54d557ae177 service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:42.521049 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2568a0-45db-4885-ad99-e54d557ae177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:42.531205 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2568a0-45db-4885-ad99-e54d557ae177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:42.532713 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2568a0-45db-4885-ad99-e54d557ae177 service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:42.542141 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1437/2864] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:58:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 17:58:42.564131 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1428/2865] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:58:42 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:58:42.568348 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2568a0-45db-4885-ad99-e54d557ae177 service neutron] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:42.582372 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2568a0-45db-4885-ad99-e54d557ae177 service neutron] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:42.642729 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3278f-24ad-4500-8539-d029d076cf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:42.643341 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3278f-24ad-4500-8539-d029d076cf9c admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:42.643625 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3278f-24ad-4500-8539-d029d076cf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:42.643902 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3278f-24ad-4500-8539-d029d076cf9c admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:42.644527 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f3278f-24ad-4500-8539-d029d076cf9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:42.646495 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f3278f-24ad-4500-8539-d029d076cf9c admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:42.708139 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1438/2866] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:58:42 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:58:42.709334 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2898cb-2e68-4cf8-a238-9daa93f2d47a admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:42.720507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2898cb-2e68-4cf8-a238-9daa93f2d47a admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:42.725195 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2a034-bbb0-4a1d-a176-d85e58bf5bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:42.725789 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2a034-bbb0-4a1d-a176-d85e58bf5bfb admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:42.726073 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2a034-bbb0-4a1d-a176-d85e58bf5bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:42.726388 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2a034-bbb0-4a1d-a176-d85e58bf5bfb admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:42.727043 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c2a034-bbb0-4a1d-a176-d85e58bf5bfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:42.728639 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c2a034-bbb0-4a1d-a176-d85e58bf5bfb admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:42.740218 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1429/2867] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:58:42.746136 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3278f-24ad-4500-8539-d029d076cf9c admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:42.761218 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3278f-24ad-4500-8539-d029d076cf9c admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:42.764553 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717dee55-13d8-4e2f-8cb4-c5589bfb5667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:42.765201 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717dee55-13d8-4e2f-8cb4-c5589bfb5667 admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:42.765512 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717dee55-13d8-4e2f-8cb4-c5589bfb5667 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:42.765782 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717dee55-13d8-4e2f-8cb4-c5589bfb5667 admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:42.766471 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717dee55-13d8-4e2f-8cb4-c5589bfb5667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:42.768064 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717dee55-13d8-4e2f-8cb4-c5589bfb5667 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:42.781901 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1439/2868] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 17:58:42.783159 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2a034-bbb0-4a1d-a176-d85e58bf5bfb admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:42.793534 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2a034-bbb0-4a1d-a176-d85e58bf5bfb admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:42.799250 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6399789-dacb-4823-9c73-d07f08260917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:42.799906 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6399789-dacb-4823-9c73-d07f08260917 admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:42.800187 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6399789-dacb-4823-9c73-d07f08260917 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:42.800461 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6399789-dacb-4823-9c73-d07f08260917 admin admin] PATH_INFO: `/v3/projects/1a6e46d25c3842ecbe624eb9162451f0/users/9418ce0870424b5fa40747f4600a733c/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:42.818575 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6399789-dacb-4823-9c73-d07f08260917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a6e46d25c3842ecbe624eb9162451f0, user_id=9418ce0870424b5fa40747f4600a733c, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:42.821325 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6399789-dacb-4823-9c73-d07f08260917 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:42.890958 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1430/2869] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:58:42 2022] PUT /identity/v3/projects/1a6e46d25c3842ecbe624eb9162451f0/users/9418ce0870424b5fa40747f4600a733c/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:42.902450 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f463ec6-0e4e-4cf9-bd33-85d6967d4c30 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:42.902738 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f463ec6-0e4e-4cf9-bd33-85d6967d4c30 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:42.903015 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f463ec6-0e4e-4cf9-bd33-85d6967d4c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:42.917498 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:42.935205 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6399789-dacb-4823-9c73-d07f08260917 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:42.935897 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-7f463ec6-0e4e-4cf9-bd33-85d6967d4c30 None None] MFA Rules not processed for user `9418ce0870424b5fa40747f4600a733c`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:42.937384 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-7f463ec6-0e4e-4cf9-bd33-85d6967d4c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:42.937828 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-f6399789-dacb-4823-9c73-d07f08260917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:43.004227 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:43.009173 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1440/2870] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:43.014559 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f463ec6-0e4e-4cf9-bd33-85d6967d4c30 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:43.017994 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6399789-dacb-4823-9c73-d07f08260917 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:43.022762 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebad526-a159-48f3-8200-b344f1e33711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:43.023397 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebad526-a159-48f3-8200-b344f1e33711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:43.023927 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebad526-a159-48f3-8200-b344f1e33711 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:43.024068 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebad526-a159-48f3-8200-b344f1e33711 admin admin] PATH_INFO: `/v3/projects/e68e96ffbd994a40a23221d0b0897db3` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:43.024611 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f463ec6-0e4e-4cf9-bd33-85d6967d4c30 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:43.025231 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebad526-a159-48f3-8200-b344f1e33711 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e68e96ffbd994a40a23221d0b0897db3)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:43.027138 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebad526-a159-48f3-8200-b344f1e33711 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:43.030571 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d92ef-762a-4ca0-87c9-7ee8ceba40be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:43.040023 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d92ef-762a-4ca0-87c9-7ee8ceba40be admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:43.040023 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d92ef-762a-4ca0-87c9-7ee8ceba40be admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:43.040023 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d92ef-762a-4ca0-87c9-7ee8ceba40be admin admin] PATH_INFO: `/v3/projects` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:43.040023 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d92ef-762a-4ca0-87c9-7ee8ceba40be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:43.040023 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d92ef-762a-4ca0-87c9-7ee8ceba40be admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:43.146978 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1441/2871] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:58:43 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:58:43.151116 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d92ef-762a-4ca0-87c9-7ee8ceba40be admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:43.168411 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-2ebad526-a159-48f3-8200-b344f1e33711 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e68e96ffbd994a40a23221d0b0897db3', 'request_id': 'req-2ebad526-a159-48f3-8200-b344f1e33711'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:43.174016 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-2ebad526-a159-48f3-8200-b344f1e33711 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e68e96ffbd994a40a23221d0b0897db3', 'request_id': 'req-2ebad526-a159-48f3-8200-b344f1e33711'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:43.212499 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d92ef-762a-4ca0-87c9-7ee8ceba40be admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:43.247467 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-2ebad526-a159-48f3-8200-b344f1e33711 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e68e96ffbd994a40a23221d0b0897db3', 'request_id': 'req-2ebad526-a159-48f3-8200-b344f1e33711'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:43.259762 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-2ebad526-a159-48f3-8200-b344f1e33711 admin admin] The token cache is being invalidate because project e68e96ffbd994a40a23221d0b0897db3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:58:43.259999 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-2ebad526-a159-48f3-8200-b344f1e33711 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:43.261328 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-2ebad526-a159-48f3-8200-b344f1e33711 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:43.262826 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1431/2872] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:58:42 2022] DELETE /identity/v3/projects/e68e96ffbd994a40a23221d0b0897db3 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 17:58:43.271674 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d2ea7-61bd-45df-910c-17e61b996963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:43.272349 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d2ea7-61bd-45df-910c-17e61b996963 admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:43.272627 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d2ea7-61bd-45df-910c-17e61b996963 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:43.272896 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d2ea7-61bd-45df-910c-17e61b996963 admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:43.273597 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d2ea7-61bd-45df-910c-17e61b996963 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:43.275576 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d2ea7-61bd-45df-910c-17e61b996963 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:43.363336 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1442/2873] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:58:43 2022] POST /identity/v3/users => generated 292 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:58:43.367601 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebad526-a159-48f3-8200-b344f1e33711 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:43.369226 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-2ebad526-a159-48f3-8200-b344f1e33711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:43.384090 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebad526-a159-48f3-8200-b344f1e33711 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:43.389569 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86360300-d9d8-4691-9ee0-91576f071737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:43.395377 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86360300-d9d8-4691-9ee0-91576f071737 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:43.395377 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86360300-d9d8-4691-9ee0-91576f071737 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:43.395377 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86360300-d9d8-4691-9ee0-91576f071737 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:43.395377 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86360300-d9d8-4691-9ee0-91576f071737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:43.395377 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86360300-d9d8-4691-9ee0-91576f071737 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:43.405504 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1432/2874] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:58:43.409758 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d2ea7-61bd-45df-910c-17e61b996963 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:43.421133 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d2ea7-61bd-45df-910c-17e61b996963 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:43.425921 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e085bc-bafa-45f1-be83-572d89ef0aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:43.426543 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e085bc-bafa-45f1-be83-572d89ef0aca admin admin] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:43.426825 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e085bc-bafa-45f1-be83-572d89ef0aca admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:43.427099 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e085bc-bafa-45f1-be83-572d89ef0aca admin admin] PATH_INFO: `/v3/roles` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:43.427754 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e085bc-bafa-45f1-be83-572d89ef0aca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:43.429423 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e085bc-bafa-45f1-be83-572d89ef0aca admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:43.436085 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:43.441870 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1443/2875] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:58:43.446592 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86360300-d9d8-4691-9ee0-91576f071737 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:43.458296 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86360300-d9d8-4691-9ee0-91576f071737 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:43.463022 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f05e07-0ce4-40c4-95fc-c4c5c10ec85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:43.463666 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f05e07-0ce4-40c4-95fc-c4c5c10ec85a admin admin] REQUEST_METHOD: `PUT` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:43.463945 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f05e07-0ce4-40c4-95fc-c4c5c10ec85a admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:43.464324 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f05e07-0ce4-40c4-95fc-c4c5c10ec85a admin admin] PATH_INFO: `/v3/projects/f27221b7356d4a549dee99b2dc4f581c/users/3337ff3f10eb4df5971b2379120cab4f/roles/adc45cdd4c9543b3b8b24141870f4b11` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:43.481916 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f05e07-0ce4-40c4-95fc-c4c5c10ec85a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f27221b7356d4a549dee99b2dc4f581c, user_id=3337ff3f10eb4df5971b2379120cab4f, role_id=adc45cdd4c9543b3b8b24141870f4b11)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:43.484936 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f05e07-0ce4-40c4-95fc-c4c5c10ec85a admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:43.539736 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1433/2876] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:58:43 2022] PUT /identity/v3/projects/f27221b7356d4a549dee99b2dc4f581c/users/3337ff3f10eb4df5971b2379120cab4f/roles/adc45cdd4c9543b3b8b24141870f4b11 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:43.549960 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573727a-6807-4ec6-bb24-4b1c5118f305 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:43.552225 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573727a-6807-4ec6-bb24-4b1c5118f305 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:43.552225 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573727a-6807-4ec6-bb24-4b1c5118f305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:43.578709 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-7573727a-6807-4ec6-bb24-4b1c5118f305 None None] MFA Rules not processed for user `3337ff3f10eb4df5971b2379120cab4f`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:43.579926 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-7573727a-6807-4ec6-bb24-4b1c5118f305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:43.642676 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1444/2877] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:43.647293 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f05e07-0ce4-40c4-95fc-c4c5c10ec85a admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:43.711377 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f05e07-0ce4-40c4-95fc-c4c5c10ec85a admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:43.716325 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9065f8f-80c8-4612-8b67-8b6551d653f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:43.716928 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9065f8f-80c8-4612-8b67-8b6551d653f7 admin admin] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:43.717239 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9065f8f-80c8-4612-8b67-8b6551d653f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:43.717509 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9065f8f-80c8-4612-8b67-8b6551d653f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:43.718140 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9065f8f-80c8-4612-8b67-8b6551d653f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:43.720029 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9065f8f-80c8-4612-8b67-8b6551d653f7 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:43.815079 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1434/2878] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 8 17:58:43 2022] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 17:58:43.819207 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573727a-6807-4ec6-bb24-4b1c5118f305 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:43.830050 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573727a-6807-4ec6-bb24-4b1c5118f305 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:43.886964 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4645a-7fa9-4f62-a335-d150c869bfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:43.887565 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4645a-7fa9-4f62-a335-d150c869bfaf admin admin] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:43.887847 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4645a-7fa9-4f62-a335-d150c869bfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:43.888121 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4645a-7fa9-4f62-a335-d150c869bfaf admin admin] PATH_INFO: `/v3/users` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:43.888762 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4645a-7fa9-4f62-a335-d150c869bfaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:43.890752 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4645a-7fa9-4f62-a335-d150c869bfaf admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:44.004223 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1445/2879] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 8 17:58:43 2022] POST /identity/v3/users => generated 299 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 17:58:44.008272 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9065f8f-80c8-4612-8b67-8b6551d653f7 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:44.019029 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9065f8f-80c8-4612-8b67-8b6551d653f7 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:44.023637 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d2925-4b4c-4bc0-97e3-58bf637f3f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:44.024229 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d2925-4b4c-4bc0-97e3-58bf637f3f08 admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:44.024509 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d2925-4b4c-4bc0-97e3-58bf637f3f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:44.024780 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d2925-4b4c-4bc0-97e3-58bf637f3f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:44.025446 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d2925-4b4c-4bc0-97e3-58bf637f3f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:44.027032 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d2925-4b4c-4bc0-97e3-58bf637f3f08 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:44.038188 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1435/2880] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:58:44.042215 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4645a-7fa9-4f62-a335-d150c869bfaf admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:44.052961 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4645a-7fa9-4f62-a335-d150c869bfaf admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:44.057569 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f7eab-d0b6-4e0d-a6e1-57e958eb79de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:44.058204 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f7eab-d0b6-4e0d-a6e1-57e958eb79de admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:44.058488 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f7eab-d0b6-4e0d-a6e1-57e958eb79de admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:44.058777 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f7eab-d0b6-4e0d-a6e1-57e958eb79de admin admin] PATH_INFO: `/v3/projects/348339d8cac442afa13515b48de01e62/users/7c66c8e4aef1420f85bf65976cd4e381/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:44.074255 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f7eab-d0b6-4e0d-a6e1-57e958eb79de admin admin] RBAC: Authorizing `identity:create_grant(project_id=348339d8cac442afa13515b48de01e62, user_id=7c66c8e4aef1420f85bf65976cd4e381, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:44.075916 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f7eab-d0b6-4e0d-a6e1-57e958eb79de admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:44.178867 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1446/2881] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:58:44 2022] PUT /identity/v3/projects/348339d8cac442afa13515b48de01e62/users/7c66c8e4aef1420f85bf65976cd4e381/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:44.183039 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d2925-4b4c-4bc0-97e3-58bf637f3f08 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:44.193298 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d2925-4b4c-4bc0-97e3-58bf637f3f08 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:44.209602 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:44.249977 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e0945-d1bb-481b-a428-7b50aae53ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:44.250578 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e0945-d1bb-481b-a428-7b50aae53ebe admin admin] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:44.250860 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e0945-d1bb-481b-a428-7b50aae53ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:44.251132 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e0945-d1bb-481b-a428-7b50aae53ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:44.251795 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e0945-d1bb-481b-a428-7b50aae53ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:44.253530 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e0945-d1bb-481b-a428-7b50aae53ebe admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:44.263387 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1436/2882] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 8 17:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 17:58:44.267836 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f7eab-d0b6-4e0d-a6e1-57e958eb79de admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:44.278233 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f7eab-d0b6-4e0d-a6e1-57e958eb79de admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:44.283892 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13066bdf-ae99-4427-bf24-141816552b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:44.284537 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13066bdf-ae99-4427-bf24-141816552b59 admin admin] REQUEST_METHOD: `PUT` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:44.284814 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13066bdf-ae99-4427-bf24-141816552b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:44.285118 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13066bdf-ae99-4427-bf24-141816552b59 admin admin] PATH_INFO: `/v3/projects/348339d8cac442afa13515b48de01e62/users/7c66c8e4aef1420f85bf65976cd4e381/roles/5c25aa917ab34baabb795c54dd8a4d02` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:44.287022 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13066bdf-ae99-4427-bf24-141816552b59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=348339d8cac442afa13515b48de01e62, user_id=7c66c8e4aef1420f85bf65976cd4e381, role_id=5c25aa917ab34baabb795c54dd8a4d02)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:44.289704 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13066bdf-ae99-4427-bf24-141816552b59 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:44.300631 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1447/2883] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 8 17:58:44 2022] PUT /identity/v3/projects/348339d8cac442afa13515b48de01e62/users/7c66c8e4aef1420f85bf65976cd4e381/roles/5c25aa917ab34baabb795c54dd8a4d02 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:44.312463 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653081a0-ad69-4b84-8bbd-2979333ecf9b None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:44.312736 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653081a0-ad69-4b84-8bbd-2979333ecf9b None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:44.313009 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653081a0-ad69-4b84-8bbd-2979333ecf9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:44.340993 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-653081a0-ad69-4b84-8bbd-2979333ecf9b None None] MFA Rules not processed for user `7c66c8e4aef1420f85bf65976cd4e381`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:44.342656 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-653081a0-ad69-4b84-8bbd-2979333ecf9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:44.411395 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1437/2884] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:44.423400 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13066bdf-ae99-4427-bf24-141816552b59 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:44.425079 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-13066bdf-ae99-4427-bf24-141816552b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:44.471018 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:44.482104 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13066bdf-ae99-4427-bf24-141816552b59 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:44.486161 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01273957-286a-4863-aa70-4eafa3af85ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:44.486749 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01273957-286a-4863-aa70-4eafa3af85ff service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:44.487031 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01273957-286a-4863-aa70-4eafa3af85ff service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:44.487300 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01273957-286a-4863-aa70-4eafa3af85ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:44.489021 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-01273957-286a-4863-aa70-4eafa3af85ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:44.546713 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01273957-286a-4863-aa70-4eafa3af85ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:44.548196 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01273957-286a-4863-aa70-4eafa3af85ff service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:44.557316 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1448/2885] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:58:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:58:46.449244 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653081a0-ad69-4b84-8bbd-2979333ecf9b None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:46.450647 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-653081a0-ad69-4b84-8bbd-2979333ecf9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:46.463019 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653081a0-ad69-4b84-8bbd-2979333ecf9b None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:46.466889 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156f0fc-22b7-4c5e-a144-2f6b7abc3891 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:46.467479 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156f0fc-22b7-4c5e-a144-2f6b7abc3891 service cinder] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:46.467759 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156f0fc-22b7-4c5e-a144-2f6b7abc3891 service cinder] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:46.468030 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156f0fc-22b7-4c5e-a144-2f6b7abc3891 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:46.524741 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e156f0fc-22b7-4c5e-a144-2f6b7abc3891 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:46.526259 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e156f0fc-22b7-4c5e-a144-2f6b7abc3891 service cinder] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:46.535217 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1438/2886] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:58:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:58:47.915889 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01273957-286a-4863-aa70-4eafa3af85ff service cinder] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:47.924715 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01273957-286a-4863-aa70-4eafa3af85ff service cinder] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:47.928235 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a59ba-f5f8-41c9-85bc-935e776f10d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44340c24b5784b58b829e2faa62ac58a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:47.928826 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a59ba-f5f8-41c9-85bc-935e776f10d0 service cinder] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:47.929131 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a59ba-f5f8-41c9-85bc-935e776f10d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:47.929406 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a59ba-f5f8-41c9-85bc-935e776f10d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:47.938689 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a59ba-f5f8-41c9-85bc-935e776f10d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:47.940097 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a59ba-f5f8-41c9-85bc-935e776f10d0 service cinder] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:47.949395 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1449/2887] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:58:47 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:58:50.643537 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156f0fc-22b7-4c5e-a144-2f6b7abc3891 service cinder] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:50.645020 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-e156f0fc-22b7-4c5e-a144-2f6b7abc3891 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:50.689651 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=100 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:50.741286 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156f0fc-22b7-4c5e-a144-2f6b7abc3891 service cinder] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:50.746354 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a929478-bfb2-4c32-88c2-4c7c7a372ac9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68717c19e74e434da825d9b1d6ca202a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:50.746953 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a929478-bfb2-4c32-88c2-4c7c7a372ac9 service placement] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:50.747234 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a929478-bfb2-4c32-88c2-4c7c7a372ac9 service placement] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:50.747504 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a929478-bfb2-4c32-88c2-4c7c7a372ac9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:50.749267 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-4a929478-bfb2-4c32-88c2-4c7c7a372ac9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:50.761404 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a929478-bfb2-4c32-88c2-4c7c7a372ac9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:50.763011 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a929478-bfb2-4c32-88c2-4c7c7a372ac9 service placement] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:50.773844 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1439/2888] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:58:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:58:52.529607 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a59ba-f5f8-41c9-85bc-935e776f10d0 service cinder] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:52.593320 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a59ba-f5f8-41c9-85bc-935e776f10d0 service cinder] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:52.599950 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6d3d7-aa88-4f70-adfe-1c471133fefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:52.600613 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6d3d7-aa88-4f70-adfe-1c471133fefe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:52.600890 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6d3d7-aa88-4f70-adfe-1c471133fefe admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:52.601198 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6d3d7-aa88-4f70-adfe-1c471133fefe admin admin] PATH_INFO: `/v3/users/9418ce0870424b5fa40747f4600a733c` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:52.602344 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce6d3d7-aa88-4f70-adfe-1c471133fefe admin admin] RBAC: Authorizing `identity:delete_user(user_id=9418ce0870424b5fa40747f4600a733c)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:52.604377 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce6d3d7-aa88-4f70-adfe-1c471133fefe admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:52.753318 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-8ce6d3d7-aa88-4f70-adfe-1c471133fefe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9418ce0870424b5fa40747f4600a733c'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:52.795902 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-8ce6d3d7-aa88-4f70-adfe-1c471133fefe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9418ce0870424b5fa40747f4600a733c'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:52.797146 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-8ce6d3d7-aa88-4f70-adfe-1c471133fefe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9418ce0870424b5fa40747f4600a733c'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:52.797885 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-8ce6d3d7-aa88-4f70-adfe-1c471133fefe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9418ce0870424b5fa40747f4600a733c'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:52.804774 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-8ce6d3d7-aa88-4f70-adfe-1c471133fefe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9418ce0870424b5fa40747f4600a733c'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:52.822529 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1450/2889] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:58:52 2022] DELETE /identity/v3/users/9418ce0870424b5fa40747f4600a733c => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:52.827089 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218e030-9abf-41e5-b55f-071c0940eedc None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:52.827514 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218e030-9abf-41e5-b55f-071c0940eedc None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:52.827635 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218e030-9abf-41e5-b55f-071c0940eedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:52.846507 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-8218e030-9abf-41e5-b55f-071c0940eedc None None] MFA Rules not processed for user `f82db915cef84d91b03fd2cabdc99332`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:58:52.847730 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-8218e030-9abf-41e5-b55f-071c0940eedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:52.906005 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1440/2890] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 8 17:58:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:58:52.915918 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6d3d7-aa88-4f70-adfe-1c471133fefe admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:52.917437 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-8ce6d3d7-aa88-4f70-adfe-1c471133fefe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:52.923710 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:52.975905 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6d3d7-aa88-4f70-adfe-1c471133fefe admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:52.979609 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005768b9-8e7f-4f3e-949d-5eb49717ee67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:52.980210 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005768b9-8e7f-4f3e-949d-5eb49717ee67 service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:52.980483 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005768b9-8e7f-4f3e-949d-5eb49717ee67 service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:52.980755 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005768b9-8e7f-4f3e-949d-5eb49717ee67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:52.991571 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005768b9-8e7f-4f3e-949d-5eb49717ee67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:52.992980 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005768b9-8e7f-4f3e-949d-5eb49717ee67 service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:53.003390 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1451/2891] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:58:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:58:53.364283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218e030-9abf-41e5-b55f-071c0940eedc None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:53.366449 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-8218e030-9abf-41e5-b55f-071c0940eedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:53.381261 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218e030-9abf-41e5-b55f-071c0940eedc None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:53.386085 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905e772-39b6-406c-86d3-fa816181782c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:53.387823 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905e772-39b6-406c-86d3-fa816181782c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:53.388107 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905e772-39b6-406c-86d3-fa816181782c admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:53.388383 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905e772-39b6-406c-86d3-fa816181782c admin admin] PATH_INFO: `/v3/projects/1a6e46d25c3842ecbe624eb9162451f0` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:53.389608 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2905e772-39b6-406c-86d3-fa816181782c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a6e46d25c3842ecbe624eb9162451f0)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:53.391995 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2905e772-39b6-406c-86d3-fa816181782c admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:53.482697 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-2905e772-39b6-406c-86d3-fa816181782c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a6e46d25c3842ecbe624eb9162451f0', 'request_id': 'req-2905e772-39b6-406c-86d3-fa816181782c'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:53.488777 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-2905e772-39b6-406c-86d3-fa816181782c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a6e46d25c3842ecbe624eb9162451f0', 'request_id': 'req-2905e772-39b6-406c-86d3-fa816181782c'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:53.533378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-2905e772-39b6-406c-86d3-fa816181782c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a6e46d25c3842ecbe624eb9162451f0', 'request_id': 'req-2905e772-39b6-406c-86d3-fa816181782c'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:53.544309 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-2905e772-39b6-406c-86d3-fa816181782c admin admin] The token cache is being invalidate because project 1a6e46d25c3842ecbe624eb9162451f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:58:53.544605 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-2905e772-39b6-406c-86d3-fa816181782c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:53.545310 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-2905e772-39b6-406c-86d3-fa816181782c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:53.548413 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1441/2892] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:58:53 2022] DELETE /identity/v3/projects/1a6e46d25c3842ecbe624eb9162451f0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:53.551174 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005768b9-8e7f-4f3e-949d-5eb49717ee67 service neutron] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:53.560797 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005768b9-8e7f-4f3e-949d-5eb49717ee67 service neutron] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:53.618367 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b2fff-ec15-474f-b6bb-31e743950af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:53.619073 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b2fff-ec15-474f-b6bb-31e743950af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:53.619278 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b2fff-ec15-474f-b6bb-31e743950af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:53.619556 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b2fff-ec15-474f-b6bb-31e743950af4 admin admin] PATH_INFO: `/v3/users/3337ff3f10eb4df5971b2379120cab4f` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:53.620677 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b2fff-ec15-474f-b6bb-31e743950af4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3337ff3f10eb4df5971b2379120cab4f)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:53.622640 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b2fff-ec15-474f-b6bb-31e743950af4 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:53.838090 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-fa9b2fff-ec15-474f-b6bb-31e743950af4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3337ff3f10eb4df5971b2379120cab4f'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:53.892861 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-fa9b2fff-ec15-474f-b6bb-31e743950af4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3337ff3f10eb4df5971b2379120cab4f'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:53.893525 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-fa9b2fff-ec15-474f-b6bb-31e743950af4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3337ff3f10eb4df5971b2379120cab4f'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:53.894134 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-fa9b2fff-ec15-474f-b6bb-31e743950af4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3337ff3f10eb4df5971b2379120cab4f'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:53.901421 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-fa9b2fff-ec15-474f-b6bb-31e743950af4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3337ff3f10eb4df5971b2379120cab4f'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:53.918757 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1452/2893] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:58:53 2022] DELETE /identity/v3/users/3337ff3f10eb4df5971b2379120cab4f => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:54.335378 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905e772-39b6-406c-86d3-fa816181782c admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:54.336862 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-2905e772-39b6-406c-86d3-fa816181782c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:54.359207 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905e772-39b6-406c-86d3-fa816181782c admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:54.383459 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:54.411987 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df16755-68e3-4810-b1bb-31cc18f8116d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:54.412626 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df16755-68e3-4810-b1bb-31cc18f8116d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:54.412906 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df16755-68e3-4810-b1bb-31cc18f8116d admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:54.413216 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df16755-68e3-4810-b1bb-31cc18f8116d admin admin] PATH_INFO: `/v3/projects/f27221b7356d4a549dee99b2dc4f581c` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:54.414502 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df16755-68e3-4810-b1bb-31cc18f8116d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f27221b7356d4a549dee99b2dc4f581c)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:54.416237 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df16755-68e3-4810-b1bb-31cc18f8116d admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:54.550565 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-2df16755-68e3-4810-b1bb-31cc18f8116d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f27221b7356d4a549dee99b2dc4f581c', 'request_id': 'req-2df16755-68e3-4810-b1bb-31cc18f8116d'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:54.555998 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-2df16755-68e3-4810-b1bb-31cc18f8116d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f27221b7356d4a549dee99b2dc4f581c', 'request_id': 'req-2df16755-68e3-4810-b1bb-31cc18f8116d'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:54.619319 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-2df16755-68e3-4810-b1bb-31cc18f8116d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f27221b7356d4a549dee99b2dc4f581c', 'request_id': 'req-2df16755-68e3-4810-b1bb-31cc18f8116d'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:54.631671 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-2df16755-68e3-4810-b1bb-31cc18f8116d admin admin] The token cache is being invalidate because project f27221b7356d4a549dee99b2dc4f581c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:58:54.631959 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-2df16755-68e3-4810-b1bb-31cc18f8116d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:54.632596 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-2df16755-68e3-4810-b1bb-31cc18f8116d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:54.634157 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1442/2894] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:58:54 2022] DELETE /identity/v3/projects/f27221b7356d4a549dee99b2dc4f581c => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:54.638122 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b2fff-ec15-474f-b6bb-31e743950af4 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:54.639503 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-fa9b2fff-ec15-474f-b6bb-31e743950af4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:54.653439 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b2fff-ec15-474f-b6bb-31e743950af4 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:54.672947 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:54.710278 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c9e56-9bee-48d9-8811-c9d0ffbd4038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:54.710896 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c9e56-9bee-48d9-8811-c9d0ffbd4038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:54.711172 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c9e56-9bee-48d9-8811-c9d0ffbd4038 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:54.711438 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c9e56-9bee-48d9-8811-c9d0ffbd4038 admin admin] PATH_INFO: `/v3/users/7c66c8e4aef1420f85bf65976cd4e381` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:54.712545 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c9e56-9bee-48d9-8811-c9d0ffbd4038 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c66c8e4aef1420f85bf65976cd4e381)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:54.714530 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c9e56-9bee-48d9-8811-c9d0ffbd4038 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:54.918369 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1f5c9e56-9bee-48d9-8811-c9d0ffbd4038 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c66c8e4aef1420f85bf65976cd4e381'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:54.978904 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1f5c9e56-9bee-48d9-8811-c9d0ffbd4038 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c66c8e4aef1420f85bf65976cd4e381'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:54.979531 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1f5c9e56-9bee-48d9-8811-c9d0ffbd4038 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c66c8e4aef1420f85bf65976cd4e381'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:54.980141 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1f5c9e56-9bee-48d9-8811-c9d0ffbd4038 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c66c8e4aef1420f85bf65976cd4e381'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:54.988264 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-1f5c9e56-9bee-48d9-8811-c9d0ffbd4038 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c66c8e4aef1420f85bf65976cd4e381'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:55.005633 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1453/2895] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 17:58:54 2022] DELETE /identity/v3/users/7c66c8e4aef1420f85bf65976cd4e381 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:58:55.523942 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df16755-68e3-4810-b1bb-31cc18f8116d admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:58:55.525489 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-2df16755-68e3-4810-b1bb-31cc18f8116d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:58:55.538953 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df16755-68e3-4810-b1bb-31cc18f8116d admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:58:55.599220 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b66384-8db1-4ace-8b5d-fb72b2f9fba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:58:55.599841 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b66384-8db1-4ace-8b5d-fb72b2f9fba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:58:55.600119 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b66384-8db1-4ace-8b5d-fb72b2f9fba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:58:55.600389 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b66384-8db1-4ace-8b5d-fb72b2f9fba6 admin admin] PATH_INFO: `/v3/projects/348339d8cac442afa13515b48de01e62` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:58:55.601515 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b66384-8db1-4ace-8b5d-fb72b2f9fba6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=348339d8cac442afa13515b48de01e62)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:58:55.603396 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b66384-8db1-4ace-8b5d-fb72b2f9fba6 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:58:55.710835 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-b2b66384-8db1-4ace-8b5d-fb72b2f9fba6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '348339d8cac442afa13515b48de01e62', 'request_id': 'req-b2b66384-8db1-4ace-8b5d-fb72b2f9fba6'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:55.716784 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-b2b66384-8db1-4ace-8b5d-fb72b2f9fba6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '348339d8cac442afa13515b48de01e62', 'request_id': 'req-b2b66384-8db1-4ace-8b5d-fb72b2f9fba6'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:55.773202 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-b2b66384-8db1-4ace-8b5d-fb72b2f9fba6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '348339d8cac442afa13515b48de01e62', 'request_id': 'req-b2b66384-8db1-4ace-8b5d-fb72b2f9fba6'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:55.774360 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:58:55.784747 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-b2b66384-8db1-4ace-8b5d-fb72b2f9fba6 admin admin] The token cache is being invalidate because project 348339d8cac442afa13515b48de01e62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 17:58:55.798262 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-b2b66384-8db1-4ace-8b5d-fb72b2f9fba6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:55.798262 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-b2b66384-8db1-4ace-8b5d-fb72b2f9fba6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 17:58:55.798262 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1443/2896] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 17:58:55 2022] DELETE /identity/v3/projects/348339d8cac442afa13515b48de01e62 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 17:59:05.007622 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:59:05.859159 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=3 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:59:13.190325 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5eda80-1a5d-4088-85e7-ce1d4b71b843 None None] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:59:13.190915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5eda80-1a5d-4088-85e7-ce1d4b71b843 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:59:13.190915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5eda80-1a5d-4088-85e7-ce1d4b71b843 None None] PATH_INFO: `/` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:59:13.192360 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1454/2897] 10.222.0.70 () {54 vars in 921 bytes} [Mon Aug 8 17:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:59:13.198579 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed233759-a401-49b5-9733-e01619f38d2f None None] REQUEST_METHOD: `POST` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:59:13.199337 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed233759-a401-49b5-9733-e01619f38d2f None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:59:13.199337 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed233759-a401-49b5-9733-e01619f38d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:59:13.251193 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.auth.core [None req-ed233759-a401-49b5-9733-e01619f38d2f None None] MFA Rules not processed for user `bdb6f0f0cde24b05a34b78d48dc45c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=86919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:59:13.252415 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-ed233759-a401-49b5-9733-e01619f38d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:59:13.341515 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1444/2898] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Aug 8 17:59:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:59:13.353868 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5eda80-1a5d-4088-85e7-ce1d4b71b843 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:59:13.355625 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-9f5eda80-1a5d-4088-85e7-ce1d4b71b843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:59:13.369584 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5eda80-1a5d-4088-85e7-ce1d4b71b843 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:59:13.373080 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d467110-c494-4ce3-a474-09da2d31810c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:59:13.373674 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d467110-c494-4ce3-a474-09da2d31810c service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:59:13.373956 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d467110-c494-4ce3-a474-09da2d31810c service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:59:13.374245 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d467110-c494-4ce3-a474-09da2d31810c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:59:13.381819 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d467110-c494-4ce3-a474-09da2d31810c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:59:13.383237 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d467110-c494-4ce3-a474-09da2d31810c service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:59:13.391257 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1455/2899] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:59:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:59:13.474022 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6431c-b7a4-495d-af68-ea64def2ffa3 None None] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:59:13.474316 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6431c-b7a4-495d-af68-ea64def2ffa3 None None] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:59:13.474592 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6431c-b7a4-495d-af68-ea64def2ffa3 None None] PATH_INFO: `/` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:59:13.475933 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1445/2900] 10.222.0.70 () {54 vars in 921 bytes} [Mon Aug 8 17:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 17:59:13.481200 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1f4f7-f47b-42c6-9cd4-447d0bca0b15 None None] REQUEST_METHOD: `POST` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:59:13.481493 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1f4f7-f47b-42c6-9cd4-447d0bca0b15 None None] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:59:13.481772 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1f4f7-f47b-42c6-9cd4-447d0bca0b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:59:13.515716 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.auth.core [None req-ceb1f4f7-f47b-42c6-9cd4-447d0bca0b15 None None] MFA Rules not processed for user `3973b8fbfbb9475896e4e110ca8aa615`. Rule list: `[]` (Enabled: `True`). {{(pid=86920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 17:59:13.516928 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-ceb1f4f7-f47b-42c6-9cd4-447d0bca0b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 17:59:13.600878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1456/2901] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Aug 8 17:59:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 17:59:13.611941 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6431c-b7a4-495d-af68-ea64def2ffa3 None None] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 17:59:13.622843 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6431c-b7a4-495d-af68-ea64def2ffa3 None None] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 17:59:13.626441 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ce514-47e6-449f-aeec-a8a3e2d3c3e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 17:59:13.627028 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ce514-47e6-449f-aeec-a8a3e2d3c3e5 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 17:59:13.627307 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ce514-47e6-449f-aeec-a8a3e2d3c3e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 17:59:13.627706 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ce514-47e6-449f-aeec-a8a3e2d3c3e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 17:59:13.637880 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ce514-47e6-449f-aeec-a8a3e2d3c3e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 17:59:13.639309 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ce514-47e6-449f-aeec-a8a3e2d3c3e5 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 17:59:13.650412 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1446/2902] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 17:59:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 17:59:23.597835 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=49 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:59:23.645838 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=42 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:00:41.786453 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1f4f7-f47b-42c6-9cd4-447d0bca0b15 None None] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 18:00:41.788275 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-ceb1f4f7-f47b-42c6-9cd4-447d0bca0b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 18:00:41.805111 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1f4f7-f47b-42c6-9cd4-447d0bca0b15 None None] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 18:00:41.806247 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360fc81-7080-48c4-8945-0140be344f56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 18:00:41.806891 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360fc81-7080-48c4-8945-0140be344f56 service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 18:00:41.807177 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360fc81-7080-48c4-8945-0140be344f56 service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 18:00:41.807448 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360fc81-7080-48c4-8945-0140be344f56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 18:00:41.809265 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-4360fc81-7080-48c4-8945-0140be344f56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 18:00:41.824467 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4360fc81-7080-48c4-8945-0140be344f56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 18:00:41.825945 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4360fc81-7080-48c4-8945-0140be344f56 service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 18:00:41.837459 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1457/2903] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 18:00:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 18:00:43.017054 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ce514-47e6-449f-aeec-a8a3e2d3c3e5 service neutron] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 18:00:43.026452 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ce514-47e6-449f-aeec-a8a3e2d3c3e5 service neutron] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 18:00:43.030105 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d18e84-bd57-4ace-841f-2617073d8bf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 18:00:43.030692 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d18e84-bd57-4ace-841f-2617073d8bf9 service neutron] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 18:00:43.030975 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d18e84-bd57-4ace-841f-2617073d8bf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 18:00:43.031246 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d18e84-bd57-4ace-841f-2617073d8bf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 18:00:43.032956 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-74d18e84-bd57-4ace-841f-2617073d8bf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 18:00:43.049383 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d18e84-bd57-4ace-841f-2617073d8bf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 18:00:43.051027 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d18e84-bd57-4ace-841f-2617073d8bf9 service neutron] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 18:00:43.064346 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1447/2904] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 18:00:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 18:00:50.716581 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360fc81-7080-48c4-8945-0140be344f56 service neutron] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 18:00:50.725554 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360fc81-7080-48c4-8945-0140be344f56 service neutron] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 18:00:50.729278 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59942028-228b-4887-918a-3d85b0a220d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb6f0f0cde24b05a34b78d48dc45c0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 18:00:50.729878 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59942028-228b-4887-918a-3d85b0a220d9 service neutron] REQUEST_METHOD: `GET` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 18:00:50.730165 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59942028-228b-4887-918a-3d85b0a220d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 18:00:50.730600 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59942028-228b-4887-918a-3d85b0a220d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 18:00:50.732516 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-59942028-228b-4887-918a-3d85b0a220d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 18:00:50.804581 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59942028-228b-4887-918a-3d85b0a220d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 18:00:50.806044 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59942028-228b-4887-918a-3d85b0a220d9 service neutron] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 18:00:50.816915 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1458/2905] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 18:00:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 18:00:52.972156 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d18e84-bd57-4ace-841f-2617073d8bf9 service neutron] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 18:00:52.974325 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-74d18e84-bd57-4ace-841f-2617073d8bf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 18:00:52.991973 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d18e84-bd57-4ace-841f-2617073d8bf9 service neutron] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 18:00:53.001009 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdab15a-7092-48bb-ad8e-422400160cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 18:00:53.001009 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdab15a-7092-48bb-ad8e-422400160cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 18:00:53.001009 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdab15a-7092-48bb-ad8e-422400160cca admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 18:00:53.001009 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdab15a-7092-48bb-ad8e-422400160cca admin admin] PATH_INFO: `/v3/users/3195fa3ae35a463da7bebb512dc0d817` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 18:00:53.001512 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdab15a-7092-48bb-ad8e-422400160cca admin admin] RBAC: Authorizing `identity:delete_user(user_id=3195fa3ae35a463da7bebb512dc0d817)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 18:00:53.001990 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdab15a-7092-48bb-ad8e-422400160cca admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 18:00:53.228054 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-0fdab15a-7092-48bb-ad8e-422400160cca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3195fa3ae35a463da7bebb512dc0d817'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 18:00:53.310958 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-0fdab15a-7092-48bb-ad8e-422400160cca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3195fa3ae35a463da7bebb512dc0d817'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 18:00:53.311532 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-0fdab15a-7092-48bb-ad8e-422400160cca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3195fa3ae35a463da7bebb512dc0d817'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 18:00:53.312148 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-0fdab15a-7092-48bb-ad8e-422400160cca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3195fa3ae35a463da7bebb512dc0d817'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 18:00:53.320141 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-0fdab15a-7092-48bb-ad8e-422400160cca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3195fa3ae35a463da7bebb512dc0d817'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 18:00:53.338088 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1448/2906] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 18:00:52 2022] DELETE /identity/v3/users/3195fa3ae35a463da7bebb512dc0d817 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 18:00:53.584586 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59942028-228b-4887-918a-3d85b0a220d9 service neutron] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 18:00:53.596850 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59942028-228b-4887-918a-3d85b0a220d9 service neutron] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 18:00:53.657335 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1bae58-e97a-46a5-958b-c6e086a2e676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 18:00:53.657967 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bae58-e97a-46a5-958b-c6e086a2e676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 18:00:53.658253 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bae58-e97a-46a5-958b-c6e086a2e676 admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 18:00:53.658532 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bae58-e97a-46a5-958b-c6e086a2e676 admin admin] PATH_INFO: `/v3/projects/d837ee9c5edb438c88b870a4945fac0a` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 18:00:53.659673 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1bae58-e97a-46a5-958b-c6e086a2e676 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d837ee9c5edb438c88b870a4945fac0a)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 18:00:53.661621 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1bae58-e97a-46a5-958b-c6e086a2e676 admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 18:00:53.779839 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-af1bae58-e97a-46a5-958b-c6e086a2e676 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd837ee9c5edb438c88b870a4945fac0a', 'request_id': 'req-af1bae58-e97a-46a5-958b-c6e086a2e676'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 18:00:53.785435 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-af1bae58-e97a-46a5-958b-c6e086a2e676 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd837ee9c5edb438c88b870a4945fac0a', 'request_id': 'req-af1bae58-e97a-46a5-958b-c6e086a2e676'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 18:00:53.851769 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-af1bae58-e97a-46a5-958b-c6e086a2e676 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd837ee9c5edb438c88b870a4945fac0a', 'request_id': 'req-af1bae58-e97a-46a5-958b-c6e086a2e676'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 18:00:53.864067 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-af1bae58-e97a-46a5-958b-c6e086a2e676 admin admin] The token cache is being invalidate because project d837ee9c5edb438c88b870a4945fac0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 18:00:53.864359 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-af1bae58-e97a-46a5-958b-c6e086a2e676 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 18:00:53.865020 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-af1bae58-e97a-46a5-958b-c6e086a2e676 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 18:00:53.867144 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1459/2907] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 18:00:53 2022] DELETE /identity/v3/projects/d837ee9c5edb438c88b870a4945fac0a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 18:00:53.871085 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdab15a-7092-48bb-ad8e-422400160cca admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 18:00:53.872557 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-0fdab15a-7092-48bb-ad8e-422400160cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 18:00:53.887404 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdab15a-7092-48bb-ad8e-422400160cca admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 18:00:53.946967 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b9e37-54e2-41d5-b190-438cd32783c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 18:00:53.947597 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b9e37-54e2-41d5-b190-438cd32783c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 18:00:53.947879 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b9e37-54e2-41d5-b190-438cd32783c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 18:00:53.948154 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b9e37-54e2-41d5-b190-438cd32783c4 admin admin] PATH_INFO: `/v3/users/7bc10122aa9444dfa5bb6067a9b46ae3` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 18:00:53.949323 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b9e37-54e2-41d5-b190-438cd32783c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bc10122aa9444dfa5bb6067a9b46ae3)` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 18:00:53.951235 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b9e37-54e2-41d5-b190-438cd32783c4 admin admin] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 18:00:54.139512 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-f94b9e37-54e2-41d5-b190-438cd32783c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bc10122aa9444dfa5bb6067a9b46ae3'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 18:00:54.217724 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-f94b9e37-54e2-41d5-b190-438cd32783c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bc10122aa9444dfa5bb6067a9b46ae3'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 18:00:54.218342 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-f94b9e37-54e2-41d5-b190-438cd32783c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bc10122aa9444dfa5bb6067a9b46ae3'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 18:00:54.219202 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-f94b9e37-54e2-41d5-b190-438cd32783c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bc10122aa9444dfa5bb6067a9b46ae3'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 18:00:54.224597 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:00:54.227710 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.notifications [None req-f94b9e37-54e2-41d5-b190-438cd32783c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bc10122aa9444dfa5bb6067a9b46ae3'} {{(pid=86919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 18:00:54.245648 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1449/2908] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 8 18:00:53 2022] DELETE /identity/v3/users/7bc10122aa9444dfa5bb6067a9b46ae3 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 18:00:54.495645 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1bae58-e97a-46a5-958b-c6e086a2e676 admin admin] Authenticating user token {{(pid=86920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 18:00:54.497693 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.fernet_utils [None req-af1bae58-e97a-46a5-958b-c6e086a2e676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 18:00:54.512107 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1bae58-e97a-46a5-958b-c6e086a2e676 admin admin] Validating token access rules against request {{(pid=86920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 18:00:54.521074 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:00:54.572471 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27a1f7-d8e7-4910-8924-429f76c0bb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f82db915cef84d91b03fd2cabdc99332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8e66549226e41208010bac52754a1ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 18:00:54.573131 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27a1f7-d8e7-4910-8924-429f76c0bb6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 18:00:54.573417 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27a1f7-d8e7-4910-8924-429f76c0bb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 18:00:54.573693 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27a1f7-d8e7-4910-8924-429f76c0bb6f admin admin] PATH_INFO: `/v3/projects/19a534e77d64404cbdc8ef85d8f428b4` {{(pid=86920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 18:00:54.574835 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27a1f7-d8e7-4910-8924-429f76c0bb6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=19a534e77d64404cbdc8ef85d8f428b4)` {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 18:00:54.576747 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27a1f7-d8e7-4910-8924-429f76c0bb6f admin admin] RBAC: Authorization granted {{(pid=86920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 18:00:54.681195 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-cb27a1f7-d8e7-4910-8924-429f76c0bb6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19a534e77d64404cbdc8ef85d8f428b4', 'request_id': 'req-cb27a1f7-d8e7-4910-8924-429f76c0bb6f'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 18:00:54.686838 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-cb27a1f7-d8e7-4910-8924-429f76c0bb6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19a534e77d64404cbdc8ef85d8f428b4', 'request_id': 'req-cb27a1f7-d8e7-4910-8924-429f76c0bb6f'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 18:00:54.766546 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-cb27a1f7-d8e7-4910-8924-429f76c0bb6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19a534e77d64404cbdc8ef85d8f428b4', 'request_id': 'req-cb27a1f7-d8e7-4910-8924-429f76c0bb6f'} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 18:00:54.778879 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-cb27a1f7-d8e7-4910-8924-429f76c0bb6f admin admin] The token cache is being invalidate because project 19a534e77d64404cbdc8ef85d8f428b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 18:00:54.779174 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-cb27a1f7-d8e7-4910-8924-429f76c0bb6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 18:00:54.779834 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG keystone.notifications [None req-cb27a1f7-d8e7-4910-8924-429f76c0bb6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 18:00:54.781360 dv-cinder-852364-1-smb devstack@keystone.service[86920]: [pid: 86920|app: 0|req: 1460/2909] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 8 18:00:54 2022] DELETE /identity/v3/projects/19a534e77d64404cbdc8ef85d8f428b4 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 18:01:04.339565 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=8,keystone:DELETE=2 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:01:04.775753 dv-cinder-852364-1-smb devstack@keystone.service[86920]: DEBUG dbcounter [-] [86920] Writing DB stats keystone:SELECT=46,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 18:03:55.612854 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b9e37-54e2-41d5-b190-438cd32783c4 admin admin] Authenticating user token {{(pid=86919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 18:03:55.614371 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-f94b9e37-54e2-41d5-b190-438cd32783c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 18:03:55.685554 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b9e37-54e2-41d5-b190-438cd32783c4 admin admin] Validating token access rules against request {{(pid=86919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 18:03:55.744517 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d041b6e-2a58-4458-bb7b-424e81c318cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68717c19e74e434da825d9b1d6ca202a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '047a28b7cd11486da9d330723a384812', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 18:03:55.745157 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d041b6e-2a58-4458-bb7b-424e81c318cb service placement] REQUEST_METHOD: `GET` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 18:03:55.745446 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d041b6e-2a58-4458-bb7b-424e81c318cb service placement] SCRIPT_NAME: `/identity` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 18:03:55.745722 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d041b6e-2a58-4458-bb7b-424e81c318cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 18:03:55.747462 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.fernet_utils [None req-1d041b6e-2a58-4458-bb7b-424e81c318cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 18:03:55.759188 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d041b6e-2a58-4458-bb7b-424e81c318cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 18:03:55.760742 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d041b6e-2a58-4458-bb7b-424e81c318cb service placement] RBAC: Authorization granted {{(pid=86919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 18:03:55.770493 dv-cinder-852364-1-smb devstack@keystone.service[86919]: [pid: 86919|app: 0|req: 1450/2910] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 8 18:03:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 18:04:05.766283 dv-cinder-852364-1-smb devstack@keystone.service[86919]: DEBUG dbcounter [-] [86919] Writing DB stats keystone:SELECT=58 {{(pid=86919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}